2024-09-11T22:09:28.077 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T22:09:28.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:09:28.196 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901418' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGcuv6dGY6mdVQLn3XTr4n/Zxnc4ksoGi3/98TtFwK6mbnzI4sn68pwmDS51lM6kogEYoHgTQMMSZG/2sPb6HI= smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgS0Ssma6ChGzFs9N9hj65lpLhK5aK+wQFA4rrxrUYJ4OshD1emDc127YbsHo9XdHLrsKWdRV7ON5Q31o2Bfag= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/Q77KLnFkdk7eHaYJO8DJb2n1DRa5WIaKafep/GlrVBe7rRsU9DWXvnvue5XhqEhRveHYwi3Fr35Y36qGsbp8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T22:09:28.197 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T22:09:28.197 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T22:09:28.197 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T22:09:28.199 INFO:teuthology.task.internal:Checking packages... 2024-09-11T22:09:28.220 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T22:09:28.220 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T22:09:28.220 INFO:teuthology.packaging:ref: None 2024-09-11T22:09:28.220 INFO:teuthology.packaging:tag: None 2024-09-11T22:09:28.220 INFO:teuthology.packaging:branch: squid 2024-09-11T22:09:28.220 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:09:28.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T22:09:28.447 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T22:09:28.449 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T22:09:28.455 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T22:09:28.455 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T22:09:28.517 INFO:teuthology.task.internal:Saving configuration 2024-09-11T22:09:28.537 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T22:09:28.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T22:09:28.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:04:15.013181', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGcuv6dGY6mdVQLn3XTr4n/Zxnc4ksoGi3/98TtFwK6mbnzI4sn68pwmDS51lM6kogEYoHgTQMMSZG/2sPb6HI='} 2024-09-11T22:09:28.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:04:15.014565', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPgS0Ssma6ChGzFs9N9hj65lpLhK5aK+wQFA4rrxrUYJ4OshD1emDc127YbsHo9XdHLrsKWdRV7ON5Q31o2Bfag='} 2024-09-11T22:09:28.664 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:04:15.015719', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/Q77KLnFkdk7eHaYJO8DJb2n1DRa5WIaKafep/GlrVBe7rRsU9DWXvnvue5XhqEhRveHYwi3Fr35Y36qGsbp8='} 2024-09-11T22:09:28.664 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T22:09:28.669 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T22:09:28.669 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T22:09:28.669 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T22:09:28.669 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T22:09:28.754 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e794d75b0>, signals=[15]) 2024-09-11T22:09:28.755 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T22:09:28.760 INFO:teuthology.task.internal:Opening connections... 2024-09-11T22:09:28.761 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:09:28.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:09:28.836 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-09-11T22:09:28.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:09:28.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-11T22:09:28.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:09:29.002 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T22:09:29.006 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-11T22:09:29.024 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-11T22:09:29.024 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-11T22:09:29.082 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-11T22:09:29.082 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-11T22:09:29.082 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-11T22:09:29.082 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:09:29.082 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:09:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:09:29.084 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-11T22:09:29.113 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-09-11T22:09:29.132 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-09-11T22:09:29.132 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:09:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:09:29.191 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:09:29.191 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-09-11T22:09:29.213 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-11T22:09:29.232 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-11T22:09:29.232 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:09:29.290 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:09:29.291 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:09:29.291 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-11T22:09:29.313 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T22:09:29.326 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T22:09:29.395 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T22:09:29.395 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:09:29.397 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:09:29.399 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:09:29.416 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T22:09:29.424 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T22:09:29.424 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:09:29.455 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:09:29.457 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:09:29.483 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T22:09:29.562 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T22:09:29.637 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T22:09:29.638 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-11T22:09:29.638 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-11T22:09:29.638 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:09:29.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:09:29.655 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-11T22:09:29.713 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-503.el9.x86_64 2024-09-11T22:09:29.713 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-503.el9.x86_64 2024-09-11T22:09:29.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-09-11T22:09:31.894 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T22:09:37.003 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-11T22:09:42.687 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-11T22:09:44.420 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-11T22:09:45.649 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T22:09:51.239 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T22:09:53.312 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T22:09:53.312 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T22:09:53.411 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T22:09:53.422 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 79 M 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 126 M 2024-09-11T22:09:53.423 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-11T22:09:53.648 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 221 kB/s | 23 kB 00:00 2024-09-11T22:09:54.040 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T22:09:54.466 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 35 MB/s | 29 MB 00:00 2024-09-11T22:09:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-11T22:09:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:09:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-11T22:09:55.491 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-11T22:09:55.877 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-11T22:09:55.877 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-11T22:09:56.838 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-11T22:09:56.839 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-11T22:09:59.528 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-11T22:10:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:10:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:03.074 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:03.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:08.326 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:08.371 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:13.508 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:52.023 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:52.064 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:52.423 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:52.423 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:10:52.423 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:52.423 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.329 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:10:53.330 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-11T22:10:53.706 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:10:53.803 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:10:53.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T22:10:53.804 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:10:53.804 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:10:53.804 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-11T22:10:53.804 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:10:53.804 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:10:53.863 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:10:53.864 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:10:53.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-09-11T22:10:53.900 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 82.el9 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8274670 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:10:53.901 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:10:53.902 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:10:53.903 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:10:53.903 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 5.14.0-505.el9.x86_64 2024-09-11T22:10:53.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:10:54.568 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-09-11T22:10:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:10:55.874 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-09-11T22:10:55.877 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-09-11T22:10:55.892 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.MvcG3QBxyI 2024-09-11T22:10:55.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MvcG3QBxyI 2024-09-11T22:10:55.958 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.MvcG3QBxyI 2024-09-11T22:10:56.103 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.MvcG3QBxyI is 6KB 2024-09-11T22:10:56.153 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.MvcG3QBxyI 2024-09-11T22:10:56.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:10:56.230 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:10:56.231 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:10:56.231 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:10:56.231 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T22:10:56.232 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T22:10:56.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-09-11T22:11:26.389 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T22:11:26.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-11T22:11:26.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:12:26.393 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T22:12:35.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-11T22:12:35.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:12:35.903 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-11T22:12:36.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-11T22:12:36.250 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-11T22:12:36.251 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-11T22:12:36.266 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-505.el9.x86_64 2024-09-11T22:12:36.266 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T22:12:36.266 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:12:36.266 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:12:37.267 DEBUG:teuthology.parallel:result is None 2024-09-11T22:12:37.268 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T22:12:37.275 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T22:12:37.275 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:12:37.280 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:12:37.283 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:12:37.302 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T22:12:37.333 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T22:12:37.423 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T22:12:37.423 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:12:37.426 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:12:37.428 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:12:37.547 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T22:12:37.553 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T22:12:37.553 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:12:37.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:12:37.570 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:12:37.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:12:37.588 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:12:37.590 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:12:37.613 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:12:37.647 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.660 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.669 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.696 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.702 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.713 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:12:37.715 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T22:12:37.721 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T22:12:37.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:12:37.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:12:37.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:12:37.754 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T22:12:37.772 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T22:12:37.772 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:12:37.788 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:12:37.795 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:12:37.812 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:37.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:37.923 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:37.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:38.039 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:12:38.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:12:38.100 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:38.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:38.203 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:38.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:38.329 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:12:38.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:12:38.396 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:38.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:12:38.497 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:38.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:12:38.624 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:12:38.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:12:38.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-11T22:12:38.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-09-11T22:12:38.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-11T22:12:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:12:38.766 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:12:38.777 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:12:39.207 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T22:12:39.214 INFO:teuthology.task.internal:Starting timer... 2024-09-11T22:12:39.214 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T22:12:39.291 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T22:12:39.324 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T22:12:39.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-11T22:12:39.381 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-11T22:12:39.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-09-11T22:12:39.451 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-09-11T22:12:39.453 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-11T22:12:39.523 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-11T22:12:39.525 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T22:12:39.525 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-11T22:12:39.544 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-11T22:12:39.545 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-09-11T22:12:39.569 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-09-11T22:12:39.569 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-11T22:12:39.606 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-11T22:12:39.607 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-11T22:12:39.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:12:39.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:12:39.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:12:39.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:12:39.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:12:39.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:12:39.690 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T22:12:39.690 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:12:39.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:12:39.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:12:39.788 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T22:12:39.798 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T22:12:39.810 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T22:12:39.811 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi045.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T22:16:42.072 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-11T22:16:42.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-11T22:16:42.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:42.150 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-11T22:16:42.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-11T22:16:42.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-11T22:16:42.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:42.311 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-09-11T22:16:42.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-11T22:16:42.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-11T22:16:42.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:42.482 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-11T22:16:42.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-11T22:16:42.568 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T22:16:42.580 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T22:16:42.580 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:42.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:42.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:42.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:42.586 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:42.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:42.629 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:42.632 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:42.641 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:42.654 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-11T22:16:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-09-11T22:16:42.666 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-11T22:16:42.670 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-09-11T22:16:42.681 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-11T22:16:42.682 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:42.685 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:42.693 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-11T22:16:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:42.700 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:42.707 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:42.721 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:42.759 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.763 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:42.763 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-11T22:16:42.763 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.763 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.764 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.764 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.778 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:42.782 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:42.782 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-11T22:16:42.782 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.782 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.783 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.783 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:42.783 INFO:teuthology.run_tasks:Running task install... 2024-09-11T22:16:42.792 DEBUG:teuthology.task.install:project ceph 2024-09-11T22:16:42.792 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T22:16:42.792 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T22:16:42.792 INFO:teuthology.task.install:Using flavor: default 2024-09-11T22:16:42.798 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T22:16:42.798 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T22:16:42.799 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:42.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:42.801 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:42.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:42.802 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:42.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:42.948 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:42.949 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:42.965 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:42.965 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:42.984 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:42.984 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:43.067 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:43.067 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:16:43.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:43.088 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:43.089 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:16:43.089 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:43.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:43.096 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:16:43.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:43.098 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:43.098 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:43.116 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:43.116 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:43.124 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:43.124 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:43.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:43.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:43.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:43.243 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:43.257 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:43.264 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:43.308 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-11T22:16:43.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-11T22:16:43.321 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-11T22:16:43.323 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-11T22:16:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-09-11T22:16:43.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-09-11T22:16:43.547 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-11T22:16:43.561 INFO:teuthology.orchestra.run.smithi045.stdout:45 files removed 2024-09-11T22:16:43.562 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-11T22:16:43.574 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:43.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:43.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:44.135 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-11T22:16:44.145 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-11T22:16:44.167 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-11T22:16:44.419 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T22:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T22:16:44.451 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T22:16:44.695 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T22:16:44.704 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T22:16:44.751 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-11T22:16:45.818 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.2 MB 00:01 2024-09-11T22:16:46.413 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-11T22:16:46.728 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:01 2024-09-11T22:16:47.628 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-11T22:16:48.754 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-11T22:16:49.532 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-11T22:16:52.087 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T22:16:53.247 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-11T22:16:53.898 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-11T22:16:54.639 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-11T22:16:54.654 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-11T22:16:55.499 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 19 kB 00:00 2024-09-11T22:16:55.594 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T22:16:55.617 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T22:16:56.245 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-11T22:17:01.050 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T22:17:01.298 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T22:17:01.918 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T22:17:03.370 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.371 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.385 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:17:03.386 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.387 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:17:03.388 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.390 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:17:03.393 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.394 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.457 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-11T22:17:03.472 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-11T22:17:03.472 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:17:03.473 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:17:03.474 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:17:03.475 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:17:03.476 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:17:03.478 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:17:03.479 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:17:03.480 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:17:03.481 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:17:03.482 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:17:03.483 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:17:03.484 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-11T22:17:03.485 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-11T22:17:03.486 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-11T22:17:03.486 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-11T22:17:03.486 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:17:03.486 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 226 M 2024-09-11T22:17:03.486 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-11T22:17:03.725 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.726 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.737 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:17:03.738 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:17:03.739 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:17:03.740 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.741 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:17:03.744 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.745 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:17:03.811 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-11T22:17:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-11T22:17:03.829 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-11T22:17:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-11T22:17:03.829 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:17:03.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:17:03.832 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:17:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:17:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:17:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:17:03.837 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:17:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:17:03.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:17:03.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:17:03.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:17:03.842 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:17:03.843 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-11T22:17:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-11T22:17:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-09-11T22:17:03.844 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-11T22:17:03.844 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:03.846 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 226 M 2024-09-11T22:17:03.846 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-11T22:17:04.151 INFO:teuthology.orchestra.run.smithi169.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-11T22:17:04.271 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:04.272 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:04.285 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:17:04.288 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:17:04.288 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:17:04.288 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:17:04.289 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:17:04.291 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:17:04.293 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:17:04.360 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:17:04.371 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:17:04.372 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:17:04.373 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:17:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:17:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:17:04.376 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:17:04.377 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:17:04.378 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:17:04.379 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:17:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:17:04.381 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:17:04.382 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:17:04.383 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout:Install 148 Packages 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 8 Packages 2024-09-11T22:17:04.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:04.385 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 226 M 2024-09-11T22:17:04.385 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-11T22:17:04.392 INFO:teuthology.orchestra.run.smithi169.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-11T22:17:04.526 INFO:teuthology.orchestra.run.smithi169.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T22:17:04.532 INFO:teuthology.orchestra.run.smithi022.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-11T22:17:04.551 INFO:teuthology.orchestra.run.smithi169.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 915 kB/s | 145 kB 00:00 2024-09-11T22:17:04.635 INFO:teuthology.orchestra.run.smithi169.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-11T22:17:04.869 INFO:teuthology.orchestra.run.smithi169.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.8 MB/s | 1.5 MB 00:00 2024-09-11T22:17:04.944 INFO:teuthology.orchestra.run.smithi169.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 4.7 MB 00:00 2024-09-11T22:17:05.041 INFO:teuthology.orchestra.run.smithi022.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 897 kB 00:00 2024-09-11T22:17:05.133 INFO:teuthology.orchestra.run.smithi022.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-11T22:17:05.203 INFO:teuthology.orchestra.run.smithi045.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-11T22:17:05.211 INFO:teuthology.orchestra.run.smithi169.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-11T22:17:05.253 INFO:teuthology.orchestra.run.smithi169.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 611 kB/s | 25 kB 00:00 2024-09-11T22:17:05.545 INFO:teuthology.orchestra.run.smithi169.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-11T22:17:05.612 INFO:teuthology.orchestra.run.smithi169.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-11T22:17:05.616 INFO:teuthology.orchestra.run.smithi022.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-09-11T22:17:05.695 INFO:teuthology.orchestra.run.smithi169.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 325 kB/s | 27 kB 00:00 2024-09-11T22:17:05.812 INFO:teuthology.orchestra.run.smithi169.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 272 kB/s | 32 kB 00:00 2024-09-11T22:17:05.920 INFO:teuthology.orchestra.run.smithi022.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-11T22:17:05.922 INFO:teuthology.orchestra.run.smithi045.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 897 kB 00:00 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.0 MB/s | 145 kB 00:00 2024-09-11T22:17:06.183 INFO:teuthology.orchestra.run.smithi022.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 2.7 MB/s | 1.5 MB 00:00 2024-09-11T22:17:06.871 INFO:teuthology.orchestra.run.smithi169.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 710 kB/s | 752 kB 00:01 2024-09-11T22:17:06.954 INFO:teuthology.orchestra.run.smithi169.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-11T22:17:06.992 INFO:teuthology.orchestra.run.smithi022.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-09-11T22:17:07.029 INFO:teuthology.orchestra.run.smithi045.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-09-11T22:17:07.038 INFO:teuthology.orchestra.run.smithi169.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T22:17:07.121 INFO:teuthology.orchestra.run.smithi045.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-09-11T22:17:07.138 INFO:teuthology.orchestra.run.smithi169.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.9 MB/s | 506 kB 00:00 2024-09-11T22:17:07.513 INFO:teuthology.orchestra.run.smithi045.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 3.1 MB/s | 1.5 MB 00:00 2024-09-11T22:17:07.789 INFO:teuthology.orchestra.run.smithi169.stdout:(18/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-11T22:17:07.839 INFO:teuthology.orchestra.run.smithi169.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 911 kB/s | 45 kB 00:00 2024-09-11T22:17:07.906 INFO:teuthology.orchestra.run.smithi169.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 7.0 MB/s | 5.3 MB 00:00 2024-09-11T22:17:07.931 INFO:teuthology.orchestra.run.smithi169.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-11T22:17:07.956 INFO:teuthology.orchestra.run.smithi169.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-11T22:17:07.975 INFO:teuthology.orchestra.run.smithi022.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 5.8 MB/s | 21 MB 00:03 2024-09-11T22:17:07.990 INFO:teuthology.orchestra.run.smithi169.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T22:17:08.015 INFO:teuthology.orchestra.run.smithi169.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T22:17:08.034 INFO:teuthology.orchestra.run.smithi022.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-11T22:17:08.040 INFO:teuthology.orchestra.run.smithi169.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T22:17:08.074 INFO:teuthology.orchestra.run.smithi169.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-11T22:17:08.096 INFO:teuthology.orchestra.run.smithi045.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 4.8 MB/s | 4.7 MB 00:00 2024-09-11T22:17:08.149 INFO:teuthology.orchestra.run.smithi169.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-11T22:17:08.333 INFO:teuthology.orchestra.run.smithi169.stdout:(28/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 4.9 MB/s | 17 MB 00:03 2024-09-11T22:17:08.358 INFO:teuthology.orchestra.run.smithi169.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 153 kB/s | 32 kB 00:00 2024-09-11T22:17:08.417 INFO:teuthology.orchestra.run.smithi169.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 8.2 MB/s | 3.1 MB 00:00 2024-09-11T22:17:08.442 INFO:teuthology.orchestra.run.smithi169.stdout:(31/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.3 MB/s | 146 kB 00:00 2024-09-11T22:17:08.600 INFO:teuthology.orchestra.run.smithi169.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.5 MB/s | 249 kB 00:00 2024-09-11T22:17:08.709 INFO:teuthology.orchestra.run.smithi169.stdout:(33/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-11T22:17:08.734 INFO:teuthology.orchestra.run.smithi169.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 369 kB/s | 49 kB 00:00 2024-09-11T22:17:08.784 INFO:teuthology.orchestra.run.smithi169.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 219 kB/s | 16 kB 00:00 2024-09-11T22:17:08.902 INFO:teuthology.orchestra.run.smithi169.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-11T22:17:08.927 INFO:teuthology.orchestra.run.smithi169.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 285 kB 00:00 2024-09-11T22:17:09.053 INFO:teuthology.orchestra.run.smithi169.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-11T22:17:09.078 INFO:teuthology.orchestra.run.smithi169.stdout:(39/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 104 kB/s | 18 kB 00:00 2024-09-11T22:17:09.144 INFO:teuthology.orchestra.run.smithi169.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 367 kB/s | 80 kB 00:00 2024-09-11T22:17:09.167 INFO:teuthology.orchestra.run.smithi022.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 4.9 MB/s | 11 MB 00:02 2024-09-11T22:17:09.203 INFO:teuthology.orchestra.run.smithi169.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-11T22:17:09.229 INFO:teuthology.orchestra.run.smithi169.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T22:17:09.271 INFO:teuthology.orchestra.run.smithi169.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-11T22:17:09.287 INFO:teuthology.orchestra.run.smithi169.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T22:17:09.314 INFO:teuthology.orchestra.run.smithi169.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-09-11T22:17:09.334 INFO:teuthology.orchestra.run.smithi022.stdout:(11/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 17 MB 00:03 2024-09-11T22:17:09.339 INFO:teuthology.orchestra.run.smithi169.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 5.0 MB/s | 21 MB 00:04 2024-09-11T22:17:09.360 INFO:teuthology.orchestra.run.smithi022.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 228 kB 00:00 2024-09-11T22:17:09.364 INFO:teuthology.orchestra.run.smithi169.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T22:17:09.377 INFO:teuthology.orchestra.run.smithi022.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 648 kB/s | 27 kB 00:00 2024-09-11T22:17:09.402 INFO:teuthology.orchestra.run.smithi022.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 759 kB/s | 32 kB 00:00 2024-09-11T22:17:09.405 INFO:teuthology.orchestra.run.smithi045.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 507 kB/s | 25 kB 00:00 2024-09-11T22:17:09.406 INFO:teuthology.orchestra.run.smithi169.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-11T22:17:09.452 INFO:teuthology.orchestra.run.smithi022.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-11T22:17:09.494 INFO:teuthology.orchestra.run.smithi022.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 6.3 MB/s | 752 kB 00:00 2024-09-11T22:17:09.519 INFO:teuthology.orchestra.run.smithi022.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.8 MB/s | 127 kB 00:00 2024-09-11T22:17:09.595 INFO:teuthology.orchestra.run.smithi022.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.9 MB/s | 506 kB 00:00 2024-09-11T22:17:09.654 INFO:teuthology.orchestra.run.smithi022.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 772 kB/s | 45 kB 00:00 2024-09-11T22:17:09.729 INFO:teuthology.orchestra.run.smithi022.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-11T22:17:09.796 INFO:teuthology.orchestra.run.smithi022.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T22:17:09.879 INFO:teuthology.orchestra.run.smithi022.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 321 kB 00:00 2024-09-11T22:17:09.938 INFO:teuthology.orchestra.run.smithi022.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T22:17:09.939 INFO:teuthology.orchestra.run.smithi045.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 6.9 MB/s | 17 MB 00:02 2024-09-11T22:17:09.997 INFO:teuthology.orchestra.run.smithi022.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-11T22:17:09.997 INFO:teuthology.orchestra.run.smithi045.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-11T22:17:10.047 INFO:teuthology.orchestra.run.smithi022.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T22:17:10.056 INFO:teuthology.orchestra.run.smithi045.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 464 kB/s | 27 kB 00:00 2024-09-11T22:17:10.173 INFO:teuthology.orchestra.run.smithi169.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 139 kB/s | 107 kB 00:00 2024-09-11T22:17:10.209 INFO:teuthology.orchestra.run.smithi045.stdout:(13/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 5.0 MB/s | 11 MB 00:02 2024-09-11T22:17:10.231 INFO:teuthology.orchestra.run.smithi045.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 181 kB/s | 32 kB 00:00 2024-09-11T22:17:10.290 INFO:teuthology.orchestra.run.smithi045.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T22:17:10.331 INFO:teuthology.orchestra.run.smithi022.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 6.6 MB/s | 5.3 MB 00:00 2024-09-11T22:17:10.348 INFO:teuthology.orchestra.run.smithi045.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T22:17:10.374 INFO:teuthology.orchestra.run.smithi045.stdout:(17/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.4 MB/s | 752 kB 00:00 2024-09-11T22:17:10.389 INFO:teuthology.orchestra.run.smithi022.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-11T22:17:10.457 INFO:teuthology.orchestra.run.smithi045.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.6 MB/s | 506 kB 00:00 2024-09-11T22:17:10.473 INFO:teuthology.orchestra.run.smithi022.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 3.1 MB 00:00 2024-09-11T22:17:10.498 INFO:teuthology.orchestra.run.smithi022.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 293 kB/s | 32 kB 00:00 2024-09-11T22:17:10.507 INFO:teuthology.orchestra.run.smithi045.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 904 kB/s | 45 kB 00:00 2024-09-11T22:17:10.523 INFO:teuthology.orchestra.run.smithi022.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T22:17:10.566 INFO:teuthology.orchestra.run.smithi045.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-11T22:17:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T22:17:10.732 INFO:teuthology.orchestra.run.smithi169.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-11T22:17:10.734 INFO:teuthology.orchestra.run.smithi045.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-11T22:17:10.834 INFO:teuthology.orchestra.run.smithi045.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-11T22:17:10.874 INFO:teuthology.orchestra.run.smithi169.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 449 kB/s | 689 kB 00:01 2024-09-11T22:17:10.901 INFO:teuthology.orchestra.run.smithi045.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 100 kB 00:00 2024-09-11T22:17:10.968 INFO:teuthology.orchestra.run.smithi045.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.3 MB/s | 85 kB 00:00 2024-09-11T22:17:11.041 INFO:teuthology.orchestra.run.smithi022.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.6 MB/s | 3.6 MB 00:00 2024-09-11T22:17:11.091 INFO:teuthology.orchestra.run.smithi022.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-11T22:17:11.102 INFO:teuthology.orchestra.run.smithi045.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-11T22:17:11.141 INFO:teuthology.orchestra.run.smithi022.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 992 kB/s | 49 kB 00:00 2024-09-11T22:17:11.160 INFO:teuthology.orchestra.run.smithi045.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-11T22:17:11.199 INFO:teuthology.orchestra.run.smithi022.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 282 kB/s | 16 kB 00:00 2024-09-11T22:17:11.207 INFO:teuthology.orchestra.run.smithi169.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 512 kB/s | 943 kB 00:01 2024-09-11T22:17:11.210 INFO:teuthology.orchestra.run.smithi045.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 635 kB/s | 32 kB 00:00 2024-09-11T22:17:11.291 INFO:teuthology.orchestra.run.smithi022.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.0 MB/s | 285 kB 00:00 2024-09-11T22:17:11.294 INFO:teuthology.orchestra.run.smithi045.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-11T22:17:11.424 INFO:teuthology.orchestra.run.smithi169.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-11T22:17:11.450 INFO:teuthology.orchestra.run.smithi022.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-11T22:17:11.484 INFO:teuthology.orchestra.run.smithi022.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-11T22:17:11.509 INFO:teuthology.orchestra.run.smithi022.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 311 kB/s | 18 kB 00:00 2024-09-11T22:17:11.511 INFO:teuthology.orchestra.run.smithi045.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.7 MB/s | 3.1 MB 00:00 2024-09-11T22:17:11.685 INFO:teuthology.orchestra.run.smithi022.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-11T22:17:11.728 INFO:teuthology.orchestra.run.smithi045.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 8.2 MB/s | 3.6 MB 00:00 2024-09-11T22:17:11.752 INFO:teuthology.orchestra.run.smithi022.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-11T22:17:11.770 INFO:teuthology.orchestra.run.smithi045.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 5.9 MB/s | 249 kB 00:00 2024-09-11T22:17:11.776 INFO:teuthology.orchestra.run.smithi022.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-11T22:17:11.782 INFO:teuthology.orchestra.run.smithi169.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 299 kB/s | 313 kB 00:01 2024-09-11T22:17:11.810 INFO:teuthology.orchestra.run.smithi022.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-11T22:17:11.826 INFO:teuthology.orchestra.run.smithi045.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 893 kB/s | 49 kB 00:00 2024-09-11T22:17:11.869 INFO:teuthology.orchestra.run.smithi022.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T22:17:11.876 INFO:teuthology.orchestra.run.smithi045.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-11T22:17:11.928 INFO:teuthology.orchestra.run.smithi022.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-09-11T22:17:11.935 INFO:teuthology.orchestra.run.smithi045.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T22:17:11.953 INFO:teuthology.orchestra.run.smithi022.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-11T22:17:11.958 INFO:teuthology.orchestra.run.smithi169.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-09-11T22:17:11.986 INFO:teuthology.orchestra.run.smithi022.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T22:17:12.029 INFO:teuthology.orchestra.run.smithi022.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T22:17:12.060 INFO:teuthology.orchestra.run.smithi045.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-11T22:17:12.110 INFO:teuthology.orchestra.run.smithi045.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 365 kB/s | 18 kB 00:00 2024-09-11T22:17:12.219 INFO:teuthology.orchestra.run.smithi045.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 737 kB/s | 80 kB 00:00 2024-09-11T22:17:12.283 INFO:teuthology.orchestra.run.smithi169.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-11T22:17:12.319 INFO:teuthology.orchestra.run.smithi045.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 7.9 MB/s | 801 kB 00:00 2024-09-11T22:17:12.361 INFO:teuthology.orchestra.run.smithi045.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-11T22:17:12.403 INFO:teuthology.orchestra.run.smithi045.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-11T22:17:12.487 INFO:teuthology.orchestra.run.smithi045.stdout:(42/156): ceph-mgr-diskprediction-local-19.1.1- 7.6 MB/s | 7.4 MB 00:00 2024-09-11T22:17:12.529 INFO:teuthology.orchestra.run.smithi045.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-11T22:17:12.571 INFO:teuthology.orchestra.run.smithi045.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-11T22:17:12.613 INFO:teuthology.orchestra.run.smithi045.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-11T22:17:12.621 INFO:teuthology.orchestra.run.smithi022.stdout:(48/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 11 MB/s | 49 MB 00:04 2024-09-11T22:17:12.638 INFO:teuthology.orchestra.run.smithi045.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 706 kB/s | 106 kB 00:00 2024-09-11T22:17:12.655 INFO:teuthology.orchestra.run.smithi045.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-11T22:17:12.663 INFO:teuthology.orchestra.run.smithi022.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-11T22:17:12.704 INFO:teuthology.orchestra.run.smithi022.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 526 kB/s | 22 kB 00:00 2024-09-11T22:17:12.738 INFO:teuthology.orchestra.run.smithi022.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-11T22:17:12.758 INFO:teuthology.orchestra.run.smithi169.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 200 kB/s | 160 kB 00:00 2024-09-11T22:17:12.772 INFO:teuthology.orchestra.run.smithi022.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-11T22:17:12.797 INFO:teuthology.orchestra.run.smithi022.stdout:(53/156): boost-program-options-1.75.0-8.el9.x8 608 kB/s | 107 kB 00:00 2024-09-11T22:17:12.814 INFO:teuthology.orchestra.run.smithi022.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-11T22:17:12.848 INFO:teuthology.orchestra.run.smithi022.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-09-11T22:17:12.873 INFO:teuthology.orchestra.run.smithi022.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-11T22:17:12.898 INFO:teuthology.orchestra.run.smithi022.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-11T22:17:12.914 INFO:teuthology.orchestra.run.smithi045.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-11T22:17:12.923 INFO:teuthology.orchestra.run.smithi022.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-11T22:17:12.956 INFO:teuthology.orchestra.run.smithi045.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-11T22:17:12.973 INFO:teuthology.orchestra.run.smithi022.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-11T22:17:13.006 INFO:teuthology.orchestra.run.smithi045.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-11T22:17:13.007 INFO:teuthology.orchestra.run.smithi022.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-11T22:17:13.032 INFO:teuthology.orchestra.run.smithi022.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-11T22:17:13.040 INFO:teuthology.orchestra.run.smithi045.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-11T22:17:13.058 INFO:teuthology.orchestra.run.smithi022.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-11T22:17:13.090 INFO:teuthology.orchestra.run.smithi045.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-09-11T22:17:13.091 INFO:teuthology.orchestra.run.smithi022.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T22:17:13.108 INFO:teuthology.orchestra.run.smithi169.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 55 kB/s | 45 kB 00:00 2024-09-11T22:17:13.117 INFO:teuthology.orchestra.run.smithi022.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-11T22:17:13.124 INFO:teuthology.orchestra.run.smithi045.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-11T22:17:13.142 INFO:teuthology.orchestra.run.smithi022.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-11T22:17:13.167 INFO:teuthology.orchestra.run.smithi022.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T22:17:13.174 INFO:teuthology.orchestra.run.smithi045.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-09-11T22:17:13.225 INFO:teuthology.orchestra.run.smithi045.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T22:17:13.251 INFO:teuthology.orchestra.run.smithi022.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-11T22:17:13.293 INFO:teuthology.orchestra.run.smithi022.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T22:17:13.308 INFO:teuthology.orchestra.run.smithi045.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-11T22:17:13.335 INFO:teuthology.orchestra.run.smithi022.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-11T22:17:13.358 INFO:teuthology.orchestra.run.smithi045.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-09-11T22:17:13.360 INFO:teuthology.orchestra.run.smithi022.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T22:17:13.435 INFO:teuthology.orchestra.run.smithi022.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-11T22:17:13.478 INFO:teuthology.orchestra.run.smithi022.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-11T22:17:13.503 INFO:teuthology.orchestra.run.smithi022.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-11T22:17:13.526 INFO:teuthology.orchestra.run.smithi045.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-11T22:17:13.595 INFO:teuthology.orchestra.run.smithi022.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-11T22:17:13.611 INFO:teuthology.orchestra.run.smithi022.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-11T22:17:13.645 INFO:teuthology.orchestra.run.smithi022.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.7 MB/s | 245 kB 00:00 2024-09-11T22:17:13.671 INFO:teuthology.orchestra.run.smithi022.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T22:17:13.688 INFO:teuthology.orchestra.run.smithi022.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-09-11T22:17:13.693 INFO:teuthology.orchestra.run.smithi045.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-11T22:17:13.704 INFO:teuthology.orchestra.run.smithi022.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-11T22:17:13.743 INFO:teuthology.orchestra.run.smithi045.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 492 kB/s | 24 kB 00:00 2024-09-11T22:17:13.788 INFO:teuthology.orchestra.run.smithi022.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-11T22:17:13.805 INFO:teuthology.orchestra.run.smithi022.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-11T22:17:13.830 INFO:teuthology.orchestra.run.smithi022.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-11T22:17:13.856 INFO:teuthology.orchestra.run.smithi022.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-11T22:17:13.881 INFO:teuthology.orchestra.run.smithi022.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-11T22:17:13.907 INFO:teuthology.orchestra.run.smithi022.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T22:17:13.923 INFO:teuthology.orchestra.run.smithi022.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-11T22:17:13.974 INFO:teuthology.orchestra.run.smithi022.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-11T22:17:13.999 INFO:teuthology.orchestra.run.smithi022.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-11T22:17:14.024 INFO:teuthology.orchestra.run.smithi022.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-11T22:17:14.049 INFO:teuthology.orchestra.run.smithi022.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T22:17:14.066 INFO:teuthology.orchestra.run.smithi022.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-11T22:17:14.150 INFO:teuthology.orchestra.run.smithi022.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-11T22:17:14.175 INFO:teuthology.orchestra.run.smithi022.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-11T22:17:14.185 INFO:teuthology.orchestra.run.smithi045.stdout:(61/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 10 MB/s | 49 MB 00:04 2024-09-11T22:17:14.200 INFO:teuthology.orchestra.run.smithi022.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-11T22:17:14.210 INFO:teuthology.orchestra.run.smithi045.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 102 kB/s | 47 kB 00:00 2024-09-11T22:17:14.226 INFO:teuthology.orchestra.run.smithi022.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-11T22:17:14.250 INFO:teuthology.orchestra.run.smithi169.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 444 kB/s | 662 kB 00:01 2024-09-11T22:17:14.251 INFO:teuthology.orchestra.run.smithi022.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-11T22:17:14.269 INFO:teuthology.orchestra.run.smithi045.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-11T22:17:14.276 INFO:teuthology.orchestra.run.smithi022.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T22:17:14.302 INFO:teuthology.orchestra.run.smithi022.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-11T22:17:14.319 INFO:teuthology.orchestra.run.smithi045.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T22:17:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T22:17:14.344 INFO:teuthology.orchestra.run.smithi045.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 513 kB/s | 38 kB 00:00 2024-09-11T22:17:14.352 INFO:teuthology.orchestra.run.smithi022.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T22:17:14.367 INFO:teuthology.orchestra.run.smithi169.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 462 kB/s | 581 kB 00:01 2024-09-11T22:17:14.377 INFO:teuthology.orchestra.run.smithi022.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T22:17:14.403 INFO:teuthology.orchestra.run.smithi022.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-11T22:17:14.461 INFO:teuthology.orchestra.run.smithi045.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-09-11T22:17:14.503 INFO:teuthology.orchestra.run.smithi022.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-11T22:17:14.570 INFO:teuthology.orchestra.run.smithi022.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-11T22:17:14.746 INFO:teuthology.orchestra.run.smithi022.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-11T22:17:14.771 INFO:teuthology.orchestra.run.smithi022.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-09-11T22:17:14.804 INFO:teuthology.orchestra.run.smithi022.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 591 kB/s | 19 kB 00:00 2024-09-11T22:17:14.809 INFO:teuthology.orchestra.run.smithi169.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-11T22:17:14.829 INFO:teuthology.orchestra.run.smithi022.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-11T22:17:14.855 INFO:teuthology.orchestra.run.smithi022.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-11T22:17:14.870 INFO:teuthology.orchestra.run.smithi045.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-09-11T22:17:14.888 INFO:teuthology.orchestra.run.smithi022.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-09-11T22:17:14.930 INFO:teuthology.orchestra.run.smithi022.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-11T22:17:14.956 INFO:teuthology.orchestra.run.smithi022.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-11T22:17:14.998 INFO:teuthology.orchestra.run.smithi022.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-11T22:17:15.023 INFO:teuthology.orchestra.run.smithi022.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:17:15.026 INFO:teuthology.orchestra.run.smithi169.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-09-11T22:17:15.048 INFO:teuthology.orchestra.run.smithi022.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T22:17:15.074 INFO:teuthology.orchestra.run.smithi022.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-11T22:17:15.090 INFO:teuthology.orchestra.run.smithi022.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-11T22:17:15.095 INFO:teuthology.orchestra.run.smithi045.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.0 MB/s | 910 kB 00:00 2024-09-11T22:17:15.116 INFO:teuthology.orchestra.run.smithi022.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-11T22:17:15.150 INFO:teuthology.orchestra.run.smithi022.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T22:17:15.154 INFO:teuthology.orchestra.run.smithi045.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T22:17:15.183 INFO:teuthology.orchestra.run.smithi022.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-11T22:17:15.208 INFO:teuthology.orchestra.run.smithi022.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T22:17:15.242 INFO:teuthology.orchestra.run.smithi022.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T22:17:15.259 INFO:teuthology.orchestra.run.smithi022.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-09-11T22:17:15.276 INFO:teuthology.orchestra.run.smithi022.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T22:17:15.293 INFO:teuthology.orchestra.run.smithi022.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T22:17:15.321 INFO:teuthology.orchestra.run.smithi045.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-09-11T22:17:15.360 INFO:teuthology.orchestra.run.smithi022.stdout:(126/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-11T22:17:15.377 INFO:teuthology.orchestra.run.smithi022.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-09-11T22:17:15.394 INFO:teuthology.orchestra.run.smithi022.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-11T22:17:15.411 INFO:teuthology.orchestra.run.smithi022.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T22:17:15.436 INFO:teuthology.orchestra.run.smithi022.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:17:15.453 INFO:teuthology.orchestra.run.smithi022.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-11T22:17:15.486 INFO:teuthology.orchestra.run.smithi022.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T22:17:15.512 INFO:teuthology.orchestra.run.smithi022.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 648 kB/s | 16 kB 00:00 2024-09-11T22:17:15.524 INFO:teuthology.orchestra.run.smithi045.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-09-11T22:17:15.546 INFO:teuthology.orchestra.run.smithi022.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-11T22:17:15.571 INFO:teuthology.orchestra.run.smithi022.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T22:17:15.588 INFO:teuthology.orchestra.run.smithi045.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-11T22:17:15.596 INFO:teuthology.orchestra.run.smithi022.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-11T22:17:15.613 INFO:teuthology.orchestra.run.smithi045.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 951 kB/s | 87 kB 00:00 2024-09-11T22:17:15.621 INFO:teuthology.orchestra.run.smithi022.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-11T22:17:15.664 INFO:teuthology.orchestra.run.smithi022.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-11T22:17:15.664 INFO:teuthology.orchestra.run.smithi045.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T22:17:15.689 INFO:teuthology.orchestra.run.smithi022.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 882 kB/s | 59 kB 00:00 2024-09-11T22:17:15.714 INFO:teuthology.orchestra.run.smithi022.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-11T22:17:15.739 INFO:teuthology.orchestra.run.smithi022.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-11T22:17:15.747 INFO:teuthology.orchestra.run.smithi045.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T22:17:15.766 INFO:teuthology.orchestra.run.smithi022.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 969 kB/s | 74 kB 00:00 2024-09-11T22:17:15.792 INFO:teuthology.orchestra.run.smithi022.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:15.817 INFO:teuthology.orchestra.run.smithi022.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T22:17:15.818 INFO:teuthology.orchestra.run.smithi169.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 664 kB/s | 3.0 MB 00:04 2024-09-11T22:17:15.839 INFO:teuthology.orchestra.run.smithi045.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-11T22:17:15.842 INFO:teuthology.orchestra.run.smithi022.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T22:17:15.843 INFO:teuthology.orchestra.run.smithi169.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 231 kB/s | 188 kB 00:00 2024-09-11T22:17:15.867 INFO:teuthology.orchestra.run.smithi022.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T22:17:15.868 INFO:teuthology.orchestra.run.smithi169.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 276 kB/s | 292 kB 00:01 2024-09-11T22:17:15.889 INFO:teuthology.orchestra.run.smithi045.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-11T22:17:15.918 INFO:teuthology.orchestra.run.smithi022.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-11T22:17:15.940 INFO:teuthology.orchestra.run.smithi045.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-11T22:17:15.968 INFO:teuthology.orchestra.run.smithi022.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T22:17:15.998 INFO:teuthology.orchestra.run.smithi045.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:17:16.057 INFO:teuthology.orchestra.run.smithi045.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-11T22:17:16.227 INFO:teuthology.orchestra.run.smithi022.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-11T22:17:16.333 INFO:teuthology.orchestra.run.smithi022.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.0 MB/s | 2.3 MB 00:00 2024-09-11T22:17:16.377 INFO:teuthology.orchestra.run.smithi022.stdout:(151/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-11T22:17:16.382 INFO:teuthology.orchestra.run.smithi045.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-11T22:17:16.394 INFO:teuthology.orchestra.run.smithi022.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 444 kB/s | 41 kB 00:00 2024-09-11T22:17:16.427 INFO:teuthology.orchestra.run.smithi169.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 63 kB/s | 38 kB 00:00 2024-09-11T22:17:16.466 INFO:teuthology.orchestra.run.smithi045.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-11T22:17:16.494 INFO:teuthology.orchestra.run.smithi022.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-11T22:17:16.558 INFO:teuthology.orchestra.run.smithi045.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-11T22:17:16.608 INFO:teuthology.orchestra.run.smithi045.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-11T22:17:16.611 INFO:teuthology.orchestra.run.smithi022.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.7 MB/s | 1.8 MB 00:00 2024-09-11T22:17:16.645 INFO:teuthology.orchestra.run.smithi022.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 931 kB/s | 249 kB 00:00 2024-09-11T22:17:16.658 INFO:teuthology.orchestra.run.smithi045.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-11T22:17:16.695 INFO:teuthology.orchestra.run.smithi022.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-11T22:17:16.700 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:16.701 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-11T22:17:16.767 INFO:teuthology.orchestra.run.smithi045.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-11T22:17:16.792 INFO:teuthology.orchestra.run.smithi045.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-11T22:17:16.868 INFO:teuthology.orchestra.run.smithi045.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-11T22:17:16.893 INFO:teuthology.orchestra.run.smithi045.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T22:17:16.918 INFO:teuthology.orchestra.run.smithi045.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-11T22:17:16.943 INFO:teuthology.orchestra.run.smithi045.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-11T22:17:16.969 INFO:teuthology.orchestra.run.smithi045.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 709 kB/s | 54 kB 00:00 2024-09-11T22:17:17.002 INFO:teuthology.orchestra.run.smithi045.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-11T22:17:17.028 INFO:teuthology.orchestra.run.smithi045.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-11T22:17:17.061 INFO:teuthology.orchestra.run.smithi045.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T22:17:17.087 INFO:teuthology.orchestra.run.smithi045.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 609 kB/s | 36 kB 00:00 2024-09-11T22:17:17.112 INFO:teuthology.orchestra.run.smithi045.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T22:17:17.163 INFO:teuthology.orchestra.run.smithi045.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T22:17:17.188 INFO:teuthology.orchestra.run.smithi045.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-11T22:17:17.221 INFO:teuthology.orchestra.run.smithi045.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-11T22:17:17.247 INFO:teuthology.orchestra.run.smithi045.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-11T22:17:17.280 INFO:teuthology.orchestra.run.smithi045.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-11T22:17:17.381 INFO:teuthology.orchestra.run.smithi045.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-11T22:17:17.448 INFO:teuthology.orchestra.run.smithi045.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-11T22:17:17.481 INFO:teuthology.orchestra.run.smithi045.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T22:17:17.506 INFO:teuthology.orchestra.run.smithi045.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-11T22:17:17.615 INFO:teuthology.orchestra.run.smithi045.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-11T22:17:17.632 INFO:teuthology.orchestra.run.smithi045.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-11T22:17:17.666 INFO:teuthology.orchestra.run.smithi045.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-11T22:17:17.683 INFO:teuthology.orchestra.run.smithi045.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-11T22:17:17.716 INFO:teuthology.orchestra.run.smithi045.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T22:17:17.758 INFO:teuthology.orchestra.run.smithi045.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 21 MB/s | 839 kB 00:00 2024-09-11T22:17:17.784 INFO:teuthology.orchestra.run.smithi045.stdout:(113/156): libunwind-1.6.2-1.el9.x86_64.rpm 574 kB/s | 67 kB 00:00 2024-09-11T22:17:17.809 INFO:teuthology.orchestra.run.smithi045.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:17:17.834 INFO:teuthology.orchestra.run.smithi045.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-11T22:17:17.860 INFO:teuthology.orchestra.run.smithi045.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-11T22:17:17.885 INFO:teuthology.orchestra.run.smithi045.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T22:17:17.918 INFO:teuthology.orchestra.run.smithi045.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T22:17:17.952 INFO:teuthology.orchestra.run.smithi045.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-11T22:17:17.970 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-11T22:17:17.977 INFO:teuthology.orchestra.run.smithi045.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T22:17:18.003 INFO:teuthology.orchestra.run.smithi045.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T22:17:18.028 INFO:teuthology.orchestra.run.smithi045.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-11T22:17:18.054 INFO:teuthology.orchestra.run.smithi045.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-11T22:17:18.069 INFO:teuthology.orchestra.run.smithi169.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 989 kB/s | 1.6 MB 00:01 2024-09-11T22:17:18.079 INFO:teuthology.orchestra.run.smithi045.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-11T22:17:18.104 INFO:teuthology.orchestra.run.smithi045.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-11T22:17:18.130 INFO:teuthology.orchestra.run.smithi045.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-11T22:17:18.136 INFO:teuthology.orchestra.run.smithi169.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-11T22:17:18.140 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-11T22:17:18.140 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-11T22:17:18.155 INFO:teuthology.orchestra.run.smithi045.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-11T22:17:18.205 INFO:teuthology.orchestra.run.smithi045.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-11T22:17:18.211 INFO:teuthology.orchestra.run.smithi169.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-09-11T22:17:18.230 INFO:teuthology.orchestra.run.smithi045.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T22:17:18.264 INFO:teuthology.orchestra.run.smithi045.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-11T22:17:18.289 INFO:teuthology.orchestra.run.smithi045.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-11T22:17:18.315 INFO:teuthology.orchestra.run.smithi045.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-11T22:17:18.340 INFO:teuthology.orchestra.run.smithi045.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-11T22:17:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T22:17:18.391 INFO:teuthology.orchestra.run.smithi045.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:18.416 INFO:teuthology.orchestra.run.smithi045.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T22:17:18.575 INFO:teuthology.orchestra.run.smithi045.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 167 kB/s | 31 kB 00:00 2024-09-11T22:17:18.600 INFO:teuthology.orchestra.run.smithi045.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-11T22:17:18.625 INFO:teuthology.orchestra.run.smithi045.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T22:17:18.651 INFO:teuthology.orchestra.run.smithi045.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-11T22:17:18.676 INFO:teuthology.orchestra.run.smithi045.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T22:17:18.701 INFO:teuthology.orchestra.run.smithi045.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T22:17:18.726 INFO:teuthology.orchestra.run.smithi045.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T22:17:18.752 INFO:teuthology.orchestra.run.smithi045.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-11T22:17:18.785 INFO:teuthology.orchestra.run.smithi045.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-09-11T22:17:18.811 INFO:teuthology.orchestra.run.smithi045.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T22:17:18.861 INFO:teuthology.orchestra.run.smithi045.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-11T22:17:18.919 INFO:teuthology.orchestra.run.smithi169.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 175 kB/s | 137 kB 00:00 2024-09-11T22:17:19.036 INFO:teuthology.orchestra.run.smithi169.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 941 kB/s | 910 kB 00:00 2024-09-11T22:17:19.195 INFO:teuthology.orchestra.run.smithi045.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-11T22:17:19.245 INFO:teuthology.orchestra.run.smithi045.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.9 MB/s | 3.4 MB 00:00 2024-09-11T22:17:19.370 INFO:teuthology.orchestra.run.smithi169.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-11T22:17:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:(150/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.5 MB/s | 16 MB 00:02 2024-09-11T22:17:19.463 INFO:teuthology.orchestra.run.smithi045.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 8.7 MB/s | 2.3 MB 00:00 2024-09-11T22:17:19.505 INFO:teuthology.orchestra.run.smithi045.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-11T22:17:19.546 INFO:teuthology.orchestra.run.smithi045.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-11T22:17:19.572 INFO:teuthology.orchestra.run.smithi045.stdout:(154/156): NetworkManager-team-1.49.90-1.el9.x8 244 kB/s | 41 kB 00:00 2024-09-11T22:17:19.614 INFO:teuthology.orchestra.run.smithi045.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-11T22:17:19.664 INFO:teuthology.orchestra.run.smithi045.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-11T22:17:19.669 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:19.669 INFO:teuthology.orchestra.run.smithi045.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-11T22:17:19.729 INFO:teuthology.orchestra.run.smithi169.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 126 kB/s | 87 kB 00:00 2024-09-11T22:17:20.004 INFO:teuthology.orchestra.run.smithi169.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 953 kB/s | 1.0 MB 00:01 2024-09-11T22:17:20.329 INFO:teuthology.orchestra.run.smithi169.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 102 kB/s | 61 kB 00:00 2024-09-11T22:17:20.437 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-11T22:17:20.437 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-11T22:17:20.638 INFO:teuthology.orchestra.run.smithi169.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-11T22:17:20.805 INFO:teuthology.orchestra.run.smithi169.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 306 kB/s | 245 kB 00:00 2024-09-11T22:17:20.883 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-11T22:17:21.048 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-11T22:17:21.048 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-11T22:17:21.205 INFO:teuthology.orchestra.run.smithi169.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-11T22:17:21.250 INFO:teuthology.orchestra.run.smithi169.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 271 kB/s | 248 kB 00:00 2024-09-11T22:17:21.297 INFO:teuthology.orchestra.run.smithi169.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-11T22:17:21.864 INFO:teuthology.orchestra.run.smithi169.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 56 kB/s | 35 kB 00:00 2024-09-11T22:17:22.014 INFO:teuthology.orchestra.run.smithi169.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 213 kB/s | 172 kB 00:00 2024-09-11T22:17:22.539 INFO:teuthology.orchestra.run.smithi169.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-11T22:17:22.706 INFO:teuthology.orchestra.run.smithi169.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 298 kB/s | 250 kB 00:00 2024-09-11T22:17:22.815 INFO:teuthology.orchestra.run.smithi169.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 278 kB/s | 222 kB 00:00 2024-09-11T22:17:22.955 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-11T22:17:22.955 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-11T22:17:23.190 INFO:teuthology.orchestra.run.smithi169.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-11T22:17:23.290 INFO:teuthology.orchestra.run.smithi169.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-09-11T22:17:23.590 INFO:teuthology.orchestra.run.smithi169.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 347 kB/s | 269 kB 00:00 2024-09-11T22:17:23.940 INFO:teuthology.orchestra.run.smithi169.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 212 kB/s | 159 kB 00:00 2024-09-11T22:17:24.116 INFO:teuthology.orchestra.run.smithi169.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 338 kB/s | 279 kB 00:00 2024-09-11T22:17:24.249 INFO:teuthology.orchestra.run.smithi169.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-09-11T22:17:24.625 INFO:teuthology.orchestra.run.smithi169.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 78 kB/s | 54 kB 00:00 2024-09-11T22:17:24.900 INFO:teuthology.orchestra.run.smithi169.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 64 kB/s | 42 kB 00:00 2024-09-11T22:17:25.208 INFO:teuthology.orchestra.run.smithi169.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 76 kB/s | 44 kB 00:00 2024-09-11T22:17:25.692 INFO:teuthology.orchestra.run.smithi169.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-11T22:17:25.809 INFO:teuthology.orchestra.run.smithi169.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 243 kB/s | 221 kB 00:00 2024-09-11T22:17:26.121 INFO:teuthology.orchestra.run.smithi169.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 39 kB/s | 36 kB 00:00 2024-09-11T22:17:26.617 INFO:teuthology.orchestra.run.smithi169.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 53 kB/s | 47 kB 00:00 2024-09-11T22:17:26.806 INFO:teuthology.orchestra.run.smithi169.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-09-11T22:17:26.835 INFO:teuthology.orchestra.run.smithi169.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 296 kB/s | 304 kB 00:01 2024-09-11T22:17:26.974 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-11T22:17:27.083 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:27.186 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:27.277 INFO:teuthology.orchestra.run.smithi169.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-11T22:17:27.352 INFO:teuthology.orchestra.run.smithi169.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 299 kB/s | 22 kB 00:00 2024-09-11T22:17:27.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:27.403 INFO:teuthology.orchestra.run.smithi169.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-09-11T22:17:27.434 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:27.453 INFO:teuthology.orchestra.run.smithi169.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T22:17:27.459 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:27.470 INFO:teuthology.orchestra.run.smithi169.stdout:(105/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-11T22:17:27.509 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:27.511 INFO:teuthology.orchestra.run.smithi169.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-09-11T22:17:27.545 INFO:teuthology.orchestra.run.smithi169.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-11T22:17:27.562 INFO:teuthology.orchestra.run.smithi169.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-11T22:17:27.579 INFO:teuthology.orchestra.run.smithi169.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.7 MB/s | 26 kB 00:00 2024-09-11T22:17:27.596 INFO:teuthology.orchestra.run.smithi169.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-11T22:17:27.621 INFO:teuthology.orchestra.run.smithi169.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T22:17:27.646 INFO:teuthology.orchestra.run.smithi169.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-11T22:17:27.697 INFO:teuthology.orchestra.run.smithi169.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-11T22:17:27.722 INFO:teuthology.orchestra.run.smithi169.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-11T22:17:27.739 INFO:teuthology.orchestra.run.smithi169.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-11T22:17:27.756 INFO:teuthology.orchestra.run.smithi169.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 962 kB/s | 32 kB 00:00 2024-09-11T22:17:27.773 INFO:teuthology.orchestra.run.smithi169.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-11T22:17:27.798 INFO:teuthology.orchestra.run.smithi169.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-11T22:17:27.823 INFO:teuthology.orchestra.run.smithi169.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T22:17:27.849 INFO:teuthology.orchestra.run.smithi169.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-11T22:17:27.867 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:27.874 INFO:teuthology.orchestra.run.smithi169.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T22:17:27.908 INFO:teuthology.orchestra.run.smithi169.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T22:17:27.924 INFO:teuthology.orchestra.run.smithi169.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-11T22:17:27.950 INFO:teuthology.orchestra.run.smithi169.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-11T22:17:27.975 INFO:teuthology.orchestra.run.smithi169.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-11T22:17:27.984 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:28.000 INFO:teuthology.orchestra.run.smithi169.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-11T22:17:28.025 INFO:teuthology.orchestra.run.smithi169.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-11T22:17:28.093 INFO:teuthology.orchestra.run.smithi169.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-11T22:17:28.093 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:28.118 INFO:teuthology.orchestra.run.smithi169.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T22:17:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:28.143 INFO:teuthology.orchestra.run.smithi169.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:17:28.177 INFO:teuthology.orchestra.run.smithi169.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-11T22:17:28.202 INFO:teuthology.orchestra.run.smithi169.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-11T22:17:28.220 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:28.227 INFO:teuthology.orchestra.run.smithi169.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-11T22:17:28.249 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:28.253 INFO:teuthology.orchestra.run.smithi169.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T22:17:28.278 INFO:teuthology.orchestra.run.smithi169.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:28.303 INFO:teuthology.orchestra.run.smithi169.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-11T22:17:28.384 INFO:teuthology.orchestra.run.smithi169.stdout:(137/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-09-11T22:17:28.412 INFO:teuthology.orchestra.run.smithi169.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2024-09-11T22:17:28.423 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:28.438 INFO:teuthology.orchestra.run.smithi169.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T22:17:28.463 INFO:teuthology.orchestra.run.smithi169.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-11T22:17:28.479 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:28.488 INFO:teuthology.orchestra.run.smithi169.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-11T22:17:28.513 INFO:teuthology.orchestra.run.smithi169.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 900 kB/s | 188 kB 00:00 2024-09-11T22:17:28.515 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:28.538 INFO:teuthology.orchestra.run.smithi169.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:28.564 INFO:teuthology.orchestra.run.smithi169.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T22:17:28.581 INFO:teuthology.orchestra.run.smithi169.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-11T22:17:28.621 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:28.658 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:28.673 INFO:teuthology.orchestra.run.smithi169.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-11T22:17:28.698 INFO:teuthology.orchestra.run.smithi169.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-11T22:17:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:28.749 INFO:teuthology.orchestra.run.smithi169.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-11T22:17:28.759 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:28.786 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:28.940 INFO:teuthology.orchestra.run.smithi169.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-11T22:17:28.970 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:28.991 INFO:teuthology.orchestra.run.smithi169.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.6 MB/s | 2.3 MB 00:00 2024-09-11T22:17:29.041 INFO:teuthology.orchestra.run.smithi169.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-11T22:17:29.058 INFO:teuthology.orchestra.run.smithi169.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 611 kB/s | 41 kB 00:00 2024-09-11T22:17:29.083 INFO:teuthology.orchestra.run.smithi169.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-11T22:17:29.140 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:29.158 INFO:teuthology.orchestra.run.smithi169.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-11T22:17:29.200 INFO:teuthology.orchestra.run.smithi169.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-11T22:17:29.276 INFO:teuthology.orchestra.run.smithi169.stdout:(156/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.7 MB/s | 3.4 MB 00:00 2024-09-11T22:17:29.282 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:29.282 INFO:teuthology.orchestra.run.smithi169.stdout:Total 8.8 MB/s | 226 MB 00:25 2024-09-11T22:17:29.291 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:29.416 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:29.501 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-11T22:17:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:29.762 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:29.799 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:29.852 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:29.894 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:29.919 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:29.963 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:30.361 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:30.421 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:30.537 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-11T22:17:30.546 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:30.572 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:30.664 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-11T22:17:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-11T22:17:30.693 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:30.853 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:30.907 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:30.934 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:31.040 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:31.069 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:31.096 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:31.132 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:31.154 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:31.173 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:31.508 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:31.644 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:31.709 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:31.749 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:31.806 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:31.829 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:31.841 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:31.884 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:31.931 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:31.973 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:32.050 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:32.144 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:32.165 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:32.200 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:32.257 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:32.301 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:32.331 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:32.345 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:32.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:32.432 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:32.462 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:32.492 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:32.513 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-11T22:17:32.514 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-11T22:17:32.531 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:32.575 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:32.608 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:32.636 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:32.678 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:32.708 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:32.712 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:32.756 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:32.759 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:32.798 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:32.813 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:32.866 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:32.944 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:32.945 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:32.977 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:32.982 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:33.021 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:33.032 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:33.049 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:33.123 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:33.139 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:33.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:33.193 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:33.234 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:33.241 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:33.276 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:33.300 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:33.380 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:33.452 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:33.532 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:33.566 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:33.603 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:33.643 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:33.684 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:33.724 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:33.754 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:33.797 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:33.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:33.880 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:33.915 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:34.007 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:34.015 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:34.062 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:34.090 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:34.093 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:34.133 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:34.184 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:34.201 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:34.231 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:34.261 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:34.273 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:34.454 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:34.525 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:34.582 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:34.656 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:34.701 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:34.746 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:34.794 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:34.828 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:34.872 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:34.914 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:35.058 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:35.076 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:35.099 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:35.110 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:35.150 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:35.214 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:35.257 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:35.266 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:35.320 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:35.412 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:35.455 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:35.525 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:35.590 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:35.623 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:35.647 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:35.648 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:35.732 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:35.761 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:35.914 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:35.942 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:35.976 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:36.017 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:36.056 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:36.087 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:36.120 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:36.162 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:36.213 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:36.337 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:36.395 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:36.425 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:36.534 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:36.586 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:36.588 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:37.356 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:37.399 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:37.433 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:37.546 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:37.598 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:37.923 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:37.960 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:38.000 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:38.005 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:38.034 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:38.067 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:38.394 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:38.446 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:38.546 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:38.576 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:38.613 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:38.764 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:38.777 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-11T22:17:38.862 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:38.878 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:38.910 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:38.962 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:38.996 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:39.025 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:39.064 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:39.119 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:39.357 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:39.386 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:39.479 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:39.518 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:39.523 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:39.644 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:39.682 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:39.773 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:39.803 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:39.950 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:39.999 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:40.028 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:40.123 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:40.145 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:40.182 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:40.208 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:40.221 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:40.244 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:40.264 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:40.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:40.325 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:40.439 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:40.595 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:40.652 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:40.696 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:40.720 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:40.789 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:40.818 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:40.819 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:40.855 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:40.896 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:41.127 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:41.249 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:41.340 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:41.361 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:41.376 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:41.391 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:41.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:41.463 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:41.492 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:41.493 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:41.537 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:41.577 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:41.620 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:41.661 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:41.689 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:41.761 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:41.811 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:41.857 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:41.897 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:41.929 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:41.964 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:41.973 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:42.008 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:42.051 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:42.080 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:42.150 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:42.203 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:42.279 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:42.410 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:42.464 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:42.559 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:42.601 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:42.693 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:42.693 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:42.693 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:42.693 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:42.727 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:42.990 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:43.068 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:43.097 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:43.131 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:43.169 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:43.210 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:43.364 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:43.414 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:43.469 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:43.542 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:43.573 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:43.609 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:43.656 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:43.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:43.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:43.787 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:43.854 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:43.890 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:43.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:43.980 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:44.021 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:44.123 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:44.155 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:44.194 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:44.220 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:44.245 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:44.319 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:44.438 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:44.468 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:44.496 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:44.530 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:44.569 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:44.591 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:44.591 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:44.591 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:44.591 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:44.601 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:44.629 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:44.631 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:44.665 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:44.701 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:44.745 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:44.777 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:44.863 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:44.907 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:44.949 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:45.050 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:45.097 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:45.824 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:45.878 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:45.912 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:46.019 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:46.067 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:46.112 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:46.199 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:46.248 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:46.432 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:46.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:46.522 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:47.172 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:47.285 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:48.527 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:48.624 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:48.652 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:48.685 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:48.997 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:49.039 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:49.152 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:49.188 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:49.669 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:49.700 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:49.772 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:49.802 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:52.093 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:52.132 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:52.682 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:52.727 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:52.816 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:52.816 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:17:52.845 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-11T22:17:55.036 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-11T22:17:55.037 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-11T22:17:55.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:55.216 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:55.233 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:55.233 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:55.233 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:17:55.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:56.669 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-09-11T22:17:56.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:56.769 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:56.797 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:56.798 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:56.798 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:17:56.798 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:56.798 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:56.798 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:56.877 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:56.877 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:17:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:57.036 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:57.061 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:57.061 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:57.061 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:17:57.061 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:57.061 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:57.062 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:57.520 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:57.545 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:17:57.651 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:17:57.709 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:17:57.803 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:17:58.012 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:17:58.075 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:17:58.145 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:17:58.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:17:58.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:17:58.415 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:58.442 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:58.442 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:58.442 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:17:58.442 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:58.443 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:58.443 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:58.447 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:17:58.478 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:17:58.506 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:17:58.682 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:58.705 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:58.706 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:58.706 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:17:58.706 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:58.706 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:58.706 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:58.949 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:58.980 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:59.012 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:17:59.077 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:17:59.103 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:17:59.167 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:59.190 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:17:59.297 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:17:59.356 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:17:59.420 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:17:59.622 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:17:59.669 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:17:59.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:17:59.856 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:18:00.008 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:18:00.052 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:18:00.084 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:18:00.111 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:18:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:00.445 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:00.486 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:00.517 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:18:00.582 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:18:00.609 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:01.265 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:01.288 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:01.400 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:01.566 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:01.590 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:01.616 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:01.616 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:01.616 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:01.616 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:01.617 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:01.617 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:01.666 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:01.678 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:01.713 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:01.752 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:01.788 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:01.850 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:02.770 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:02.834 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:02.928 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:02.952 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:02.953 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:02.953 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:02.953 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:03.003 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:03.028 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:03.028 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:03.029 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:03.029 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:03.029 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:03.029 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:03.080 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:03.113 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:03.137 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:03.189 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:03.201 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:03.302 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:03.354 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:03.355 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:03.379 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:03.379 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:03.379 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:18:03.379 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:03.380 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:03.380 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:04.341 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:04.375 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:04.398 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:04.399 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:04.399 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:04.399 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:04.399 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:04.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:04.443 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:04.465 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:04.465 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:04.465 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:04.466 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:04.510 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:04.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:04.853 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:04.865 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:04.865 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-11T22:18:04.865 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-11T22:18:04.866 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:04.875 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:04.875 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:04.875 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:18:04.876 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:04.876 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:04.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:05.040 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:05.056 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:05.056 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:05.056 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:18:05.056 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:06.526 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:06.554 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:06.554 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:06.554 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:18:06.554 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:06.555 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:06.555 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:06.785 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:06.809 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:06.809 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:06.809 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:18:06.810 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:06.810 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:06.810 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:07.244 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:07.268 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:07.366 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:18:07.423 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:18:07.486 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:18:07.672 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:18:07.728 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:18:07.806 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:18:07.904 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:18:08.043 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:18:08.095 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:18:08.126 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:18:08.154 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:18:08.216 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:18:08.258 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:18:08.300 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:18:08.330 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:18:08.358 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:18:08.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:18:08.613 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:18:08.614 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:18:08.644 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:08.673 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:18:08.684 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:18:08.719 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:18:08.747 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:18:08.776 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:09.372 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:09.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:09.438 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:09.707 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:18:09.757 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:18:09.807 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:18:09.826 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:09.838 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:18:09.861 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:09.865 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:18:10.064 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:18:10.104 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:18:10.134 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:18:10.164 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:18:10.210 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:18:10.354 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:18:10.455 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:18:10.505 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:18:10.610 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:18:10.641 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:18:10.667 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:18:10.701 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:18:10.702 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:10.802 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:10.802 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:10.832 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:10.846 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:10.861 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:10.884 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:10.894 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:10.919 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:18:10.925 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:10.925 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:10.964 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:11.113 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:11.113 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:11.133 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:11.163 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:11.187 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:11.187 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:11.188 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:11.188 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:11.188 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:11.188 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:11.197 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:11.239 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:11.251 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:11.266 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:11.348 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:11.396 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:11.800 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:18:11.898 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:18:11.949 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:18:12.042 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:18:12.085 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:18:12.110 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:18:12.153 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:18:12.153 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:12.229 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:12.229 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:12.321 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:12.330 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:12.354 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:18:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:12.360 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:12.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:12.417 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:12.441 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:12.441 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:12.441 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:12.441 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:12.493 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:12.516 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:12.540 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:12.540 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:12.607 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:12.674 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:12.827 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:12.850 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:12.851 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:12.851 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:18:12.851 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:12.851 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:12.851 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:16.771 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:16.772 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:16.773 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:16.774 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:16.775 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:16.776 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:16.777 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:16.778 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:16.779 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:16.782 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:16.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:17.406 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:18:17.447 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:18:17.487 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:18:17.520 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:18:17.547 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:18:17.732 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:18:17.785 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:18:17.815 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:18:17.846 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:18:17.892 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:18:18.361 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:18.361 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:18.361 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:18.361 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:18.362 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:18.363 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:18.364 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:18.364 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:18.364 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:18.377 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:18.377 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:18.377 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:18.377 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:18.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:18.379 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:18.380 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:18.381 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:18.382 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:18.383 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:18.384 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:18.385 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:18.386 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:18.387 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:18.470 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:18.514 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:18.535 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:19.380 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:18:19.478 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:18:19.518 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:18:19.600 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:18:19.627 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:19.627 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:19.628 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.629 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.630 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:19.631 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.632 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:19.635 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:19.636 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:19.637 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:19.638 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:19.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:19.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:19.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:19.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:19.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:19.643 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:19.644 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:19.645 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:18:19.645 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:19.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:18:19.645 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-11T22:18:19.664 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:18:19.691 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:18:19.691 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:19.774 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:19.774 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:19.858 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:19.883 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:18:19.889 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:19.889 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:20.077 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:20.171 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:20.171 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:20.233 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:20.867 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:20.870 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:20.871 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:20.872 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:20.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:20.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:20.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:20.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:20.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:20.878 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:20.879 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:20.880 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:18:20.880 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-11T22:18:21.264 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:25.762 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:25.763 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:25.763 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:25.763 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:25.764 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:25.765 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:25.766 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:25.767 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:25.768 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:25.769 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:25.770 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:25.771 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:25.772 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:25.773 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:25.774 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:25.775 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:25.776 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:25.777 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:25.778 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:28.289 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:28.289 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:28.290 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.291 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.292 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:28.293 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:28.294 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:28.295 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.296 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:28.297 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:28.298 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:28.299 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:28.300 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.301 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:28.302 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:28.303 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:18:28.303 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-11T22:18:28.739 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:28.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:28.891 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:28.994 INFO:teuthology.orchestra.run.smithi022.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:28.995 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:28.995 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:28.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:29.152 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:30.299 INFO:teuthology.orchestra.run.smithi045.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:30.300 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:30.300 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:30.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:30.454 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:30.481 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:30.481 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:30.481 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:30.483 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T22:18:30.483 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:18:30.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:30.517 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:18:30.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:30.549 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:18:30.549 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:30.580 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T22:18:30.581 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:18:30.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:30.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:30.680 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:18:30.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:30.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:30.782 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:18:30.782 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:30.813 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:30.883 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T22:18:30.883 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:18:30.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:30.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:30.981 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:18:30.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:31.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:31.079 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:18:31.079 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:31.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:31.177 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T22:18:31.177 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:18:31.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:31.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:31.280 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:18:31.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:31.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:31.379 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:18:31.380 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:31.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:31.479 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T22:18:31.576 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T22:18:31.577 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:31.577 INFO:tasks.cephadm:Cluster fsid is c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:18:31.577 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T22:18:31.577 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.45', 'mon.c': '172.21.15.169'} 2024-09-11T22:18:31.578 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-09-11T22:18:31.578 INFO:tasks.cephadm:First mgr is x 2024-09-11T22:18:31.578 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T22:18:31.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-11T22:18:31.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname $(hostname -s) 2024-09-11T22:18:31.639 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-11T22:18:31.669 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T22:18:31.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:31.804 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T22:18:31.945 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:31.947 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T22:18:31.947 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T22:18:31.947 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:32.329 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:32.329 DEBUG:teuthology.orchestra.run.smithi045:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:32.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:32.710 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:33.070 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:33.071 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:33.091 DEBUG:teuthology.orchestra.run.smithi045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:33.110 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:33.145 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T22:18:33.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:33.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:33.153 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:34.691 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:18:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:18:34.863 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:04.166 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-11T22:19:04.166 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:04.167 INFO:teuthology.orchestra.run.smithi045.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:04.167 INFO:teuthology.orchestra.run.smithi045.stdout: "repo_digests": [ 2024-09-11T22:19:04.167 INFO:teuthology.orchestra.run.smithi045.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:04.167 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-11T22:19:04.167 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-11T22:19:20.404 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:19:20.405 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:20.405 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:20.405 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-11T22:19:20.405 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:20.405 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:19:20.406 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:19:21.386 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-11T22:19:21.387 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-11T22:19:21.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:21.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:21.480 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:21.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:21.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:21.566 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:21.592 INFO:tasks.cephadm:Writing seed config... 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T22:19:21.593 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T22:19:21.594 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T22:19:21.595 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T22:19:21.596 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T22:19:21.597 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T22:19:21.597 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T22:19:21.597 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T22:19:21.597 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-11T22:19:21.597 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:19:21.598 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T22:19:21.616 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c727338c-708b-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T22:19:21.616 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T22:19:21.659 DEBUG:teuthology.orchestra.run.smithi022:mgr.x> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T22:19:21.702 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T22:19:21.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid c727338c-708b-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:19:21.918 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:19:21.918 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'c727338c-708b-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2024-09-11T22:19:21.918 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T22:19:21.919 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-09-11T22:19:21.943 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-09-11T22:19:21.951 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T22:19:21.951 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T22:19:21.957 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T22:19:21.957 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:19:21.965 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-11T22:19:21.971 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-11T22:19:21.971 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-11T22:19:21.971 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-09-11T22:19:21.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-11T22:19:21.994 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T22:19:21.994 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-09-11T22:19:21.995 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-09-11T22:19:22.001 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T22:19:22.001 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T22:19:22.007 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T22:19:22.007 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:19:22.014 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 140715610153984 on /run/cephadm/c727338c-708b-11ef-bcea-c7b262605968.lock 2024-09-11T22:19:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 140715610153984 acquired on /run/cephadm/c727338c-708b-11ef-bcea-c7b262605968.lock 2024-09-11T22:19:22.022 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2024-09-11T22:19:22.022 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-09-11T22:19:22.022 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-11T22:19:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-09-11T22:19:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-09-11T22:19:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T22:19:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T22:19:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1791sec hoplimit 64 pref medium 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-11T22:19:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T22:19:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-11T22:19:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-11T22:19:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T22:19:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T22:19:22.033 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T22:19:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T22:19:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T22:19:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T22:19:23.488 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T22:19:23.488 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T22:19:23.488 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T22:19:24.443 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-09-11T22:19:24.443 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-09-11T22:19:25.573 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBsF+JmgC9TLhAA9hlNxhKiP9t6wq1xEhWdBw== 2024-09-11T22:19:26.445 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBtF+JmiDARMxAAeHoOoF8u5PNmvBQ+0yHF/Q== 2024-09-11T22:19:27.326 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBuF+JmhKP7LBAAh3q3jLZNrepdswV4dEjtlg== 2024-09-11T22:19:27.327 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-09-11T22:19:28.348 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:19:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-09-11T22:19:29.438 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-09-11T22:19:29.662 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T22:19:29.809 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T22:19:30.009 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c727338c-708b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968.target. 2024-09-11T22:19:30.010 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c727338c-708b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968.target. 2024-09-11T22:19:30.260 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a 2024-09-11T22:19:30.261 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T22:19:30.435 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968.target.wants/ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968@.service. 2024-09-11T22:19:30.990 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:19:30.990 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-09-11T22:19:30.999 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-09-11T22:19:31.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:30 smithi022 systemd[1]: Started Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:19:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T22:19:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T22:19:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.564649s) 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:32.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.422+0000 7f32fa736640 1 Processor -- start 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.422+0000 7f32fa736640 1 -- start start 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.422+0000 7f32fa736640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.422+0000 7f32fa736640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4107150 con 0x7f32f4106780 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.423+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.423+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41042/0 (socket says 172.21.15.22:41042) 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.423+0000 7f32f3fff640 1 -- 172.21.15.22:0/1830683095 learned_addr learned my addr 172.21.15.22:0/1830683095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.423+0000 7f32f3fff640 1 -- 172.21.15.22:0/1830683095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f4107980 con 0x7f32f4106780 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.425+0000 7f32f3fff640 1 --2- 172.21.15.22:0/1830683095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009820 tx=0x7f32e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deefcba526ada8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.425+0000 7f32f37fe640 1 -- 172.21.15.22:0/1830683095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e4037070 con 0x7f32f4106780 2024-09-11T22:19:32.008 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.425+0000 7f32f37fe640 1 -- 172.21.15.22:0/1830683095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4032440 con 0x7f32f4106780 2024-09-11T22:19:32.008 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.425+0000 7f32f37fe640 1 -- 172.21.15.22:0/1830683095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e4032740 con 0x7f32f4106780 2024-09-11T22:19:32.008 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- 172.21.15.22:0/1830683095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 msgr2=0x7f32f4106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 --2- 172.21.15.22:0/1830683095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009820 tx=0x7f32e402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- 172.21.15.22:0/1830683095 shutdown_connections 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 --2- 172.21.15.22:0/1830683095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f4106b80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- 172.21.15.22:0/1830683095 >> 172.21.15.22:0/1830683095 conn(0x7f32f4101fd0 msgr2=0x7f32f41043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- 172.21.15.22:0/1830683095 shutdown_connections 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- 172.21.15.22:0/1830683095 wait complete. 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 Processor -- start 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.426+0000 7f32fa736640 1 -- start start 2024-09-11T22:19:32.009 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32fa736640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32fa736640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32f4107f20 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41052/0 (socket says 172.21.15.22:41052) 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f3fff640 1 -- 172.21.15.22:0/1940694548 learned_addr learned my addr 172.21.15.22:0/1940694548 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f3fff640 1 -- 172.21.15.22:0/1940694548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f419b560 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f3fff640 1 --2- 172.21.15.22:0/1940694548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32e40090b0 tx=0x7f32e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e4041070 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e403c7a0 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f419b7f0 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e4037040 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.427+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f419e4e0 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.428+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f32e4044070 con 0x7f32f4106780 2024-09-11T22:19:32.010 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.428+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f32e403d3f0 con 0x7f32f4106780 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.428+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f4108570 con 0x7f32f4106780 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.431+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f32e4046450 con 0x7f32f4106780 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.494+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f32f419ea30 con 0x7f32f4106780 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.495+0000 7f32f1ffb640 1 -- 172.21.15.22:0/1940694548 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f32e4046630 con 0x7f32f4106780 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 msgr2=0x7f32f419b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 --2- 172.21.15.22:0/1940694548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32e40090b0 tx=0x7f32e40046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 shutdown_connections 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 --2- 172.21.15.22:0/1940694548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32f4106780 0x7f32f419b020 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 >> 172.21.15.22:0/1940694548 conn(0x7f32f4101fd0 msgr2=0x7f32f4062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 shutdown_connections 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:31.496+0000 7f32fa736640 1 -- 172.21.15.22:0/1940694548 wait complete. 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-09-11T22:19:32.011 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T22:19:32.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: monmap epoch 1 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: last_changed 2024-09-11T22:19:27.657074+0000 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: min_mon_release 19 (squid) 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: election_strategy: 1 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: fsmap 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: mgrmap e1: no daemons active 2024-09-11T22:19:32.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:31 smithi022 ceph-mon[30603]: from='client.? 172.21.15.22:0/1940694548' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T22:19:33.093 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:32 smithi022 ceph-mon[30603]: from='client.? 172.21.15.22:0/3480084208' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T22:19:33.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:32 smithi022 ceph-mon[30603]: from='client.? 172.21.15.22:0/3480084208' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T22:19:33.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:33.104 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.436+0000 7f7902f0d640 1 Processor -- start 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.436+0000 7f7902f0d640 1 -- start start 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7902f0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7902f0d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc0634d0 con 0x7f78fc108330 2024-09-11T22:19:33.105 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7900ca9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7900ca9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41054/0 (socket says 172.21.15.22:41054) 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7900ca9640 1 -- 172.21.15.22:0/802715744 learned_addr learned my addr 172.21.15.22:0/802715744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.437+0000 7f7900ca9640 1 -- 172.21.15.22:0/802715744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc10ac60 con 0x7f78fc108330 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.438+0000 7f7900ca9640 1 --2- 172.21.15.22:0/802715744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009820 tx=0x7f78e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278edb7a099b8b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.438+0000 7f78fb7fe640 1 -- 172.21.15.22:0/802715744 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78e4037070 con 0x7f78fc108330 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.438+0000 7f78fb7fe640 1 -- 172.21.15.22:0/802715744 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e4032440 con 0x7f78fc108330 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.438+0000 7f78fb7fe640 1 -- 172.21.15.22:0/802715744 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78e4032740 con 0x7f78fc108330 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 -- 172.21.15.22:0/802715744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 msgr2=0x7f78fc10a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 --2- 172.21.15.22:0/802715744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009820 tx=0x7f78e402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 -- 172.21.15.22:0/802715744 shutdown_connections 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 --2- 172.21.15.22:0/802715744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc10a720 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.106 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 -- 172.21.15.22:0/802715744 >> 172.21.15.22:0/802715744 conn(0x7f78fc102010 msgr2=0x7f78fc104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 -- 172.21.15.22:0/802715744 shutdown_connections 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.439+0000 7f7902f0d640 1 -- 172.21.15.22:0/802715744 wait complete. 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7902f0d640 1 Processor -- start 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7902f0d640 1 -- start start 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7902f0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7902f0d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc10b140 con 0x7f78fc108330 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7900ca9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7900ca9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41060/0 (socket says 172.21.15.22:41060) 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7900ca9640 1 -- 172.21.15.22:0/3480084208 learned_addr learned my addr 172.21.15.22:0/3480084208 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7900ca9640 1 -- 172.21.15.22:0/3480084208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc19b590 con 0x7f78fc108330 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.440+0000 7f7900ca9640 1 --2- 172.21.15.22:0/3480084208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f78e40090b0 tx=0x7f78e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78e4041070 con 0x7f78fc108330 2024-09-11T22:19:33.107 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e403c7a0 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc19b820 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78e4037040 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc19e510 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78e4044070 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.441+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f78e403d3f0 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.442+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78fc108790 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.444+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f78e4046450 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.504+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f78fc02d910 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.508+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f78e4046630 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.509+0000 7f78f9ffb640 1 -- 172.21.15.22:0/3480084208 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f78e4056070 con 0x7f78fc108330 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 msgr2=0x7f78fc19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 --2- 172.21.15.22:0/3480084208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f78e40090b0 tx=0x7f78e40046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.108 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 shutdown_connections 2024-09-11T22:19:33.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 --2- 172.21.15.22:0/3480084208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78fc108330 0x7f78fc19b050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:33.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 >> 172.21.15.22:0/3480084208 conn(0x7f78fc102010 msgr2=0x7f78fc1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:33.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 shutdown_connections 2024-09-11T22:19:33.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:32.510+0000 7f7902f0d640 1 -- 172.21.15.22:0/3480084208 wait complete. 2024-09-11T22:19:33.109 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-09-11T22:19:34.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:33 smithi022 ceph-mon[30603]: from='client.? 172.21.15.22:0/3721606088' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:19:34.216 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb102fb640 1 Processor -- start 2024-09-11T22:19:34.216 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb102fb640 1 -- start start 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb102fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb102fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb08107150 con 0x7feb08106780 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb0e097640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb0e097640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41068/0 (socket says 172.21.15.22:41068) 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb0e097640 1 -- 172.21.15.22:0/4080605940 learned_addr learned my addr 172.21.15.22:0/4080605940 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.541+0000 7feb0e097640 1 -- 172.21.15.22:0/4080605940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb08107980 con 0x7feb08106780 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.542+0000 7feb0e097640 1 --2- 172.21.15.22:0/4080605940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb04009820 tx=0x7feb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0decfb724c9732 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:34.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.542+0000 7feb0d095640 1 -- 172.21.15.22:0/4080605940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb04037070 con 0x7feb08106780 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.542+0000 7feb0d095640 1 -- 172.21.15.22:0/4080605940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7feb04032920 con 0x7feb08106780 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.542+0000 7feb0d095640 1 -- 172.21.15.22:0/4080605940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb04030950 con 0x7feb08106780 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 -- 172.21.15.22:0/4080605940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 msgr2=0x7feb08106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 --2- 172.21.15.22:0/4080605940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feb04009820 tx=0x7feb0402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 -- 172.21.15.22:0/4080605940 shutdown_connections 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 --2- 172.21.15.22:0/4080605940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb08106b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 -- 172.21.15.22:0/4080605940 >> 172.21.15.22:0/4080605940 conn(0x7feb08101f30 msgr2=0x7feb08104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 -- 172.21.15.22:0/4080605940 shutdown_connections 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.543+0000 7feb102fb640 1 -- 172.21.15.22:0/4080605940 wait complete. 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb102fb640 1 Processor -- start 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb102fb640 1 -- start start 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb102fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb102fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810ad30 con 0x7feb08106780 2024-09-11T22:19:34.218 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb0e097640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb0e097640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41074/0 (socket says 172.21.15.22:41074) 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb0e097640 1 -- 172.21.15.22:0/3721606088 learned_addr learned my addr 172.21.15.22:0/3721606088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.544+0000 7feb0e097640 1 -- 172.21.15.22:0/3721606088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0819bec0 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feb0e097640 1 --2- 172.21.15.22:0/3721606088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb040097f0 tx=0x7feb04032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb04037040 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7feb04040070 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0819c150 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb0403a610 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0819ee40 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb0403a890 con 0x7feb08106780 2024-09-11T22:19:34.219 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.545+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feb04045b80 con 0x7feb08106780 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.546+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb08106c00 con 0x7feb08106780 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.548+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7feb04045e20 con 0x7feb08106780 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.608+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7feb0802d940 con 0x7feb08106780 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.609+0000 7feafb7fe640 1 -- 172.21.15.22:0/3721606088 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7feb0403ad10 con 0x7feb08106780 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.609+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 msgr2=0x7feb0819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.609+0000 7feb102fb640 1 --2- 172.21.15.22:0/3721606088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb040097f0 tx=0x7feb04032d00 comp rx=0 tx=0).stop 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.610+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 shutdown_connections 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.610+0000 7feb102fb640 1 --2- 172.21.15.22:0/3721606088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08106780 0x7feb0819b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.610+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 >> 172.21.15.22:0/3721606088 conn(0x7feb08101f30 msgr2=0x7feb08102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.610+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 shutdown_connections 2024-09-11T22:19:34.220 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:33.610+0000 7feb102fb640 1 -- 172.21.15.22:0/3721606088 wait complete. 2024-09-11T22:19:34.221 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-09-11T22:19:34.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:34 smithi022 systemd[1]: Stopping Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:19:34.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:34 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30599]: 2024-09-11T22:19:34.495+0000 7f19569a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:19:34.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:34 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30599]: 2024-09-11T22:19:34.495+0000 7f19569a9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T22:19:34.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:34 smithi022 podman[30844]: 2024-09-11 22:19:34.710624944 +0000 UTC m=+0.323951935 container died 6a25d3241c0d097ba2e72abfc45950477c414f01f202ed4a2e1c7dcaf7e849ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:19:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:37 smithi022 podman[30844]: 2024-09-11 22:19:37.795615466 +0000 UTC m=+3.408942463 container cleanup 6a25d3241c0d097ba2e72abfc45950477c414f01f202ed4a2e1c7dcaf7e849ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:19:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:37 smithi022 bash[30844]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a 2024-09-11T22:19:39.939 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:39 smithi022 podman[30856]: 2024-09-11 22:19:39.686685923 +0000 UTC m=+4.974115319 container remove 6a25d3241c0d097ba2e72abfc45950477c414f01f202ed4a2e1c7dcaf7e849ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T22:19:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:39 smithi022 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T22:19:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:39 smithi022 systemd[1]: Stopped Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:19:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:39 smithi022 systemd[1]: Starting Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:19:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:40 smithi022 podman[30947]: 2024-09-11 22:19:40.074115934 +0000 UTC m=+0.016266194 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:19:41.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:41 smithi022 podman[30947]: 2024-09-11 22:19:41.253589707 +0000 UTC m=+1.195739950 container create dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 podman[30947]: 2024-09-11 22:19:43.08108497 +0000 UTC m=+3.023235212 container init dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 podman[30947]: 2024-09-11 22:19:43.085445548 +0000 UTC m=+3.027595791 container start dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: pidfile_write: ignore empty --pid-file 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: load: jerasure load: lrc 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: RocksDB version: 7.9.2 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Git sha 0 2024-09-11T22:19:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: DB SUMMARY 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: DB Session ID: DQRZ4299GFDIA5R59CWW 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: CURRENT file: CURRENT 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106584 ; 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.error_if_exists: 0 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.create_if_missing: 0 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.paranoid_checks: 1 2024-09-11T22:19:43.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.env: 0x559e2b085940 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.info_log: 0x559e2d1656e0 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.statistics: (nil) 2024-09-11T22:19:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.use_fsync: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_log_file_size: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_fallocate: 1 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.use_direct_reads: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T22:19:43.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.db_log_dir: 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.wal_dir: 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.write_buffer_manager: 0x559e2d174dc0 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T22:19:43.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.unordered_write: 0 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.row_cache: None 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.wal_filter: None 2024-09-11T22:19:43.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.two_write_queues: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.wal_compression: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.atomic_flush: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.log_readahead_size: 0 2024-09-11T22:19:43.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_background_jobs: 2 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_background_compactions: -1 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_subcompactions: 1 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T22:19:43.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_open_files: -1 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_background_flushes: -1 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Compression algorithms supported: 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kZSTD supported: 0 2024-09-11T22:19:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kXpressCompression supported: 0 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kBZip2Compression supported: 0 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kLZ4Compression supported: 1 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kZlibCompression supported: 1 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: kSnappyCompression supported: 1 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.merge_operator: 2024-09-11T22:19:43.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_filter: None 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559e2d165320) 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-09-11T22:19:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x559e2d1591f0 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-09-11T22:19:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-09-11T22:19:43.416 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression: NoCompression 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.num_levels: 7 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T22:19:43.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T22:19:43.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T22:19:43.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T22:19:43.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T22:19:43.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.inplace_update_support: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.bloom_locality: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.max_successive_merges: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T22:19:43.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.ttl: 2592000 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enable_blob_files: false 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.min_blob_size: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T22:19:43.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fcafffe9-ff7d-4943-9ce2-b4403b78e209 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093183117331, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093183118640, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101479, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99364, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14635, "raw_average_key_size": 49, "raw_value_size": 91494, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726093183, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fcafffe9-ff7d-4943-9ce2-b4403b78e209", "db_session_id": "DQRZ4299GFDIA5R59CWW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093183118761, "job": 1, "event": "recovery_finished"} 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559e2d186e00 2024-09-11T22:19:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: DB pointer 0x559e2d282000 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-11T22:19:43.425 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 100.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 100.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 114.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.426 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 23.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 23.87 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x559e2d1591f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T22:19:43.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???) e1 preinit fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).mds e1 new map 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).mds e1 print_map 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: btime 2024-09-11T22:19:30:932019+0000 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:19:43.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: monmap epoch 1 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: last_changed 2024-09-11T22:19:27.657074+0000 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: min_mon_release 19 (squid) 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: election_strategy: 1 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: fsmap 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T22:19:43.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 ceph-mon[30966]: mgrmap e1: no daemons active 2024-09-11T22:19:43.939 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T22:19:44.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 bash[30947]: dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc 2024-09-11T22:19:44.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:43 smithi022 systemd[1]: Started Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.956+0000 7f1f3aa27640 1 Processor -- start 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.956+0000 7f1f3aa27640 1 -- start start 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f3aa27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f3aa27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34063430 con 0x7f1f341083d0 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58566/0 (socket says 172.21.15.22:58566) 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f33fff640 1 -- 172.21.15.22:0/4124482705 learned_addr learned my addr 172.21.15.22:0/4124482705 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.957+0000 7f1f33fff640 1 -- 172.21.15.22:0/4124482705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3410ad00 con 0x7f1f341083d0 2024-09-11T22:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.959+0000 7f1f33fff640 1 --2- 172.21.15.22:0/4124482705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009820 tx=0x7f1f2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7992c4eabf32f1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f32ffd640 1 -- 172.21.15.22:0/4124482705 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24037070 con 0x7f1f341083d0 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f32ffd640 1 -- 172.21.15.22:0/4124482705 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1f24032920 con 0x7f1f341083d0 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f32ffd640 1 -- 172.21.15.22:0/4124482705 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24030950 con 0x7f1f341083d0 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 -- 172.21.15.22:0/4124482705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 msgr2=0x7f1f3410a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 --2- 172.21.15.22:0/4124482705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009820 tx=0x7f1f2402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 -- 172.21.15.22:0/4124482705 shutdown_connections 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 --2- 172.21.15.22:0/4124482705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3410a7c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 -- 172.21.15.22:0/4124482705 >> 172.21.15.22:0/4124482705 conn(0x7f1f34102010 msgr2=0x7f1f34104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 -- 172.21.15.22:0/4124482705 shutdown_connections 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.960+0000 7f1f3aa27640 1 -- 172.21.15.22:0/4124482705 wait complete. 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.961+0000 7f1f3aa27640 1 Processor -- start 2024-09-11T22:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.961+0000 7f1f3aa27640 1 -- start start 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f3aa27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f3aa27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3410bce0 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58574/0 (socket says 172.21.15.22:58574) 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f33fff640 1 -- 172.21.15.22:0/2527472071 learned_addr learned my addr 172.21.15.22:0/2527472071 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f33fff640 1 -- 172.21.15.22:0/2527472071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3419be50 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f33fff640 1 --2- 172.21.15.22:0/2527472071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1f24031000 tx=0x7f1f24032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24042070 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.962+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1f240325f0 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.963+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3419c0e0 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.963+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24037040 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.963+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3419edd0 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.963+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f24045070 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.963+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f24047c60 con 0x7f1f341083d0 2024-09-11T22:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.964+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f34108830 con 0x7f1f341083d0 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:45.966+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1f2404c030 con 0x7f1f341083d0 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.026+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f1f3419f010 con 0x7f1f341083d0 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.028+0000 7f1f317fa640 1 -- 172.21.15.22:0/2527472071 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f1f24047440 con 0x7f1f341083d0 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.029+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 msgr2=0x7f1f3419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.029+0000 7f1f3aa27640 1 --2- 172.21.15.22:0/2527472071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1f24031000 tx=0x7f1f24032e40 comp rx=0 tx=0).stop 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.029+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 shutdown_connections 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.029+0000 7f1f3aa27640 1 --2- 172.21.15.22:0/2527472071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f341083d0 0x7f1f3419b910 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.030+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 >> 172.21.15.22:0/2527472071 conn(0x7f1f34102010 msgr2=0x7f1f34102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.030+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 shutdown_connections 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:46.030+0000 7f1f3aa27640 1 -- 172.21.15.22:0/2527472071 wait complete. 2024-09-11T22:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T22:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-09-11T22:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T22:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T22:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x 2024-09-11T22:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T22:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968.target.wants/ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c727338c-708b-11ef-bcea-c7b262605968@.service. 2024-09-11T22:19:47.288 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:47 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2527472071' entity='client.admin' 2024-09-11T22:19:47.289 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 systemd[1]: Starting Ceph mgr.x for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:19:47.587 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 podman[31179]: 2024-09-11 22:19:47.19066229 +0000 UTC m=+0.016169752 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:19:47.588 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 podman[31179]: 2024-09-11 22:19:47.29382669 +0000 UTC m=+0.119334138 container create f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T22:19:47.588 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 podman[31179]: 2024-09-11 22:19:47.504483163 +0000 UTC m=+0.329990619 container init f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T22:19:47.588 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 podman[31179]: 2024-09-11 22:19:47.507213449 +0000 UTC m=+0.332720899 container start f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T22:19:47.588 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 bash[31179]: f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e 2024-09-11T22:19:47.602 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:19:47.602 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-11T22:19:47.609 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:19:47.610 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:19:47.610 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-11T22:19:47.610 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T22:19:47.619 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:19:47.619 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-11T22:19:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:19:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:19:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-11T22:19:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T22:19:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-09-11T22:19:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-09-11T22:19:47.848 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 systemd[1]: Started Ceph mgr.x for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:19:47.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:47.632+0000 7fd58ab6c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:19:47.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:47.694+0000 7fd58ab6c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:48.127 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:47.853+0000 7fd58ab6c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:19:48.127 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:47.923+0000 7fd58ab6c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:19:48.127 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:48.084+0000 7fd58ab6c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:48.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/587040867' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:19:48.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:48.237+0000 7fd58ab6c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:19:48.629 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:19:48.632 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:19:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:19:48.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:19:48.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:19:48.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:48.642 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:19:30:932019+0000", 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.643 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:19:30.932643+0000", 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.054+0000 7ff6516b8640 1 Processor -- start 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff6516b8640 1 -- start start 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff6516b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff6516b8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c107150 con 0x7ff64c106780 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff64affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff64affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58616/0 (socket says 172.21.15.22:58616) 2024-09-11T22:19:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff64affd640 1 -- 172.21.15.22:0/1007150500 learned_addr learned my addr 172.21.15.22:0/1007150500 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.055+0000 7ff64affd640 1 -- 172.21.15.22:0/1007150500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c107980 con 0x7ff64c106780 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.056+0000 7ff64affd640 1 --2- 172.21.15.22:0/1007150500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e80 tx=0x7ff63c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1e341c3f68c6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.056+0000 7ff649ffb640 1 -- 172.21.15.22:0/1007150500 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c036070 con 0x7ff64c106780 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.056+0000 7ff649ffb640 1 -- 172.21.15.22:0/1007150500 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff63c0318e0 con 0x7ff64c106780 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.056+0000 7ff649ffb640 1 -- 172.21.15.22:0/1007150500 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c007b00 con 0x7ff64c106780 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 -- 172.21.15.22:0/1007150500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 msgr2=0x7ff64c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 --2- 172.21.15.22:0/1007150500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e80 tx=0x7ff63c02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 -- 172.21.15.22:0/1007150500 shutdown_connections 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 --2- 172.21.15.22:0/1007150500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c106b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 -- 172.21.15.22:0/1007150500 >> 172.21.15.22:0/1007150500 conn(0x7ff64c102010 msgr2=0x7ff64c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 -- 172.21.15.22:0/1007150500 shutdown_connections 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.057+0000 7ff6516b8640 1 -- 172.21.15.22:0/1007150500 wait complete. 2024-09-11T22:19:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff6516b8640 1 Processor -- start 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff6516b8640 1 -- start start 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff6516b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff6516b8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c10ad30 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff64affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff64affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58628/0 (socket says 172.21.15.22:58628) 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.058+0000 7ff64affd640 1 -- 172.21.15.22:0/587040867 learned_addr learned my addr 172.21.15.22:0/587040867 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff64affd640 1 -- 172.21.15.22:0/587040867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c19bec0 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff64affd640 1 --2- 172.21.15.22:0/587040867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e50 tx=0x7ff63c0316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c041020 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff63c031bc0 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c036040 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c19c150 con 0x7ff64c106780 2024-09-11T22:19:48.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64c19ee40 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.059+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff63c044020 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.060+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff63c007e00 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.060+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c106c00 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.064+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff63c04b020 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.126+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff64c02d940 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.127+0000 7ff633fff640 1 -- 172.21.15.22:0/587040867 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff63c031d70 con 0x7ff64c106780 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 msgr2=0x7ff64c19b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 --2- 172.21.15.22:0/587040867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e50 tx=0x7ff63c0316a0 comp rx=0 tx=0).stop 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 shutdown_connections 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 --2- 172.21.15.22:0/587040867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff64c106780 0x7ff64c19b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 >> 172.21.15.22:0/587040867 conn(0x7ff64c102010 msgr2=0x7ff64c102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 shutdown_connections 2024-09-11T22:19:48.647 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:48.128+0000 7ff6516b8640 1 -- 172.21.15.22:0/587040867 wait complete. 2024-09-11T22:19:48.648 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-09-11T22:19:48.835 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:48.575+0000 7fd58ab6c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:19:48.835 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:48.640+0000 7fd58ab6c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:19:48.835 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:48.834+0000 7fd58ab6c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:19:50.053 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:49.765+0000 7fd58ab6c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:19:50.053 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:49.835+0000 7fd58ab6c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:19:50.891 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:50.612+0000 7fd58ab6c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:19:50.892 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:50.738+0000 7fd58ab6c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:19:51.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:50.891+0000 7fd58ab6c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:51.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:50.956+0000 7fd58ab6c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:19:51.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.116+0000 7fd58ab6c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:19:51.490 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.189+0000 7fd58ab6c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:19:51.490 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.252+0000 7fd58ab6c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:19:51.490 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.421+0000 7fd58ab6c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:19:51.490 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.489+0000 7fd58ab6c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:19:51.770 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.559+0000 7fd58ab6c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:19:51.771 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.645+0000 7fd58ab6c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:51.771 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.707+0000 7fd58ab6c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:19:51.771 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:51.770+0000 7fd58ab6c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:19:52.372 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:52 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/487768421' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:19:52.651 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:52.615+0000 7fd58ab6c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:19:52.700 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:52.703 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:19:52.704 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:19:52.712 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:19:30:932019+0000", 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.713 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:19:30.932643+0000", 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:52.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.007+0000 7f4328028640 1 Processor -- start 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.007+0000 7f4328028640 1 -- start start 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.007+0000 7f4328028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.007+0000 7f4328028640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43200634d0 con 0x7f4320108330 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.008+0000 7f4325dc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.008+0000 7f4325dc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58630/0 (socket says 172.21.15.22:58630) 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.008+0000 7f4325dc4640 1 -- 172.21.15.22:0/1365233015 learned_addr learned my addr 172.21.15.22:0/1365233015 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.008+0000 7f4325dc4640 1 -- 172.21.15.22:0/1365233015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432010ac60 con 0x7f4320108330 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.008+0000 7f4325dc4640 1 --2- 172.21.15.22:0/1365233015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f431c009820 tx=0x7f431c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867be63cc6a3d87a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4324dc2640 1 -- 172.21.15.22:0/1365233015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f431c037070 con 0x7f4320108330 2024-09-11T22:19:52.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4324dc2640 1 -- 172.21.15.22:0/1365233015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f431c032920 con 0x7f4320108330 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4324dc2640 1 -- 172.21.15.22:0/1365233015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f431c030950 con 0x7f4320108330 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4328028640 1 -- 172.21.15.22:0/1365233015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 msgr2=0x7f432010a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4328028640 1 --2- 172.21.15.22:0/1365233015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f431c009820 tx=0x7f431c02a270 comp rx=0 tx=0).stop 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4328028640 1 -- 172.21.15.22:0/1365233015 shutdown_connections 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4328028640 1 --2- 172.21.15.22:0/1365233015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f432010a720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.009+0000 7f4328028640 1 -- 172.21.15.22:0/1365233015 >> 172.21.15.22:0/1365233015 conn(0x7f4320102010 msgr2=0x7f4320104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 -- 172.21.15.22:0/1365233015 shutdown_connections 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 -- 172.21.15.22:0/1365233015 wait complete. 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 Processor -- start 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 -- start start 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.010+0000 7f4328028640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f432010bd00 con 0x7f4320108330 2024-09-11T22:19:52.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4325dc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4325dc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58634/0 (socket says 172.21.15.22:58634) 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4325dc4640 1 -- 172.21.15.22:0/487768421 learned_addr learned my addr 172.21.15.22:0/487768421 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4325dc4640 1 -- 172.21.15.22:0/487768421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201080f0 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4325dc4640 1 --2- 172.21.15.22:0/487768421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f431c031000 tx=0x7f431c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f431c042070 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201062e0 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f431c0325f0 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f431c037040 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4320106820 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f431c045070 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.011+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f431c047cc0 con 0x7f4320108330 2024-09-11T22:19:52.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.012+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4320108790 con 0x7f4320108330 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.014+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f431c04c030 con 0x7f4320108330 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.077+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4320106f50 con 0x7f4320108330 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.077+0000 7f4316ffd640 1 -- 172.21.15.22:0/487768421 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f431c047440 con 0x7f4320108330 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 msgr2=0x7f4320107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 --2- 172.21.15.22:0/487768421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f431c031000 tx=0x7f431c032e40 comp rx=0 tx=0).stop 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 shutdown_connections 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 --2- 172.21.15.22:0/487768421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4320108330 0x7f4320107bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 >> 172.21.15.22:0/487768421 conn(0x7f4320102010 msgr2=0x7f4320102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 shutdown_connections 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:52.078+0000 7f4328028640 1 -- 172.21.15.22:0/487768421 wait complete. 2024-09-11T22:19:52.718 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: Activating manager daemon x 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: mgrmap e2: x(active, starting, since 0.00318141s) 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: Manager daemon x is now available 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:19:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:19:53.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' 2024-09-11T22:19:53.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' 2024-09-11T22:19:53.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:53 smithi022 ceph-mon[30966]: from='mgr.14100 172.21.15.22:0/2758795518' entity='mgr.x' 2024-09-11T22:19:54.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:54 smithi022 ceph-mon[30966]: mgrmap e3: x(active, since 1.00691s) 2024-09-11T22:19:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:55 smithi022 ceph-mon[30966]: mgrmap e4: x(active, since 2s) 2024-09-11T22:19:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:55 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2092955396' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:19:56.000 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:19:56.001 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:19:56.002 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:19:56.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:56.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:19:56.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:19:56.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:19:56.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:19:56.011 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.012 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:19:30:932019+0000", 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:19:56.013 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:19:30.932643+0000", 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.096+0000 7f443a13d640 1 Processor -- start 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.096+0000 7f443a13d640 1 -- start start 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f443a13d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f443a13d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4434107150 con 0x7f4434106780 2024-09-11T22:19:56.014 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f44337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f44337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54008/0 (socket says 172.21.15.22:54008) 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f44337fe640 1 -- 172.21.15.22:0/3038031964 learned_addr learned my addr 172.21.15.22:0/3038031964 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.097+0000 7f44337fe640 1 -- 172.21.15.22:0/3038031964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4434107980 con 0x7f4434106780 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.098+0000 7f44337fe640 1 --2- 172.21.15.22:0/3038031964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4424009820 tx=0x7f442402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3667e999e6940f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.098+0000 7f44327fc640 1 -- 172.21.15.22:0/3038031964 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4424037070 con 0x7f4434106780 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.098+0000 7f44327fc640 1 -- 172.21.15.22:0/3038031964 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4424032920 con 0x7f4434106780 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.098+0000 7f44327fc640 1 -- 172.21.15.22:0/3038031964 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4424030950 con 0x7f4434106780 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 -- 172.21.15.22:0/3038031964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 msgr2=0x7f4434106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 --2- 172.21.15.22:0/3038031964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4424009820 tx=0x7f442402a270 comp rx=0 tx=0).stop 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 -- 172.21.15.22:0/3038031964 shutdown_connections 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 --2- 172.21.15.22:0/3038031964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f4434106b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 -- 172.21.15.22:0/3038031964 >> 172.21.15.22:0/3038031964 conn(0x7f4434102010 msgr2=0x7f4434104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.015 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 -- 172.21.15.22:0/3038031964 shutdown_connections 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.099+0000 7f443a13d640 1 -- 172.21.15.22:0/3038031964 wait complete. 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f443a13d640 1 Processor -- start 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f443a13d640 1 -- start start 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f443a13d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f443a13d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f443410ad30 con 0x7f4434106780 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f44337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f44337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54014/0 (socket says 172.21.15.22:54014) 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f44337fe640 1 -- 172.21.15.22:0/2092955396 learned_addr learned my addr 172.21.15.22:0/2092955396 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.100+0000 7f44337fe640 1 -- 172.21.15.22:0/2092955396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443419bec0 con 0x7f4434106780 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f44337fe640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4424009940 tx=0x7f4424032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4424042070 con 0x7f4434106780 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f44240325f0 con 0x7f4434106780 2024-09-11T22:19:56.016 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443419c150 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4424037040 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.101+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443419ee40 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.102+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4424045070 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.102+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4434106c00 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.102+0000 7f4430ff9640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 0x7f441c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.102+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f442406bfd0 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.102+0000 7f4432ffd640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 0x7f441c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.103+0000 7f4432ffd640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 0x7f441c03b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44280098c0 tx=0x7f4428006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.108+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f442403bde0 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.348+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f443402da40 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.349+0000 7f4430ff9640 1 -- 172.21.15.22:0/2092955396 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f442403cd60 con 0x7f4434106780 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 msgr2=0x7f441c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 0x7f441c03b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f44280098c0 tx=0x7f4428006db0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 msgr2=0x7f443419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4424009940 tx=0x7f4424032e40 comp rx=0 tx=0).stop 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 shutdown_connections 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f441c038f20 0x7f441c03b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 --2- 172.21.15.22:0/2092955396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4434106780 0x7f443419b980 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 >> 172.21.15.22:0/2092955396 conn(0x7f4434102010 msgr2=0x7f4434102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 shutdown_connections 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:55.352+0000 7f443a13d640 1 -- 172.21.15.22:0/2092955396 wait complete. 2024-09-11T22:19:56.018 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-09-11T22:19:56.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3689780349' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:57.152 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.386+0000 7f8e0e824640 1 Processor -- start 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.386+0000 7f8e0e824640 1 -- start start 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e0e824640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e0e824640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e081087d0 con 0x7f8e08107e00 2024-09-11T22:19:57.153 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54024/0 (socket says 172.21.15.22:54024) 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e07fff640 1 -- 172.21.15.22:0/2162262103 learned_addr learned my addr 172.21.15.22:0/2162262103 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.387+0000 7f8e07fff640 1 -- 172.21.15.22:0/2162262103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e081069d0 con 0x7f8e08107e00 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.388+0000 7f8e07fff640 1 --2- 172.21.15.22:0/2162262103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009820 tx=0x7f8df802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4028c53468b3e570 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.388+0000 7f8e077fe640 1 -- 172.21.15.22:0/2162262103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df8037070 con 0x7f8e08107e00 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.388+0000 7f8e077fe640 1 -- 172.21.15.22:0/2162262103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8df8032920 con 0x7f8e08107e00 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.388+0000 7f8e077fe640 1 -- 172.21.15.22:0/2162262103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df8030950 con 0x7f8e08107e00 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 -- 172.21.15.22:0/2162262103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 msgr2=0x7f8e08108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 --2- 172.21.15.22:0/2162262103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009820 tx=0x7f8df802a270 comp rx=0 tx=0).stop 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 -- 172.21.15.22:0/2162262103 shutdown_connections 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 --2- 172.21.15.22:0/2162262103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08108200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 -- 172.21.15.22:0/2162262103 >> 172.21.15.22:0/2162262103 conn(0x7f8e08101690 msgr2=0x7f8e08103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 -- 172.21.15.22:0/2162262103 shutdown_connections 2024-09-11T22:19:57.154 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.389+0000 7f8e0e824640 1 -- 172.21.15.22:0/2162262103 wait complete. 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e0e824640 1 Processor -- start 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e0e824640 1 -- start start 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e0e824640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e0e824640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0810ad90 con 0x7f8e08107e00 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54030/0 (socket says 172.21.15.22:54030) 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e07fff640 1 -- 172.21.15.22:0/3689780349 learned_addr learned my addr 172.21.15.22:0/3689780349 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.390+0000 7f8e07fff640 1 -- 172.21.15.22:0/3689780349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e08192010 con 0x7f8e08107e00 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e07fff640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097f0 tx=0x7f8df8032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df8037040 con 0x7f8e08107e00 2024-09-11T22:19:57.155 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8df8040070 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e08190200 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8df803a6d0 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.391+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e08190740 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.392+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f8df803a870 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.392+0000 7f8e05ffb640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 0x7f8df403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.392+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8df806bfe0 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.392+0000 7f8dfffff640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 0x7f8df403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.392+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e08108280 con 0x7f8e08107e00 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.393+0000 7f8dfffff640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 0x7f8df403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098c0 tx=0x7f8df0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.397+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8df80313a0 con 0x7f8e08107e00 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.575+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8e08195740 con 0x7f8e08107e00 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.576+0000 7f8e05ffb640 1 -- 172.21.15.22:0/3689780349 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f8df804a200 con 0x7f8e08107e00 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 msgr2=0x7f8df403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 0x7f8df403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8df00098c0 tx=0x7f8df0006db0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 msgr2=0x7f8e08191ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8df80097f0 tx=0x7f8df8032d00 comp rx=0 tx=0).stop 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 shutdown_connections 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f8df4038f70 0x7f8df403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 --2- 172.21.15.22:0/3689780349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e08107e00 0x7f8e08191ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 >> 172.21.15.22:0/3689780349 conn(0x7f8e08101690 msgr2=0x7f8e081025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 shutdown_connections 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:56.578+0000 7f8e0e824640 1 -- 172.21.15.22:0/3689780349 wait complete. 2024-09-11T22:19:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-09-11T22:19:58.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:57 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2690610875' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T22:19:58.039 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setuser ceph since I am not root 2024-09-11T22:19:58.039 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setgroup ceph since I am not root 2024-09-11T22:19:58.039 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:57.978+0000 7f2cac73a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:19:58.039 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.038+0000 7f2cac73a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:58.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.195+0000 7f2cac73a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:19:58.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.264+0000 7f2cac73a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:19:58.682 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.419+0000 7f2cac73a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:58.682 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.565+0000 7f2cac73a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:19:58.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.540+0000 7f0680d8c640 1 Processor -- start 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.540+0000 7f0680d8c640 1 -- start start 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.540+0000 7f0680d8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.540+0000 7f0680d8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f067c063490 con 0x7f067c106160 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.541+0000 7f067a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.541+0000 7f067a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54044/0 (socket says 172.21.15.22:54044) 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.541+0000 7f067a59c640 1 -- 172.21.15.22:0/2184371993 learned_addr learned my addr 172.21.15.22:0/2184371993 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.541+0000 7f067a59c640 1 -- 172.21.15.22:0/2184371993 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c106aa0 con 0x7f067c106160 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f067a59c640 1 --2- 172.21.15.22:0/2184371993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f066c009e80 tx=0x7f066c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b886459c0c71bd8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f067959a640 1 -- 172.21.15.22:0/2184371993 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066c036070 con 0x7f067c106160 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f067959a640 1 -- 172.21.15.22:0/2184371993 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f066c0318e0 con 0x7f067c106160 2024-09-11T22:19:58.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f067959a640 1 -- 172.21.15.22:0/2184371993 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066c007b00 con 0x7f067c106160 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f0680d8c640 1 -- 172.21.15.22:0/2184371993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 msgr2=0x7f067c106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.542+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2184371993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f066c009e80 tx=0x7f066c02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.543+0000 7f0680d8c640 1 -- 172.21.15.22:0/2184371993 shutdown_connections 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.543+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2184371993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c106560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.543+0000 7f0680d8c640 1 -- 172.21.15.22:0/2184371993 >> 172.21.15.22:0/2184371993 conn(0x7f067c101fd0 msgr2=0x7f067c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.543+0000 7f0680d8c640 1 -- 172.21.15.22:0/2184371993 shutdown_connections 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.543+0000 7f0680d8c640 1 -- 172.21.15.22:0/2184371993 wait complete. 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f0680d8c640 1 Processor -- start 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f0680d8c640 1 -- start start 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f0680d8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f0680d8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f067c107c00 con 0x7f067c106160 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f067a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.690 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f067a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54054/0 (socket says 172.21.15.22:54054) 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f067a59c640 1 -- 172.21.15.22:0/2690610875 learned_addr learned my addr 172.21.15.22:0/2690610875 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f067a59c640 1 -- 172.21.15.22:0/2690610875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c19e030 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.544+0000 7f067a59c640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f066c0076d0 tx=0x7f066c0316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.545+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066c041020 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.545+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f066c007e50 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.545+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066c036040 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.545+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c19e2c0 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.545+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c1a0fb0 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f066c044020 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067c106560 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f066b7fe640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 0x7f066403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f066c06cd30 con 0x7f067c106160 2024-09-11T22:19:58.691 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f0679d9b640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 0x7f066403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.546+0000 7f0679d9b640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 0x7f066403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f06700098c0 tx=0x7f0670006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.551+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f066c04b020 con 0x7f067c106160 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.778+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f067c02db20 con 0x7f067c106160 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.829+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f066c04d300 con 0x7f067c106160 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.831+0000 7f066b7fe640 1 -- 172.21.15.22:0/2690610875 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f066c03c470 con 0x7f067c106160 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 msgr2=0x7f066403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 0x7f066403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f06700098c0 tx=0x7f0670006db0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 msgr2=0x7f067c19daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f066c0076d0 tx=0x7f066c0316a0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 shutdown_connections 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f0664038f20 0x7f066403b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 --2- 172.21.15.22:0/2690610875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f067c106160 0x7f067c19daf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.692 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 >> 172.21.15.22:0/2690610875 conn(0x7f067c101fd0 msgr2=0x7f067c194750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.693 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 shutdown_connections 2024-09-11T22:19:58.693 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:57.832+0000 7f0680d8c640 1 -- 172.21.15.22:0/2690610875 wait complete. 2024-09-11T22:19:58.937 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2690610875' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T22:19:58.937 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-mon[30966]: mgrmap e5: x(active, since 5s) 2024-09-11T22:19:58.937 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.898+0000 7f2cac73a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:19:59.337 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:58.964+0000 7f2cac73a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:19:59.337 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:19:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:19:59.163+0000 7f2cac73a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:19:59.930 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:19:59 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1985082123' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T22:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.130+0000 7f1e1d478640 1 Processor -- start 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.130+0000 7f1e1d478640 1 -- start start 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.130+0000 7f1e1d478640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.130+0000 7f1e1d478640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1807b7d0 con 0x7f1e1807cda0 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.131+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.131+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54092/0 (socket says 172.21.15.22:54092) 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.131+0000 7f1e16ffd640 1 -- 172.21.15.22:0/1070594739 learned_addr learned my addr 172.21.15.22:0/1070594739 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.131+0000 7f1e16ffd640 1 -- 172.21.15.22:0/1070594739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1807b950 con 0x7f1e1807cda0 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.132+0000 7f1e16ffd640 1 --2- 172.21.15.22:0/1070594739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009820 tx=0x7f1e0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920eb8e3c0e6e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.132+0000 7f1e167fc640 1 -- 172.21.15.22:0/1070594739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e08037070 con 0x7f1e1807cda0 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.132+0000 7f1e167fc640 1 -- 172.21.15.22:0/1070594739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1e08032920 con 0x7f1e1807cda0 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.132+0000 7f1e167fc640 1 -- 172.21.15.22:0/1070594739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e08030950 con 0x7f1e1807cda0 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 -- 172.21.15.22:0/1070594739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 msgr2=0x7f1e1807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1070594739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009820 tx=0x7f1e0802a270 comp rx=0 tx=0).stop 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 -- 172.21.15.22:0/1070594739 shutdown_connections 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1070594739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1807b200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 -- 172.21.15.22:0/1070594739 >> 172.21.15.22:0/1070594739 conn(0x7f1e18103080 msgr2=0x7f1e181054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 -- 172.21.15.22:0/1070594739 shutdown_connections 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 -- 172.21.15.22:0/1070594739 wait complete. 2024-09-11T22:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.133+0000 7f1e1d478640 1 Processor -- start 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e1d478640 1 -- start start 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e1d478640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e1d478640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1810dfa0 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54104/0 (socket says 172.21.15.22:54104) 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e16ffd640 1 -- 172.21.15.22:0/1985082123 learned_addr learned my addr 172.21.15.22:0/1985082123 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e16ffd640 1 -- 172.21.15.22:0/1985082123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1819e070 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.134+0000 7f1e16ffd640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006f10 tx=0x7f1e080327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.135+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e08037040 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.135+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1e08040070 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.135+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1819e300 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.135+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0803a630 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.135+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e181a0ff0 con 0x7f1e1807cda0 2024-09-11T22:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e1807b280 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f1e0803a870 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e14ff9640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 0x7f1e0403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1e0806c060 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e0ffff640 1 -- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 msgr2=0x7f1e0403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.136+0000 7f1e0ffff640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 0x7f1e0403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.141+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e08041270 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.337+0000 7f1e0ffff640 1 -- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 msgr2=0x7f1e0403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.337+0000 7f1e0ffff640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 0x7f1e0403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.366+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1e181a1670 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.366+0000 7f1e14ff9640 1 -- 172.21.15.22:0/1985082123 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1e08043bf0 con 0x7f1e1807cda0 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 msgr2=0x7f1e0403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 0x7f1e0403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 msgr2=0x7f1e1819db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006f10 tx=0x7f1e080327d0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 shutdown_connections 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f1e04038f70 0x7f1e0403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 --2- 172.21.15.22:0/1985082123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e1807cda0 0x7f1e1819db30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 >> 172.21.15.22:0/1985082123 conn(0x7f1e18103080 msgr2=0x7f1e18103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 shutdown_connections 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:19:59.369+0000 7f1e1d478640 1 -- 172.21.15.22:0/1985082123 wait complete. 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-11T22:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-09-11T22:20:00.187 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:00.100+0000 7f2cac73a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:20:00.188 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:00.172+0000 7f2cac73a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:20:01.198 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:00.927+0000 7f2cac73a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:20:01.198 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.048+0000 7f2cac73a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:20:01.492 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.197+0000 7f2cac73a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:01.492 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.261+0000 7f2cac73a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:20:01.492 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.420+0000 7f2cac73a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:20:01.492 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.491+0000 7f2cac73a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:20:01.780 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.554+0000 7f2cac73a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:20:01.781 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.720+0000 7f2cac73a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:20:02.068 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.788+0000 7f2cac73a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:20:02.068 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.857+0000 7f2cac73a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:20:02.068 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:01.943+0000 7f2cac73a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:02.068 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:02.005+0000 7f2cac73a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:20:02.069 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:02.067+0000 7f2cac73a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:02.896+0000 7f2cac73a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: Active manager daemon x restarted 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: Activating manager daemon x 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: mgrmap e6: x(active, starting, since 0.00340042s) 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:20:03.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: Manager daemon x is now available 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:20:03.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:02 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.371+0000 7f4d723f8640 1 Processor -- start 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.371+0000 7f4d723f8640 1 -- start start 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d723f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d723f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c1083a0 con 0x7f4d6c1079d0 2024-09-11T22:20:04.505 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54114/0 (socket says 172.21.15.22:54114) 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d6bfff640 1 -- 172.21.15.22:0/1202503764 learned_addr learned my addr 172.21.15.22:0/1202503764 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.372+0000 7f4d6bfff640 1 -- 172.21.15.22:0/1202503764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c108b80 con 0x7f4d6c1079d0 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.373+0000 7f4d6bfff640 1 --2- 172.21.15.22:0/1202503764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009820 tx=0x7f4d5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a90cd8d270ceb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.373+0000 7f4d6affd640 1 -- 172.21.15.22:0/1202503764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c037070 con 0x7f4d6c1079d0 2024-09-11T22:20:04.506 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.373+0000 7f4d6affd640 1 -- 172.21.15.22:0/1202503764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4d5c032920 con 0x7f4d6c1079d0 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.373+0000 7f4d6affd640 1 -- 172.21.15.22:0/1202503764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c030950 con 0x7f4d6c1079d0 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 -- 172.21.15.22:0/1202503764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 msgr2=0x7f4d6c107dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 --2- 172.21.15.22:0/1202503764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009820 tx=0x7f4d5c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 -- 172.21.15.22:0/1202503764 shutdown_connections 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 --2- 172.21.15.22:0/1202503764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c107dd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 -- 172.21.15.22:0/1202503764 >> 172.21.15.22:0/1202503764 conn(0x7f4d6c103160 msgr2=0x7f4d6c1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:04.507 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 -- 172.21.15.22:0/1202503764 shutdown_connections 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.374+0000 7f4d723f8640 1 -- 172.21.15.22:0/1202503764 wait complete. 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d723f8640 1 Processor -- start 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d723f8640 1 -- start start 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d723f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d723f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c10bf30 con 0x7f4d6c1079d0 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54118/0 (socket says 172.21.15.22:54118) 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d6bfff640 1 -- 172.21.15.22:0/3342266726 learned_addr learned my addr 172.21.15.22:0/3342266726 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.375+0000 7f4d6bfff640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c19bf90 con 0x7f4d6c1079d0 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d6bfff640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097f0 tx=0x7f4d5c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c037040 con 0x7f4d6c1079d0 2024-09-11T22:20:04.508 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4d5c040070 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c19c220 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5c03a610 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.376+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c19ef10 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4d5c03a840 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d697fa640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d6c107e50 con 0x7f4d54038fc0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4d5c03b4e0 con 0x7f4d6c1079d0 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d6b7fe640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 msgr2=0x7f4d5403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:20:04.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.377+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.578+0000 7f4d6b7fe640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 msgr2=0x7f4d5403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.578+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.979+0000 7f4d6b7fe640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 msgr2=0x7f4d5403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:00.979+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:01.780+0000 7f4d6b7fe640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 msgr2=0x7f4d5403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3167992537 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:01.780+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:02.900+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f4d5c06bfc0 con 0x7f4d6c1079d0 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:02.900+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 msgr2=0x7f4d5403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:02.900+0000 7f4d697fa640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.900+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f4d5c0397b0 con 0x7f4d6c1079d0 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.900+0000 7f4d697fa640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 0x7f4d5403eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:04.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.900+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d5c00af30 con 0x7f4d5403c700 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.900+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 0x7f4d5403eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.901+0000 7f4d6b7fe640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 0x7f4d5403eaf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4d60003980 tx=0x7f4d600092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.902+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4d5c00af30 con 0x7f4d5403c700 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4d6c19c700 con 0x7f4d5403c700 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d697fa640 1 -- 172.21.15.22:0/3342266726 <== mgr.14118 v2:172.21.15.22:6800/3544100501 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4d6c19c700 con 0x7f4d5403c700 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 msgr2=0x7f4d5403eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d723f8640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 0x7f4d5403eaf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4d60003980 tx=0x7f4d600092b0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 msgr2=0x7f4d6c19ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:04.511 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.909+0000 7f4d723f8640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097f0 tx=0x7f4d5c032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 shutdown_connections 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4d5403c700 0x7f4d5403eaf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:6800/3167992537,v1:172.21.15.22:6801/3167992537] conn(0x7f4d54038fc0 0x7f4d5403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 --2- 172.21.15.22:0/3342266726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d6c1079d0 0x7f4d6c19ba50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 >> 172.21.15.22:0/3342266726 conn(0x7f4d6c103160 msgr2=0x7f4d6c103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 shutdown_connections 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:03.910+0000 7f4d723f8640 1 -- 172.21.15.22:0/3342266726 wait complete. 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-09-11T22:20:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-09-11T22:20:04.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-mon[30966]: Found migration_current of "None". Setting to last migration. 2024-09-11T22:20:04.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:04.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:04.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-mon[30966]: mgrmap e7: x(active, since 1.00518s) 2024-09-11T22:20:05.096 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:04.914+0000 7f2c1929f640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:20:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Traceback (most recent call last): 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._connections.run(self.expiration_interval) 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._run(expiration_interval) 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:05.097 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s = self.context.wrap_socket( 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: return self.sslsocket_class._create( 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self.do_handshake() 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._sslobj.do_handshake() 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:05.098 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:04] ENGINE Bus STARTING 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:05 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.891+0000 7fb50c6c3640 1 Processor -- start 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.891+0000 7fb50c6c3640 1 -- start start 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50c6c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50c6c3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb504108270 con 0x7fb5041078a0 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50a45f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50a45f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43038/0 (socket says 172.21.15.22:43038) 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50a45f640 1 -- 172.21.15.22:0/1993396479 learned_addr learned my addr 172.21.15.22:0/1993396479 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.892+0000 7fb50a45f640 1 -- 172.21.15.22:0/1993396479 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb504108aa0 con 0x7fb5041078a0 2024-09-11T22:20:05.685 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.893+0000 7fb50a45f640 1 --2- 172.21.15.22:0/1993396479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb500009820 tx=0x7fb50002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcb320fa35e2afb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.893+0000 7fb50945d640 1 -- 172.21.15.22:0/1993396479 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500037070 con 0x7fb5041078a0 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.893+0000 7fb50945d640 1 -- 172.21.15.22:0/1993396479 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb500032920 con 0x7fb5041078a0 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.893+0000 7fb50945d640 1 -- 172.21.15.22:0/1993396479 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500030950 con 0x7fb5041078a0 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 -- 172.21.15.22:0/1993396479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 msgr2=0x7fb504107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/1993396479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb500009820 tx=0x7fb50002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 -- 172.21.15.22:0/1993396479 shutdown_connections 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/1993396479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb504107ca0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 -- 172.21.15.22:0/1993396479 >> 172.21.15.22:0/1993396479 conn(0x7fb504103050 msgr2=0x7fb504105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 -- 172.21.15.22:0/1993396479 shutdown_connections 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.894+0000 7fb50c6c3640 1 -- 172.21.15.22:0/1993396479 wait complete. 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50c6c3640 1 Processor -- start 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50c6c3640 1 -- start start 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50c6c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50c6c3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb50410be50 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50a45f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50a45f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43054/0 (socket says 172.21.15.22:43054) 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50a45f640 1 -- 172.21.15.22:0/3099162412 learned_addr learned my addr 172.21.15.22:0/3099162412 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50a45f640 1 -- 172.21.15.22:0/3099162412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50419bea0 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50a45f640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097f0 tx=0x7fb500032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500037040 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50419c130 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb500040070 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.895+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb50003a610 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.896+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50419ee20 con 0x7fb5041078a0 2024-09-11T22:20:05.687 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.896+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb50003a890 con 0x7fb5041078a0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.896+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb504107d20 con 0x7fb5041078a0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.897+0000 7fb4fb7fe640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 0x7fb4f003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.897+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb50006c430 con 0x7fb5041078a0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.897+0000 7fb509c5e640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 0x7fb4f003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.897+0000 7fb509c5e640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 0x7fb4f003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40098c0 tx=0x7fb4f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:04.902+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5000313a0 con 0x7fb5041078a0 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.094+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb504104340 con 0x7fb4f0038e60 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.099+0000 7fb4fb7fe640 1 -- 172.21.15.22:0/3099162412 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb504104340 con 0x7fb4f0038e60 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.101+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 msgr2=0x7fb4f003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.101+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 0x7fb4f003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40098c0 tx=0x7fb4f4006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.101+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 msgr2=0x7fb50419b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.101+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097f0 tx=0x7fb500032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.101+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 shutdown_connections 2024-09-11T22:20:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.102+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb4f0038e60 0x7fb4f003b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.102+0000 7fb50c6c3640 1 --2- 172.21.15.22:0/3099162412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5041078a0 0x7fb50419b960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:05.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.102+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 >> 172.21.15.22:0/3099162412 conn(0x7fb504103050 msgr2=0x7fb504103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:05.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.102+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 shutdown_connections 2024-09-11T22:20:05.689 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:05.102+0000 7fb50c6c3640 1 -- 172.21.15.22:0/3099162412 wait complete. 2024-09-11T22:20:06.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:04] ENGINE Serving on https://172.21.15.22:7150 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:05] ENGINE Serving on http://172.21.15.22:8765 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:05] ENGINE Bus STARTED 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:06 smithi022 ceph-mon[30966]: mgrmap e8: x(active, since 2s) 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.106+0000 7f3b8a1e2640 1 Processor -- start 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.106+0000 7f3b8a1e2640 1 -- start start 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.106+0000 7f3b8a1e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.106+0000 7f3b8a1e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b84108700 con 0x7f3b84107d30 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.107+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.107+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43068/0 (socket says 172.21.15.22:43068) 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.107+0000 7f3b837fe640 1 -- 172.21.15.22:0/1571711800 learned_addr learned my addr 172.21.15.22:0/1571711800 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.107+0000 7f3b837fe640 1 -- 172.21.15.22:0/1571711800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b84106990 con 0x7f3b84107d30 2024-09-11T22:20:06.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b837fe640 1 --2- 172.21.15.22:0/1571711800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009820 tx=0x7f3b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b842e3d2fded9e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b827fc640 1 -- 172.21.15.22:0/1571711800 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b74037070 con 0x7f3b84107d30 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b827fc640 1 -- 172.21.15.22:0/1571711800 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3b74032920 con 0x7f3b84107d30 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b827fc640 1 -- 172.21.15.22:0/1571711800 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b74030950 con 0x7f3b84107d30 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/1571711800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 msgr2=0x7f3b84108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.108+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/1571711800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009820 tx=0x7f3b7402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/1571711800 shutdown_connections 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/1571711800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b84108130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/1571711800 >> 172.21.15.22:0/1571711800 conn(0x7f3b84101650 msgr2=0x7f3b84103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/1571711800 shutdown_connections 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/1571711800 wait complete. 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 Processor -- start 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.109+0000 7f3b8a1e2640 1 -- start start 2024-09-11T22:20:06.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b8a1e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b8a1e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8410ad50 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43080/0 (socket says 172.21.15.22:43080) 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b837fe640 1 -- 172.21.15.22:0/3131591897 learned_addr learned my addr 172.21.15.22:0/3131591897 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b837fe640 1 -- 172.21.15.22:0/3131591897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8419be60 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b837fe640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b740097f0 tx=0x7f3b74032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b74037040 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3b74040070 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.110+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b7403a6d0 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.111+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8419c0f0 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.111+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8419ede0 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.111+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3b7403a8c0 con 0x7f3b84107d30 2024-09-11T22:20:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.112+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8410aed0 con 0x7f3b84107d30 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.112+0000 7f3b80ff9640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 0x7f3b6c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.112+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3b7406c530 con 0x7f3b84107d30 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.112+0000 7f3b82ffd640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 0x7f3b6c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.112+0000 7f3b82ffd640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 0x7f3b6c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b780098c0 tx=0x7f3b78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.117+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b740392e0 con 0x7f3b84107d30 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.293+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f3b84102960 con 0x7f3b6c038f70 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.294+0000 7f3b80ff9640 1 -- 172.21.15.22:0/3131591897 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f3b84102960 con 0x7f3b6c038f70 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.296+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 msgr2=0x7f3b6c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.296+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 0x7f3b6c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b780098c0 tx=0x7f3b78006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.296+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 msgr2=0x7f3b8419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.296+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b740097f0 tx=0x7f3b74032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:06.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 shutdown_connections 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f3b6c038f70 0x7f3b6c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 --2- 172.21.15.22:0/3131591897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b84107d30 0x7f3b8419b920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 >> 172.21.15.22:0/3131591897 conn(0x7f3b84101650 msgr2=0x7f3b84102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 shutdown_connections 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.297+0000 7f3b8a1e2640 1 -- 172.21.15.22:0/3131591897 wait complete. 2024-09-11T22:20:06.860 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-09-11T22:20:07.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-mon[30966]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Generating public/private rsa key pair. 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Your identification has been saved in /tmp/tmphg950mei/key 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Your public key has been saved in /tmp/tmphg950mei/key.pub 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: The key fingerprint is: 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: SHA256:/72Elyd0Fr6TtDBNfnZWexDTdTyB8ad/aKX9oRWWtFs ceph-c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:08.347 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: The key's randomart image is: 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: +---[RSA 3072]----+ 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | .=+=| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | ..++| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | .=+| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | *oB| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | S oo@E| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | . o=%@| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | . . OO=| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | . =oo=| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: | ..o..| 2024-09-11T22:20:08.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: +----[SHA256]-----+ 2024-09-11T22:20:08.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:08 smithi022 ceph-mon[30966]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:08.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:08 smithi022 ceph-mon[30966]: Generating ssh key... 2024-09-11T22:20:08.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:08 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:08.619 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:08 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:08.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f7617c3b640 1 Processor -- start 2024-09-11T22:20:08.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f7617c3b640 1 -- start start 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f7617c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f7617c3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76100634f0 con 0x7f7610108310 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f76159d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f76159d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43086/0 (socket says 172.21.15.22:43086) 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.293+0000 7f76159d7640 1 -- 172.21.15.22:0/4065904808 learned_addr learned my addr 172.21.15.22:0/4065904808 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.294+0000 7f76159d7640 1 -- 172.21.15.22:0/4065904808 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761010ac40 con 0x7f7610108310 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.294+0000 7f76159d7640 1 --2- 172.21.15.22:0/4065904808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f760c009820 tx=0x7f760c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249ed6e45de172c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f76149d5640 1 -- 172.21.15.22:0/4065904808 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f760c037070 con 0x7f7610108310 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f76149d5640 1 -- 172.21.15.22:0/4065904808 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f760c032920 con 0x7f7610108310 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f76149d5640 1 -- 172.21.15.22:0/4065904808 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f760c030950 con 0x7f7610108310 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 -- 172.21.15.22:0/4065904808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 msgr2=0x7f761010a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:08.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 --2- 172.21.15.22:0/4065904808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f760c009820 tx=0x7f760c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 -- 172.21.15.22:0/4065904808 shutdown_connections 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 --2- 172.21.15.22:0/4065904808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f761010a700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 -- 172.21.15.22:0/4065904808 >> 172.21.15.22:0/4065904808 conn(0x7f7610101fd0 msgr2=0x7f76101043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 -- 172.21.15.22:0/4065904808 shutdown_connections 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.295+0000 7f7617c3b640 1 -- 172.21.15.22:0/4065904808 wait complete. 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f7617c3b640 1 Processor -- start 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f7617c3b640 1 -- start start 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f7617c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f7617c3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f761010bc70 con 0x7f7610108310 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f76159d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f76159d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43092/0 (socket says 172.21.15.22:43092) 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.296+0000 7f76159d7640 1 -- 172.21.15.22:0/1899879218 learned_addr learned my addr 172.21.15.22:0/1899879218 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:08.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f76159d7640 1 -- 172.21.15.22:0/1899879218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76101080d0 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f76159d7640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f760c031000 tx=0x7f760c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f760c042070 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f760c0325f0 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76101062c0 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f760c037040 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.297+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7610106800 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.298+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f760c045070 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.298+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7610108770 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.298+0000 7f7606ffd640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 0x7f75fc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.298+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f760c06bf50 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.298+0000 7f76151d6640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 0x7f75fc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.299+0000 7f76151d6640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 0x7f75fc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76000098c0 tx=0x7f7600006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.303+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f760c02f2a0 con 0x7f7610108310 2024-09-11T22:20:08.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.479+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7610103300 con 0x7f75fc038fc0 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.997+0000 7f7606ffd640 1 -- 172.21.15.22:0/1899879218 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7610103300 con 0x7f75fc038fc0 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 msgr2=0x7f75fc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 0x7f75fc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76000098c0 tx=0x7f7600006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 msgr2=0x7f7610107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f760c031000 tx=0x7f760c032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 shutdown_connections 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f75fc038fc0 0x7f75fc03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 --2- 172.21.15.22:0/1899879218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7610108310 0x7f7610107b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.999+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 >> 172.21.15.22:0/1899879218 conn(0x7f7610101fd0 msgr2=0x7f7610102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.000+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 shutdown_connections 2024-09-11T22:20:08.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.000+0000 7f7617c3b640 1 -- 172.21.15.22:0/1899879218 wait complete. 2024-09-11T22:20:09.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:09 smithi022 ceph-mon[30966]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:09.977 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.204+0000 7f6164d9a640 1 Processor -- start 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.204+0000 7f6164d9a640 1 -- start start 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f6164d9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f6164d9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6160107150 con 0x7f6160106780 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f615e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f615e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43096/0 (socket says 172.21.15.22:43096) 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f615e59c640 1 -- 172.21.15.22:0/928826555 learned_addr learned my addr 172.21.15.22:0/928826555 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.205+0000 7f615e59c640 1 -- 172.21.15.22:0/928826555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6160107980 con 0x7f6160106780 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.206+0000 7f615e59c640 1 --2- 172.21.15.22:0/928826555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6150009820 tx=0x7f615002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791d872d1eb72022 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.206+0000 7f615d59a640 1 -- 172.21.15.22:0/928826555 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150037070 con 0x7f6160106780 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.206+0000 7f615d59a640 1 -- 172.21.15.22:0/928826555 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6150032920 con 0x7f6160106780 2024-09-11T22:20:09.978 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.206+0000 7f615d59a640 1 -- 172.21.15.22:0/928826555 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150030950 con 0x7f6160106780 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 -- 172.21.15.22:0/928826555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 msgr2=0x7f6160106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 --2- 172.21.15.22:0/928826555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6150009820 tx=0x7f615002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 -- 172.21.15.22:0/928826555 shutdown_connections 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 --2- 172.21.15.22:0/928826555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f6160106b80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 -- 172.21.15.22:0/928826555 >> 172.21.15.22:0/928826555 conn(0x7f6160102010 msgr2=0x7f6160104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 -- 172.21.15.22:0/928826555 shutdown_connections 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.207+0000 7f6164d9a640 1 -- 172.21.15.22:0/928826555 wait complete. 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f6164d9a640 1 Processor -- start 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f6164d9a640 1 -- start start 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f6164d9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f6164d9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f616010ad30 con 0x7f6160106780 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f615e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:09.979 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f615e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43098/0 (socket says 172.21.15.22:43098) 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.208+0000 7f615e59c640 1 -- 172.21.15.22:0/3813078936 learned_addr learned my addr 172.21.15.22:0/3813078936 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f615e59c640 1 -- 172.21.15.22:0/3813078936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616019bec0 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f615e59c640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6150009940 tx=0x7f6150032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150042070 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616019c150 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f61500325f0 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150037040 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.209+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616019ee40 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.210+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6150045070 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.210+0000 7f614f7fe640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 0x7f614803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.210+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6160106c00 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.210+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f615006c220 con 0x7f6160106780 2024-09-11T22:20:09.980 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.211+0000 7f615dd9b640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 0x7f614803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.211+0000 7f615dd9b640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 0x7f614803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61540098c0 tx=0x7f6154006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.216+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f615003cd10 con 0x7f6160106780 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.392+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f616002da80 con 0x7f6148038f70 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.393+0000 7f614f7fe640 1 -- 172.21.15.22:0/3813078936 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f616002da80 con 0x7f6148038f70 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 msgr2=0x7f614803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 0x7f614803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61540098c0 tx=0x7f6154006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 msgr2=0x7f616019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6150009940 tx=0x7f6150032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 shutdown_connections 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f6148038f70 0x7f614803b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 --2- 172.21.15.22:0/3813078936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6160106780 0x7f616019b980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.981 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.395+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 >> 172.21.15.22:0/3813078936 conn(0x7f6160102010 msgr2=0x7f6160102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:09.982 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.396+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 shutdown_connections 2024-09-11T22:20:09.982 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:09.396+0000 7f6164d9a640 1 -- 172.21.15.22:0/3813078936 wait complete. 2024-09-11T22:20:09.982 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:20:09.982 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T22:20:09.982 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-09-11T22:20:11.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:10 smithi022 ceph-mon[30966]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:12.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:11 smithi022 ceph-mon[30966]: Deploying cephadm binary to smithi022 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa8f5a640 1 Processor -- start 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa8f5a640 1 -- start start 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa8f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa8f5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa4108270 con 0x7f2aa41078a0 2024-09-11T22:20:15.003 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43106/0 (socket says 172.21.15.22:43106) 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa259c640 1 -- 172.21.15.22:0/2927818155 learned_addr learned my addr 172.21.15.22:0/2927818155 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.345+0000 7f2aa259c640 1 -- 172.21.15.22:0/2927818155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa4108aa0 con 0x7f2aa41078a0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.346+0000 7f2aa259c640 1 --2- 172.21.15.22:0/2927818155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009820 tx=0x7f2a9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e7997d007eb7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.346+0000 7f2aa1d9b640 1 -- 172.21.15.22:0/2927818155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a94037070 con 0x7f2aa41078a0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.346+0000 7f2aa1d9b640 1 -- 172.21.15.22:0/2927818155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2a94032920 con 0x7f2aa41078a0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.346+0000 7f2aa1d9b640 1 -- 172.21.15.22:0/2927818155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a94030950 con 0x7f2aa41078a0 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/2927818155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 msgr2=0x7f2aa4107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/2927818155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009820 tx=0x7f2a9402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/2927818155 shutdown_connections 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/2927818155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa4107ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:15.004 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/2927818155 >> 172.21.15.22:0/2927818155 conn(0x7f2aa4103050 msgr2=0x7f2aa4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/2927818155 shutdown_connections 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.347+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/2927818155 wait complete. 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa8f5a640 1 Processor -- start 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa8f5a640 1 -- start start 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa8f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa8f5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa410be50 con 0x7f2aa41078a0 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43120/0 (socket says 172.21.15.22:43120) 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa259c640 1 -- 172.21.15.22:0/6792283 learned_addr learned my addr 172.21.15.22:0/6792283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.348+0000 7f2aa259c640 1 -- 172.21.15.22:0/6792283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa419e0b0 con 0x7f2aa41078a0 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2aa259c640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009940 tx=0x7f2a94032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a94042070 con 0x7f2aa41078a0 2024-09-11T22:20:15.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2a940325f0 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa419e340 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a94037040 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.349+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa41a1030 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.350+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2a94045070 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.350+0000 7f2a9b7fe640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 0x7f2a9003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.350+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa4107d20 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.350+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2a9406bf90 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.350+0000 7f2a9bfff640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 0x7f2a9003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.351+0000 7f2a9bfff640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 0x7f2a9003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098c0 tx=0x7f2a8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.355+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a9403c7f0 con 0x7f2aa41078a0 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:10.533+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}) -- 0x7f2aa41042c0 con 0x7f2a90038f70 2024-09-11T22:20:15.006 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.402+0000 7f2a9b7fe640 1 -- 172.21.15.22:0/6792283 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f2aa41042c0 con 0x7f2a90038f70 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.404+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 msgr2=0x7f2a9003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.404+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 0x7f2a9003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098c0 tx=0x7f2a8c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.404+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 msgr2=0x7f2aa419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.404+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009940 tx=0x7f2a94032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 shutdown_connections 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f2a90038f70 0x7f2a9003b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 --2- 172.21.15.22:0/6792283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aa41078a0 0x7f2aa419db70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 >> 172.21.15.22:0/6792283 conn(0x7f2aa4103050 msgr2=0x7f2aa4103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 shutdown_connections 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:14.405+0000 7f2aa8f5a640 1 -- 172.21.15.22:0/6792283 wait complete. 2024-09-11T22:20:15.007 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-09-11T22:20:15.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:15 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:15.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:15 smithi022 ceph-mon[30966]: Added host smithi022 2024-09-11T22:20:15.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:15 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b0379b640 1 Processor -- start 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b0379b640 1 -- start start 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b0379b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.371 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b0379b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc063490 con 0x7f7afc108370 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b01537640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b01537640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50644/0 (socket says 172.21.15.22:50644) 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.392+0000 7f7b01537640 1 -- 172.21.15.22:0/2547240501 learned_addr learned my addr 172.21.15.22:0/2547240501 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.393+0000 7f7b01537640 1 -- 172.21.15.22:0/2547240501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc10aca0 con 0x7f7afc108370 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.393+0000 7f7b01537640 1 --2- 172.21.15.22:0/2547240501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009820 tx=0x7f7af802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4134778632556837 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.393+0000 7f7af3fff640 1 -- 172.21.15.22:0/2547240501 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7af8037070 con 0x7f7afc108370 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.393+0000 7f7af3fff640 1 -- 172.21.15.22:0/2547240501 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7af8032920 con 0x7f7afc108370 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.393+0000 7f7af3fff640 1 -- 172.21.15.22:0/2547240501 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7af8030950 con 0x7f7afc108370 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 -- 172.21.15.22:0/2547240501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 msgr2=0x7f7afc10a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2547240501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009820 tx=0x7f7af802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:16.372 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 -- 172.21.15.22:0/2547240501 shutdown_connections 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2547240501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc10a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 -- 172.21.15.22:0/2547240501 >> 172.21.15.22:0/2547240501 conn(0x7f7afc102010 msgr2=0x7f7afc104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 -- 172.21.15.22:0/2547240501 shutdown_connections 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.394+0000 7f7b0379b640 1 -- 172.21.15.22:0/2547240501 wait complete. 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.395+0000 7f7b0379b640 1 Processor -- start 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.395+0000 7f7b0379b640 1 -- start start 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.395+0000 7f7b0379b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b0379b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10bce0 con 0x7f7afc108370 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b01537640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b01537640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50648/0 (socket says 172.21.15.22:50648) 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b01537640 1 -- 172.21.15.22:0/2002981460 learned_addr learned my addr 172.21.15.22:0/2002981460 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b01537640 1 -- 172.21.15.22:0/2002981460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc108130 con 0x7f7afc108370 2024-09-11T22:20:16.373 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b01537640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7af8031000 tx=0x7f7af8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.374 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7af8042070 con 0x7f7afc108370 2024-09-11T22:20:16.374 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7af80325f0 con 0x7f7afc108370 2024-09-11T22:20:16.374 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc106320 con 0x7f7afc108370 2024-09-11T22:20:16.374 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7af8037040 con 0x7f7afc108370 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.396+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc106860 con 0x7f7afc108370 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.397+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7af8045070 con 0x7f7afc108370 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.398+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc1087d0 con 0x7f7afc108370 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.398+0000 7f7af27fc640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 0x7f7ae803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.398+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7af806d190 con 0x7f7afc108370 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.398+0000 7f7b00d36640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 0x7f7ae803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.398+0000 7f7b00d36640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 0x7f7ae803b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098c0 tx=0x7f7aec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.375 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.403+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7af8042210 con 0x7f7afc108370 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.620+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7afc1070e0 con 0x7f7ae8038f70 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.625+0000 7f7af27fc640 1 -- 172.21.15.22:0/2002981460 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7afc1070e0 con 0x7f7ae8038f70 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 msgr2=0x7f7ae803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 0x7f7ae803b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098c0 tx=0x7f7aec006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 msgr2=0x7f7afc107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7af8031000 tx=0x7f7af8032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 shutdown_connections 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f7ae8038f70 0x7f7ae803b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 --2- 172.21.15.22:0/2002981460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7afc108370 0x7f7afc107bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 >> 172.21.15.22:0/2002981460 conn(0x7f7afc102010 msgr2=0x7f7afc102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 shutdown_connections 2024-09-11T22:20:16.376 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:15.627+0000 7f7b0379b640 1 -- 172.21.15.22:0/2002981460 wait complete. 2024-09-11T22:20:16.377 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-09-11T22:20:16.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:16 smithi022 ceph-mon[30966]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:16.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:16 smithi022 ceph-mon[30966]: Saving service mon spec with placement count:5 2024-09-11T22:20:16.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:16 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:17.555 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T22:20:17.555 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.776+0000 7fb8d8463640 1 Processor -- start 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d8463640 1 -- start start 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d8463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d8463640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d0063490 con 0x7fb8d0106160 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d61ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d61ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50652/0 (socket says 172.21.15.22:50652) 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d61ff640 1 -- 172.21.15.22:0/2741768771 learned_addr learned my addr 172.21.15.22:0/2741768771 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.777+0000 7fb8d61ff640 1 -- 172.21.15.22:0/2741768771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d0106aa0 con 0x7fb8d0106160 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.778+0000 7fb8d61ff640 1 --2- 172.21.15.22:0/2741768771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009820 tx=0x7fb8cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a602c56d68e5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.778+0000 7fb8d51fd640 1 -- 172.21.15.22:0/2741768771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc037070 con 0x7fb8d0106160 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.778+0000 7fb8d51fd640 1 -- 172.21.15.22:0/2741768771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb8cc032920 con 0x7fb8d0106160 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.778+0000 7fb8d51fd640 1 -- 172.21.15.22:0/2741768771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc030950 con 0x7fb8d0106160 2024-09-11T22:20:17.556 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 -- 172.21.15.22:0/2741768771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 msgr2=0x7fb8d0106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 --2- 172.21.15.22:0/2741768771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009820 tx=0x7fb8cc02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 -- 172.21.15.22:0/2741768771 shutdown_connections 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 --2- 172.21.15.22:0/2741768771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d0106560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 -- 172.21.15.22:0/2741768771 >> 172.21.15.22:0/2741768771 conn(0x7fb8d0101f30 msgr2=0x7fb8d0104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 -- 172.21.15.22:0/2741768771 shutdown_connections 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.779+0000 7fb8d8463640 1 -- 172.21.15.22:0/2741768771 wait complete. 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d8463640 1 Processor -- start 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d8463640 1 -- start start 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d8463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d8463640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d0107c00 con 0x7fb8d0106160 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d61ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d61ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50662/0 (socket says 172.21.15.22:50662) 2024-09-11T22:20:17.557 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d61ff640 1 -- 172.21.15.22:0/133365917 learned_addr learned my addr 172.21.15.22:0/133365917 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.780+0000 7fb8d61ff640 1 -- 172.21.15.22:0/133365917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d019dfe0 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8d61ff640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc031000 tx=0x7fb8cc032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc042070 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb8cc0325f0 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d019e270 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc037040 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.781+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d01a0f60 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb8cc045070 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8c77fe640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 0x7fb8bc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8cc06c0d0 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8d59fe640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 0x7fb8bc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d0106560 con 0x7fb8d0106160 2024-09-11T22:20:17.558 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.782+0000 7fb8d59fe640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 0x7fb8bc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098c0 tx=0x7fb8c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.787+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8cc042210 con 0x7fb8d0106160 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.976+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb8d0074c70 con 0x7fb8bc038f70 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.981+0000 7fb8c77fe640 1 -- 172.21.15.22:0/133365917 <== mgr.14118 v2:172.21.15.22:6800/3544100501 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb8d0074c70 con 0x7fb8bc038f70 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 msgr2=0x7fb8bc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 0x7fb8bc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098c0 tx=0x7fb8c0006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 msgr2=0x7fb8d019daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc031000 tx=0x7fb8cc032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 shutdown_connections 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fb8bc038f70 0x7fb8bc03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 --2- 172.21.15.22:0/133365917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8d0106160 0x7fb8d019daa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 >> 172.21.15.22:0/133365917 conn(0x7fb8d0101f30 msgr2=0x7fb8d0191dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.559 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 shutdown_connections 2024-09-11T22:20:17.560 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:16.984+0000 7fb8d8463640 1 -- 172.21.15.22:0/133365917 wait complete. 2024-09-11T22:20:18.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:17 smithi022 ceph-mon[30966]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:18.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:17 smithi022 ceph-mon[30966]: Saving service mgr spec with placement count:2 2024-09-11T22:20:18.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:17 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.940+0000 7f4c5202f640 1 Processor -- start 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.940+0000 7f4c5202f640 1 -- start start 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c5202f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c5202f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c107150 con 0x7f4c4c106780 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50676/0 (socket says 172.21.15.22:50676) 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c4b7fe640 1 -- 172.21.15.22:0/686307409 learned_addr learned my addr 172.21.15.22:0/686307409 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:18.823 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.941+0000 7f4c4b7fe640 1 -- 172.21.15.22:0/686307409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c107980 con 0x7f4c4c106780 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.942+0000 7f4c4b7fe640 1 --2- 172.21.15.22:0/686307409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009820 tx=0x7f4c3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1775b64c062fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.942+0000 7f4c4a7fc640 1 -- 172.21.15.22:0/686307409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c037070 con 0x7f4c4c106780 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.942+0000 7f4c4a7fc640 1 -- 172.21.15.22:0/686307409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4c3c032920 con 0x7f4c4c106780 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.942+0000 7f4c4a7fc640 1 -- 172.21.15.22:0/686307409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c030950 con 0x7f4c4c106780 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 -- 172.21.15.22:0/686307409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 msgr2=0x7f4c4c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 --2- 172.21.15.22:0/686307409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009820 tx=0x7f4c3c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 -- 172.21.15.22:0/686307409 shutdown_connections 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 --2- 172.21.15.22:0/686307409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c106b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 -- 172.21.15.22:0/686307409 >> 172.21.15.22:0/686307409 conn(0x7f4c4c102010 msgr2=0x7f4c4c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 -- 172.21.15.22:0/686307409 shutdown_connections 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 -- 172.21.15.22:0/686307409 wait complete. 2024-09-11T22:20:18.824 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.943+0000 7f4c5202f640 1 Processor -- start 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c5202f640 1 -- start start 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c5202f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c5202f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c10ad30 con 0x7f4c4c106780 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50690/0 (socket says 172.21.15.22:50690) 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c4b7fe640 1 -- 172.21.15.22:0/170540823 learned_addr learned my addr 172.21.15.22:0/170540823 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c4b7fe640 1 -- 172.21.15.22:0/170540823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c19be20 con 0x7f4c4c106780 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.944+0000 7f4c4b7fe640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0097f0 tx=0x7f4c3c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.945+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c037040 con 0x7f4c4c106780 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.945+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4c3c040070 con 0x7f4c4c106780 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.945+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c19c0b0 con 0x7f4c4c106780 2024-09-11T22:20:18.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.945+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c19eda0 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.945+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3c03a610 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4c3c03a840 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c106c00 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c48ff9640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 0x7f4c3403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c3c06c380 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c4affd640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 0x7f4c3403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.946+0000 7f4c4affd640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 0x7f4c3403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098c0 tx=0x7f4c40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.951+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c3c041270 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.129+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f4c4c02da40 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.131+0000 7f4c48ff9640 1 -- 172.21.15.22:0/170540823 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f4c3c045980 con 0x7f4c4c106780 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 msgr2=0x7f4c3403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 0x7f4c3403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098c0 tx=0x7f4c40006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 msgr2=0x7f4c4c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0097f0 tx=0x7f4c3c032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 shutdown_connections 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.133+0000 7f4c5202f640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4c34038fc0 0x7f4c3403b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.134+0000 7f4c5202f640 1 --2- 172.21.15.22:0/170540823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c4c106780 0x7f4c4c19b8e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.134+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 >> 172.21.15.22:0/170540823 conn(0x7f4c4c102010 msgr2=0x7f4c4c102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.134+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 shutdown_connections 2024-09-11T22:20:18.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:18.134+0000 7f4c5202f640 1 -- 172.21.15.22:0/170540823 wait complete. 2024-09-11T22:20:19.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:19 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/170540823' entity='client.admin' 2024-09-11T22:20:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.242+0000 7f405c287640 1 Processor -- start 2024-09-11T22:20:20.223 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.242+0000 7f405c287640 1 -- start start 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405c287640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405c287640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40540634d0 con 0x7f4054108330 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405a023640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405a023640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50694/0 (socket says 172.21.15.22:50694) 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405a023640 1 -- 172.21.15.22:0/1389328865 learned_addr learned my addr 172.21.15.22:0/1389328865 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.243+0000 7f405a023640 1 -- 172.21.15.22:0/1389328865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405410ac60 con 0x7f4054108330 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.244+0000 7f405a023640 1 --2- 172.21.15.22:0/1389328865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4050009820 tx=0x7f405002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ef3ec264471ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.244+0000 7f4059021640 1 -- 172.21.15.22:0/1389328865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050037070 con 0x7f4054108330 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.244+0000 7f4059021640 1 -- 172.21.15.22:0/1389328865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4050032920 con 0x7f4054108330 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.244+0000 7f4059021640 1 -- 172.21.15.22:0/1389328865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050030950 con 0x7f4054108330 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- 172.21.15.22:0/1389328865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 msgr2=0x7f405410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.224 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 --2- 172.21.15.22:0/1389328865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4050009820 tx=0x7f405002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- 172.21.15.22:0/1389328865 shutdown_connections 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 --2- 172.21.15.22:0/1389328865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f405410a720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- 172.21.15.22:0/1389328865 >> 172.21.15.22:0/1389328865 conn(0x7f4054101fd0 msgr2=0x7f40541043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- 172.21.15.22:0/1389328865 shutdown_connections 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- 172.21.15.22:0/1389328865 wait complete. 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 Processor -- start 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.245+0000 7f405c287640 1 -- start start 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405c287640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.225 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405c287640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f405410bd00 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405a023640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405a023640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50706/0 (socket says 172.21.15.22:50706) 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405a023640 1 -- 172.21.15.22:0/347836903 learned_addr learned my addr 172.21.15.22:0/347836903 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405a023640 1 -- 172.21.15.22:0/347836903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40541080f0 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405a023640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4050031000 tx=0x7f4050032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050042070 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f40500325f0 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40541062e0 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.246+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050037040 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.247+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4054106820 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.247+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4050045070 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.248+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4054108790 con 0x7f4054108330 2024-09-11T22:20:20.226 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.248+0000 7f404b7fe640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 0x7f404003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.248+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f405006c090 con 0x7f4054108330 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.248+0000 7f4059822640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 0x7f404003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.248+0000 7f4059822640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 0x7f404003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40440098c0 tx=0x7f4044006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.253+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f405003ce50 con 0x7f4054108330 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.430+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f4054106b60 con 0x7f4054108330 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.432+0000 7f404b7fe640 1 -- 172.21.15.22:0/347836903 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v7)=0 v7) ==== 130+0+0 (secure 0 0 0) 0x7f4054106b60 con 0x7f4054108330 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 msgr2=0x7f404003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 0x7f404003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40440098c0 tx=0x7f4044006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 msgr2=0x7f4054107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4050031000 tx=0x7f4050032e40 comp rx=0 tx=0).stop 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 shutdown_connections 2024-09-11T22:20:20.227 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7f4040038f70 0x7f404003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.228 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 --2- 172.21.15.22:0/347836903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4054108330 0x7f4054107bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.228 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 >> 172.21.15.22:0/347836903 conn(0x7f4054101fd0 msgr2=0x7f4054102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:20.228 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 shutdown_connections 2024-09-11T22:20:20.228 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:19.435+0000 7f405c287640 1 -- 172.21.15.22:0/347836903 wait complete. 2024-09-11T22:20:20.228 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-09-11T22:20:20.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:20 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/347836903' entity='client.admin' 2024-09-11T22:20:20.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:20 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:20.496 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:20 smithi022 ceph-mon[30966]: from='mgr.14118 172.21.15.22:0/311738302' entity='mgr.x' 2024-09-11T22:20:21.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1383739141' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T22:20:21.750 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setuser ceph since I am not root 2024-09-11T22:20:21.750 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setgroup ceph since I am not root 2024-09-11T22:20:21.750 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:21.596+0000 7fd6f8057040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:20:21.750 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:21.656+0000 7fd6f8057040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:22.049 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:21.820+0000 7fd6f8057040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:20:22.049 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:21.890+0000 7fd6f8057040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:20:22.049 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:22.048+0000 7fd6f8057040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda2a286640 1 Processor -- start 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda2a286640 1 -- start start 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda2a286640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda2a286640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda24063490 con 0x7fda24108370 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda23fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda23fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50710/0 (socket says 172.21.15.22:50710) 2024-09-11T22:20:22.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.691+0000 7fda23fff640 1 -- 172.21.15.22:0/3658845117 learned_addr learned my addr 172.21.15.22:0/3658845117 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.692+0000 7fda23fff640 1 -- 172.21.15.22:0/3658845117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2410aca0 con 0x7fda24108370 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.692+0000 7fda23fff640 1 --2- 172.21.15.22:0/3658845117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda14009820 tx=0x7fda1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84912666189d9f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.692+0000 7fda22ffd640 1 -- 172.21.15.22:0/3658845117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda14037070 con 0x7fda24108370 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.692+0000 7fda22ffd640 1 -- 172.21.15.22:0/3658845117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda14032940 con 0x7fda24108370 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.692+0000 7fda22ffd640 1 -- 172.21.15.22:0/3658845117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda140308b0 con 0x7fda24108370 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 -- 172.21.15.22:0/3658845117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 msgr2=0x7fda2410a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 --2- 172.21.15.22:0/3658845117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda14009820 tx=0x7fda1402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 -- 172.21.15.22:0/3658845117 shutdown_connections 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 --2- 172.21.15.22:0/3658845117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2410a760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 -- 172.21.15.22:0/3658845117 >> 172.21.15.22:0/3658845117 conn(0x7fda24101f30 msgr2=0x7fda24104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 -- 172.21.15.22:0/3658845117 shutdown_connections 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.693+0000 7fda2a286640 1 -- 172.21.15.22:0/3658845117 wait complete. 2024-09-11T22:20:22.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda2a286640 1 Processor -- start 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda2a286640 1 -- start start 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda2a286640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda2a286640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda2410bd20 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda23fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda23fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50722/0 (socket says 172.21.15.22:50722) 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.694+0000 7fda23fff640 1 -- 172.21.15.22:0/1383739141 learned_addr learned my addr 172.21.15.22:0/1383739141 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda23fff640 1 -- 172.21.15.22:0/1383739141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2419be80 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda23fff640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda140097f0 tx=0x7fda14032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda14037040 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2419c110 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda14040070 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda1403a520 con 0x7fda24108370 2024-09-11T22:20:22.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.695+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2419ee00 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.696+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fda1403a820 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.696+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda241087d0 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.696+0000 7fda217fa640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 0x7fda1003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.696+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fda1406c690 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.696+0000 7fda237fe640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 0x7fda1003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.697+0000 7fda237fe640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 0x7fda1003b3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098c0 tx=0x7fda0c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.701+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda14044c70 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.936+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fda2419efd0 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.435+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fda1404a200 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.436+0000 7fda217fa640 1 -- 172.21.15.22:0/1383739141 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fda14045980 con 0x7fda24108370 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 msgr2=0x7fda1003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 0x7fda1003b3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0098c0 tx=0x7fda0c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 msgr2=0x7fda2419b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda140097f0 tx=0x7fda14032e60 comp rx=0 tx=0).stop 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 shutdown_connections 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fda10038f20 0x7fda1003b3e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 --2- 172.21.15.22:0/1383739141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda24108370 0x7fda2419b940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 >> 172.21.15.22:0/1383739141 conn(0x7fda24101f30 msgr2=0x7fda24102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 shutdown_connections 2024-09-11T22:20:22.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.438+0000 7fda2a286640 1 -- 172.21.15.22:0/1383739141 wait complete. 2024-09-11T22:20:22.317 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:22.205+0000 7fd6f8057040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:20:22.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1383739141' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T22:20:22.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-mon[30966]: mgrmap e9: x(active, since 18s) 2024-09-11T22:20:22.613 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:22.547+0000 7fd6f8057040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:20:22.613 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:22.611+0000 7fd6f8057040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:20:22.901 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:22.811+0000 7fd6f8057040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:20:23.334 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:23.334 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.504+0000 7fe7111dd640 1 Processor -- start 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.504+0000 7fe7111dd640 1 -- start start 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.504+0000 7fe7111dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.504+0000 7fe7111dd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c063510 con 0x7fe70c1082f0 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.505+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.505+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50738/0 (socket says 172.21.15.22:50738) 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.505+0000 7fe70ad9d640 1 -- 172.21.15.22:0/2129052666 learned_addr learned my addr 172.21.15.22:0/2129052666 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:23.335 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.505+0000 7fe70ad9d640 1 -- 172.21.15.22:0/2129052666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c10ac20 con 0x7fe70c1082f0 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe70ad9d640 1 --2- 172.21.15.22:0/2129052666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009820 tx=0x7fe6fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aec0602ef66f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe709d9b640 1 -- 172.21.15.22:0/2129052666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6fc037070 con 0x7fe70c1082f0 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe709d9b640 1 -- 172.21.15.22:0/2129052666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6fc032940 con 0x7fe70c1082f0 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe709d9b640 1 -- 172.21.15.22:0/2129052666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6fc0308b0 con 0x7fe70c1082f0 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe7111dd640 1 -- 172.21.15.22:0/2129052666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 msgr2=0x7fe70c10a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.506+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2129052666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009820 tx=0x7fe6fc02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 -- 172.21.15.22:0/2129052666 shutdown_connections 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2129052666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c10a6e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 -- 172.21.15.22:0/2129052666 >> 172.21.15.22:0/2129052666 conn(0x7fe70c102010 msgr2=0x7fe70c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 -- 172.21.15.22:0/2129052666 shutdown_connections 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 -- 172.21.15.22:0/2129052666 wait complete. 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.507+0000 7fe7111dd640 1 Processor -- start 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe7111dd640 1 -- start start 2024-09-11T22:20:23.336 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe7111dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.337 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe7111dd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c10bd60 con 0x7fe70c1082f0 2024-09-11T22:20:23.337 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.337 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe70ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50750/0 (socket says 172.21.15.22:50750) 2024-09-11T22:20:23.337 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe70ad9d640 1 -- 172.21.15.22:0/2473716093 learned_addr learned my addr 172.21.15.22:0/2473716093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:23.337 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe70ad9d640 1 -- 172.21.15.22:0/2473716093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c19bf00 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.508+0000 7fe70ad9d640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc032670 tx=0x7fe6fc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.509+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6fc042070 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.509+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6fc03d930 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.509+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c19c190 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.509+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6fc037040 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.509+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c19ee80 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70c19c670 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe6fc045070 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe6f3fff640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 0x7fe6f403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe6fc06c1d0 con 0x7fe70c1082f0 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe70a59c640 1 -- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 msgr2=0x7fe6f403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.510+0000 7fe70a59c640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 0x7fe6f403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.515+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe70c19c670 con 0x7fe70c1082f0 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.711+0000 7fe70a59c640 1 -- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 msgr2=0x7fe6f403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.711+0000 7fe70a59c640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 0x7fe6f403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.740+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe70c19f4f0 con 0x7fe70c1082f0 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.740+0000 7fe6f3fff640 1 -- 172.21.15.22:0/2473716093 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe6fc03ce10 con 0x7fe70c1082f0 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 msgr2=0x7fe6f403b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 0x7fe6f403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 msgr2=0x7fe70c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc032670 tx=0x7fe6fc0326a0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 shutdown_connections 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7fe6f4039020 0x7fe6f403b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 --2- 172.21.15.22:0/2473716093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe70c1082f0 0x7fe70c19b9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.339 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 >> 172.21.15.22:0/2473716093 conn(0x7fe70c102010 msgr2=0x7fe70c102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.340 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 shutdown_connections 2024-09-11T22:20:23.340 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.743+0000 7fe7111dd640 1 -- 172.21.15.22:0/2473716093 wait complete. 2024-09-11T22:20:23.340 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-11T22:20:23.340 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-09-11T22:20:23.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:23 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2473716093' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T22:20:23.901 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:23.752+0000 7fd6f8057040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:20:23.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:23.822+0000 7fd6f8057040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:20:24.652 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:24.567+0000 7fd6f8057040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:20:25.055 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:24.687+0000 7fd6f8057040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:20:25.055 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:24.835+0000 7fd6f8057040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:25.055 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:24.899+0000 7fd6f8057040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:20:25.055 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.054+0000 7fd6f8057040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:20:25.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.125+0000 7fd6f8057040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:20:25.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.188+0000 7fd6f8057040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:20:25.354 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.353+0000 7fd6f8057040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:20:25.639 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.421+0000 7fd6f8057040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:20:25.639 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.490+0000 7fd6f8057040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:20:25.639 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.576+0000 7fd6f8057040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:25.639 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.638+0000 7fd6f8057040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:20:25.901 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:25.699+0000 7fd6f8057040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:20:26.777 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:26.524+0000 7fd6f8057040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: Active manager daemon x restarted 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: Activating manager daemon x 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: mgrmap e10: x(active, starting, since 0.00329873s) 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: Manager daemon x is now available 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:20:26.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94f9a9640 1 Processor -- start 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94f9a9640 1 -- start start 2024-09-11T22:20:28.388 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94f9a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94f9a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff948107260 con 0x7ff948106890 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50754/0 (socket says 172.21.15.22:50754) 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.718+0000 7ff94d745640 1 -- 172.21.15.22:0/2247170936 learned_addr learned my addr 172.21.15.22:0/2247170936 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.719+0000 7ff94d745640 1 -- 172.21.15.22:0/2247170936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff948107a90 con 0x7ff948106890 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.719+0000 7ff94d745640 1 --2- 172.21.15.22:0/2247170936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff944009820 tx=0x7ff94402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a180f7b5ae315ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff93ffff640 1 -- 172.21.15.22:0/2247170936 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff944037070 con 0x7ff948106890 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff93ffff640 1 -- 172.21.15.22:0/2247170936 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff944032940 con 0x7ff948106890 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff93ffff640 1 -- 172.21.15.22:0/2247170936 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9440308b0 con 0x7ff948106890 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 -- 172.21.15.22:0/2247170936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 msgr2=0x7ff948106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.389 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/2247170936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff944009820 tx=0x7ff94402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 -- 172.21.15.22:0/2247170936 shutdown_connections 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/2247170936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff948106c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 -- 172.21.15.22:0/2247170936 >> 172.21.15.22:0/2247170936 conn(0x7ff948102000 msgr2=0x7ff948104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 -- 172.21.15.22:0/2247170936 shutdown_connections 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.720+0000 7ff94f9a9640 1 -- 172.21.15.22:0/2247170936 wait complete. 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94f9a9640 1 Processor -- start 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94f9a9640 1 -- start start 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94f9a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94f9a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff94810ae40 con 0x7ff948106890 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94d745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50760/0 (socket says 172.21.15.22:50760) 2024-09-11T22:20:28.390 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.721+0000 7ff94d745640 1 -- 172.21.15.22:0/3842953267 learned_addr learned my addr 172.21.15.22:0/3842953267 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff94d745640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94819bfb0 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff94d745640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff944009940 tx=0x7ff944032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff944042070 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff94403d930 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94819c240 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff944037040 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.722+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94819ef30 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff944045070 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff93e7fc640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff93403bb90 con 0x7ff934038fc0 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff94406c1c0 con 0x7ff948106890 2024-09-11T22:20:28.391 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff94cf44640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 msgr2=0x7ff93403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.723+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.924+0000 7ff94cf44640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 msgr2=0x7ff93403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.924+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.325+0000 7ff94cf44640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 msgr2=0x7ff93403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.325+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.126+0000 7ff94cf44640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 msgr2=0x7ff93403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3544100501 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.126+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.528+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ff94406ac70 con 0x7ff948106890 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.528+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 msgr2=0x7ff93403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.528+0000 7ff93e7fc640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.529+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff944042d00 con 0x7ff948106890 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.529+0000 7ff93e7fc640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 0x7ff93403ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:28.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.530+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff944006810 con 0x7ff93403ca80 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.530+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 0x7ff93403ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.531+0000 7ff94cf44640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 0x7ff93403ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff938003980 tx=0x7ff938006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.532+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff944006810 con 0x7ff93403ca80 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff94819c720 con 0x7ff93403ca80 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff93e7fc640 1 -- 172.21.15.22:0/3842953267 <== mgr.14150 v2:172.21.15.22:6800/3117763107 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff94819c720 con 0x7ff93403ca80 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 msgr2=0x7ff93403ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 0x7ff93403ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff938003980 tx=0x7ff938006e10 comp rx=0 tx=0).stop 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 msgr2=0x7ff94819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff944009940 tx=0x7ff944032670 comp rx=0 tx=0).stop 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 shutdown_connections 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff93403ca80 0x7ff93403ee70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:6800/3544100501,v1:172.21.15.22:6801/3544100501] conn(0x7ff934038fc0 0x7ff93403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 --2- 172.21.15.22:0/3842953267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff948106890 0x7ff94819ba70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 >> 172.21.15.22:0/3842953267 conn(0x7ff948102000 msgr2=0x7ff948102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 shutdown_connections 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.539+0000 7ff94f9a9640 1 -- 172.21.15.22:0/3842953267 wait complete. 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-09-11T22:20:28.394 INFO:teuthology.orchestra.run.smithi022.stdout:Generating a dashboard self-signed certificate... 2024-09-11T22:20:28.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:28 smithi022 ceph-mon[30966]: mgrmap e11: x(active, since 1.00566s) 2024-09-11T22:20:28.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:28 smithi022 ceph-mon[30966]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T22:20:28.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:28 smithi022 ceph-mon[30966]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T22:20:28.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:29.166+0000 7fd6631ab640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:20:29] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Traceback (most recent call last): 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._connections.run(self.expiration_interval) 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._run(expiration_interval) 2024-09-11T22:20:29.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s = self.context.wrap_socket( 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: return self.sslsocket_class._create( 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self.do_handshake() 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._sslobj.do_handshake() 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:29.403 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.821+0000 7f4946d59640 1 Processor -- start 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.821+0000 7f4946d59640 1 -- start start 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.821+0000 7f4946d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.822+0000 7f4946d59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4940108270 con 0x7f49401078a0 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.822+0000 7f4944af5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.822+0000 7f4944af5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35348/0 (socket says 172.21.15.22:35348) 2024-09-11T22:20:29.617 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.822+0000 7f4944af5640 1 -- 172.21.15.22:0/2296270332 learned_addr learned my addr 172.21.15.22:0/2296270332 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.822+0000 7f4944af5640 1 -- 172.21.15.22:0/2296270332 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4940108aa0 con 0x7f49401078a0 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.823+0000 7f4944af5640 1 --2- 172.21.15.22:0/2296270332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4934009820 tx=0x7f493402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc49ea1ae058fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.823+0000 7f493f7fe640 1 -- 172.21.15.22:0/2296270332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4934037070 con 0x7f49401078a0 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.823+0000 7f493f7fe640 1 -- 172.21.15.22:0/2296270332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4934032940 con 0x7f49401078a0 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.823+0000 7f493f7fe640 1 -- 172.21.15.22:0/2296270332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49340308b0 con 0x7f49401078a0 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 -- 172.21.15.22:0/2296270332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 msgr2=0x7f4940107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 --2- 172.21.15.22:0/2296270332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4934009820 tx=0x7f493402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 -- 172.21.15.22:0/2296270332 shutdown_connections 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 --2- 172.21.15.22:0/2296270332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f4940107ca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 -- 172.21.15.22:0/2296270332 >> 172.21.15.22:0/2296270332 conn(0x7f4940103050 msgr2=0x7f4940105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 -- 172.21.15.22:0/2296270332 shutdown_connections 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.824+0000 7f4946d59640 1 -- 172.21.15.22:0/2296270332 wait complete. 2024-09-11T22:20:29.618 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4946d59640 1 Processor -- start 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4946d59640 1 -- start start 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4946d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4946d59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f494010be50 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4944af5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4944af5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35358/0 (socket says 172.21.15.22:35358) 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4944af5640 1 -- 172.21.15.22:0/1602231910 learned_addr learned my addr 172.21.15.22:0/1602231910 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4944af5640 1 -- 172.21.15.22:0/1602231910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494019bec0 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.825+0000 7f4944af5640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49340097f0 tx=0x7f4934032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.826+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4934037040 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.826+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494019c150 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.826+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4934040070 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.826+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f493403a520 con 0x7f49401078a0 2024-09-11T22:20:29.619 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.826+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494019ee40 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.827+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f493403a7d0 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.827+0000 7f493dffb640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 0x7f493003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.827+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4940107d20 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.827+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f493406c550 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.827+0000 7f493ffff640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 0x7f493003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.828+0000 7f493ffff640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 0x7f493003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:28.832+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4934044c70 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.017+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4940104340 con 0x7f4930038eb0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.030+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f493402fd60 con 0x7f49401078a0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.111+0000 7f493dffb640 1 -- 172.21.15.22:0/1602231910 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4940104340 con 0x7f4930038eb0 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.113+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 msgr2=0x7f493003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.113+0000 7f4946d59640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 0x7f493003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 msgr2=0x7f494019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49340097f0 tx=0x7f4934032e60 comp rx=0 tx=0).stop 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 shutdown_connections 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4930038eb0 0x7f493003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 --2- 172.21.15.22:0/1602231910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49401078a0 0x7f494019b980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 >> 172.21.15.22:0/1602231910 conn(0x7f4940103050 msgr2=0x7f4940103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 shutdown_connections 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.114+0000 7f4946d59640 1 -- 172.21.15.22:0/1602231910 wait complete. 2024-09-11T22:20:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-09-11T22:20:30.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: mgrmap e12: x(active, since 2s) 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:29] ENGINE Bus STARTING 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:29] ENGINE Serving on https://172.21.15.22:7150 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:29] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-11T22:20:30.048 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-11T22:20:30.049 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:30.050 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-11T22:20:30.050 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:30.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:29] ENGINE Serving on http://172.21.15.22:8765 2024-09-11T22:20:30.050 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:29 smithi022 ceph-mon[30966]: [11/Sep/2024:22:20:29] ENGINE Bus STARTED 2024-09-11T22:20:31.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:30 smithi022 ceph-mon[30966]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:31.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:31.462 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$XzyX7lq8oqrhQi5dnPj7n.P37Im3TIKGfImWFAKP2xEeL891mQjLa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726093230, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.056+0000 7f134b883640 1 Processor -- start 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.056+0000 7f134b883640 1 -- start start 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134b883640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134b883640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13440634b0 con 0x7f1344106140 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134961f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134961f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35368/0 (socket says 172.21.15.22:35368) 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134961f640 1 -- 172.21.15.22:0/2257892047 learned_addr learned my addr 172.21.15.22:0/2257892047 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.057+0000 7f134961f640 1 -- 172.21.15.22:0/2257892047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1344106a80 con 0x7f1344106140 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.058+0000 7f134961f640 1 --2- 172.21.15.22:0/2257892047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1334009e80 tx=0x7f133402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70fd1cb62f03e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.058+0000 7f1343fff640 1 -- 172.21.15.22:0/2257892047 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1334036070 con 0x7f1344106140 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.058+0000 7f1343fff640 1 -- 172.21.15.22:0/2257892047 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1334031900 con 0x7f1344106140 2024-09-11T22:20:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.058+0000 7f1343fff640 1 -- 172.21.15.22:0/2257892047 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1334007ab0 con 0x7f1344106140 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 -- 172.21.15.22:0/2257892047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 msgr2=0x7f1344106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 --2- 172.21.15.22:0/2257892047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1334009e80 tx=0x7f133402a7a0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 -- 172.21.15.22:0/2257892047 shutdown_connections 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 --2- 172.21.15.22:0/2257892047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f1344106540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 -- 172.21.15.22:0/2257892047 >> 172.21.15.22:0/2257892047 conn(0x7f1344102010 msgr2=0x7f1344104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 -- 172.21.15.22:0/2257892047 shutdown_connections 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 -- 172.21.15.22:0/2257892047 wait complete. 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.059+0000 7f134b883640 1 Processor -- start 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134b883640 1 -- start start 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134b883640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134b883640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1344107c20 con 0x7f1344106140 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134961f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.464 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134961f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35384/0 (socket says 172.21.15.22:35384) 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134961f640 1 -- 172.21.15.22:0/785551360 learned_addr learned my addr 172.21.15.22:0/785551360 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134961f640 1 -- 172.21.15.22:0/785551360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134419e050 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.060+0000 7f134961f640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1334031ce0 tx=0x7f1334031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.061+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1334036050 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.061+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1334042070 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.061+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f133403d9c0 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.061+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134419e2e0 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.061+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13441a0fd0 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f133403dcc0 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f13427fc640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 0x7f132c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1334007e00 con 0x7f1344106140 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f1348e1e640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 0x7f132c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1344106540 con 0x7f1344106140 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.062+0000 7f1348e1e640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 0x7f132c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13380098c0 tx=0x7f1338006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.067+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f133403bd30 con 0x7f1344106140 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.276+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f1344195890 con 0x7f132c038fc0 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.525+0000 7f13427fc640 1 -- 172.21.15.22:0/785551360 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f1344195890 con 0x7f132c038fc0 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 msgr2=0x7f132c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 0x7f132c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13380098c0 tx=0x7f1338006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 msgr2=0x7f134419db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1334031ce0 tx=0x7f1334031d10 comp rx=0 tx=0).stop 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 shutdown_connections 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f132c038fc0 0x7f132c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 --2- 172.21.15.22:0/785551360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1344106140 0x7f134419db10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 >> 172.21.15.22:0/785551360 conn(0x7f1344102010 msgr2=0x7f1344191cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 shutdown_connections 2024-09-11T22:20:31.467 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.528+0000 7f134b883640 1 -- 172.21.15.22:0/785551360 wait complete. 2024-09-11T22:20:31.467 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-09-11T22:20:32.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:32 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2075617156' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T22:20:32.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T22:20:32.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf99d8640 1 Processor -- start 2024-09-11T22:20:32.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf99d8640 1 -- start start 2024-09-11T22:20:32.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf99d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf99d8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40634d0 con 0x7f6bf4108330 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35400/0 (socket says 172.21.15.22:35400) 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.880+0000 7f6bf2ffd640 1 -- 172.21.15.22:0/880723642 learned_addr learned my addr 172.21.15.22:0/880723642 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.881+0000 7f6bf2ffd640 1 -- 172.21.15.22:0/880723642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf410ac60 con 0x7f6bf4108330 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.881+0000 7f6bf2ffd640 1 --2- 172.21.15.22:0/880723642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009820 tx=0x7f6be402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4888c9b976c58d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.881+0000 7f6bf1ffb640 1 -- 172.21.15.22:0/880723642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be4037070 con 0x7f6bf4108330 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.881+0000 7f6bf1ffb640 1 -- 172.21.15.22:0/880723642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6be4032940 con 0x7f6bf4108330 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.881+0000 7f6bf1ffb640 1 -- 172.21.15.22:0/880723642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be40308b0 con 0x7f6bf4108330 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 -- 172.21.15.22:0/880723642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 msgr2=0x7f6bf410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/880723642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009820 tx=0x7f6be402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 -- 172.21.15.22:0/880723642 shutdown_connections 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/880723642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf410a720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 -- 172.21.15.22:0/880723642 >> 172.21.15.22:0/880723642 conn(0x7f6bf4102010 msgr2=0x7f6bf4104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 -- 172.21.15.22:0/880723642 shutdown_connections 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.882+0000 7f6bf99d8640 1 -- 172.21.15.22:0/880723642 wait complete. 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf99d8640 1 Processor -- start 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf99d8640 1 -- start start 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf99d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf99d8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf410bd40 con 0x7f6bf4108330 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35408/0 (socket says 172.21.15.22:35408) 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf2ffd640 1 -- 172.21.15.22:0/2075617156 learned_addr learned my addr 172.21.15.22:0/2075617156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.883+0000 7f6bf2ffd640 1 -- 172.21.15.22:0/2075617156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf419be70 con 0x7f6bf4108330 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf2ffd640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6be4032670 tx=0x7f6be40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be4042070 con 0x7f6bf4108330 2024-09-11T22:20:32.799 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf419c100 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6be403d930 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be4037040 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.884+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf419edf0 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f6be4045070 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf4108790 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf89d6640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 0x7f6bdc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6be406c420 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf27fc640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 0x7f6bdc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.885+0000 7f6bf27fc640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 0x7f6bdc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6be80098c0 tx=0x7f6be8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:31.890+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6be4045760 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.066+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f6bf419f3e0 con 0x7f6bf4108330 2024-09-11T22:20:32.800 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.066+0000 7f6bf89d6640 1 -- 172.21.15.22:0/2075617156 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f6be40463b0 con 0x7f6bf4108330 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 msgr2=0x7f6bdc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 0x7f6bdc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6be80098c0 tx=0x7f6be8006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 msgr2=0x7f6bf419b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6be4032670 tx=0x7f6be40326a0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 shutdown_connections 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6bdc038fc0 0x7f6bdc03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 --2- 172.21.15.22:0/2075617156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bf4108330 0x7f6bf419b930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 >> 172.21.15.22:0/2075617156 conn(0x7f6bf4102010 msgr2=0x7f6bf4102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 shutdown_connections 2024-09-11T22:20:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.069+0000 7f6bf99d8640 1 -- 172.21.15.22:0/2075617156 wait complete. 2024-09-11T22:20:32.807 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:20:32.807 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-11T22:20:32.816 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:20:32.816 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-11T22:20:32.816 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-11T22:20:32.816 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi022.stdout: Password: wsk00xa3mj 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config directory 2024-09-11T22:20:34.087 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b2e0c9640 1 Processor -- start 2024-09-11T22:20:34.087 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b2e0c9640 1 -- start start 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b2e0c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b2e0c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b28108270 con 0x7f9b281078a0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35420/0 (socket says 172.21.15.22:35420) 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.236+0000 7f9b277fe640 1 -- 172.21.15.22:0/1542396388 learned_addr learned my addr 172.21.15.22:0/1542396388 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.237+0000 7f9b277fe640 1 -- 172.21.15.22:0/1542396388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28108aa0 con 0x7f9b281078a0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.237+0000 7f9b277fe640 1 --2- 172.21.15.22:0/1542396388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009820 tx=0x7f9b1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58b55f7c7478919 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.237+0000 7f9b267fc640 1 -- 172.21.15.22:0/1542396388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b18037070 con 0x7f9b281078a0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.237+0000 7f9b267fc640 1 -- 172.21.15.22:0/1542396388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b18032940 con 0x7f9b281078a0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b267fc640 1 -- 172.21.15.22:0/1542396388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b180308b0 con 0x7f9b281078a0 2024-09-11T22:20:34.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/1542396388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 msgr2=0x7f9b28107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/1542396388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009820 tx=0x7f9b1802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/1542396388 shutdown_connections 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/1542396388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b28107ca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/1542396388 >> 172.21.15.22:0/1542396388 conn(0x7f9b28103050 msgr2=0x7f9b28105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/1542396388 shutdown_connections 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.238+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/1542396388 wait complete. 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b2e0c9640 1 Processor -- start 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b2e0c9640 1 -- start start 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b2e0c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b2e0c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2810be50 con 0x7f9b281078a0 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35432/0 (socket says 172.21.15.22:35432) 2024-09-11T22:20:34.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.239+0000 7f9b277fe640 1 -- 172.21.15.22:0/945707812 learned_addr learned my addr 172.21.15.22:0/945707812 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b277fe640 1 -- 172.21.15.22:0/945707812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2819bec0 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b277fe640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097f0 tx=0x7f9b18032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b18037040 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b18040070 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2819c150 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1803a520 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.240+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2819ee40 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.241+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9b1803b430 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.241+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b28107d20 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.241+0000 7f9b24ff9640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 0x7f9b1003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.241+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9b1806c7f0 con 0x7f9b281078a0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.241+0000 7f9b26ffd640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 0x7f9b1003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.242+0000 7f9b26ffd640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 0x7f9b1003b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0098c0 tx=0x7f9b1c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.246+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b18042740 con 0x7f9b281078a0 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.514+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9b2819f010 con 0x7f9b281078a0 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.517+0000 7f9b24ff9640 1 -- 172.21.15.22:0/945707812 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f9b2819f010 con 0x7f9b281078a0 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 msgr2=0x7f9b1003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 0x7f9b1003b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0098c0 tx=0x7f9b1c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 msgr2=0x7f9b2819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097f0 tx=0x7f9b18032e60 comp rx=0 tx=0).stop 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 shutdown_connections 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9b10039060 0x7f9b1003b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 --2- 172.21.15.22:0/945707812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b281078a0 0x7f9b2819b980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 >> 172.21.15.22:0/945707812 conn(0x7f9b28103050 msgr2=0x7f9b28103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 shutdown_connections 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.519+0000 7f9b2e0c9640 1 -- 172.21.15.22:0/945707812 wait complete. 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-09-11T22:20:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.093 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T22:20:34.093 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:34.093 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-09-11T22:20:34.131 INFO:tasks.cephadm:Fetching config... 2024-09-11T22:20:34.131 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:20:34.131 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T22:20:34.148 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T22:20:34.148 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:20:34.148 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T22:20:34.204 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T22:20:34.205 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:20:34.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T22:20:34.270 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T22:20:34.270 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:20:34.270 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T22:20:34.327 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T22:20:34.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:20:34.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:34 smithi022 ceph-mon[30966]: mgrmap e13: x(active, since 6s) 2024-09-11T22:20:34.361 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:34 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/945707812' entity='client.admin' 2024-09-11T22:20:34.397 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:34.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:20:34.453 INFO:teuthology.orchestra.run.smithi045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:34.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:20:34.508 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr//dX3QRl07Hb2jcF7N3PUkI2bsNzySOPeE01vmWIKwjATxrYUuOf5xIvwxx3EX30pkGRBpY7fVKWGjZWEoKzlPLLECG4xhQrlfyalznu/rSiNqnPZVzUw3Cc9MP89weB+dpX8s+rXZEBxMwjhJjQFGBdOG2Lxta5MsvgwzS2sTxL0RgmsosGLKOp1KE3Q2DE13/Gg/pYT4l1SnjAB/O8K1Pv/DVbSOcwxiuBjB0CxE+RVJ1NwM8wnbEmoAjXowoaOlHB6yv8Ci/vWfv2YUElA7QF4oLY97a9aquU3cRMMd0cAmV6Bhz8cbkDQamfNU2O6I3QB91grU2O3C5dBEiuNeKEPyP2C+SzhWuiEWuDUvqkCgRpVBo3ZlLcKcJ7n7LCue+HCtZStK6Wr5R+fAPw3U2F2EHAIMjLo4i9vFGqMdqmPrpnV2UN+s1CDqZEe1riqyYdHg9wiWJxm05kokTXVfyzRYEa7bby14TOIXWUeyftmtM8bBsdwxMb4+Ny3WE= ceph-c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:34.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T22:20:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.242+0000 7f86c3246640 1 -- 172.21.15.22:0/2843645120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 msgr2=0x7f86bc104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.242+0000 7f86c3246640 1 --2- 172.21.15.22:0/2843645120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc104520 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009880 tx=0x7f86b002a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.242+0000 7f86c3246640 1 -- 172.21.15.22:0/2843645120 shutdown_connections 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.242+0000 7f86c3246640 1 --2- 172.21.15.22:0/2843645120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc104520 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.242+0000 7f86c3246640 1 -- 172.21.15.22:0/2843645120 >> 172.21.15.22:0/2843645120 conn(0x7f86bc0fbcd0 msgr2=0x7f86bc0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 -- 172.21.15.22:0/2843645120 shutdown_connections 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 -- 172.21.15.22:0/2843645120 wait complete. 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 Processor -- start 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 -- start start 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c3246640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc107820 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c0fe2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c0fe2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35386/0 (socket says 172.21.15.22:35386) 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.243+0000 7f86c0fe2640 1 -- 172.21.15.22:0/2941600743 learned_addr learned my addr 172.21.15.22:0/2941600743 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86c0fe2640 1 -- 172.21.15.22:0/2941600743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc197370 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86c0fe2640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86b00099a0 tx=0x7f86b0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86b003f030 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86b0003d00 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc197600 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86b0035070 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.244+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc19a2f0 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.245+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f86b0042030 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.245+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc107fa0 con 0x7f86bc102130 2024-09-11T22:20:35.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.246+0000 7f86b9ffb640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 0x7f86ac03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.246+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f86b0040070 con 0x7f86bc102130 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.246+0000 7f86bbfff640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 0x7f86ac03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.246+0000 7f86bbfff640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 0x7f86ac03b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098c0 tx=0x7f86a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.250+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86b004c350 con 0x7f86bc102130 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.427+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f86bc02d830 con 0x7f86bc102130 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.430+0000 7f86b9ffb640 1 -- 172.21.15.22:0/2941600743 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f86b002fdc0 con 0x7f86bc102130 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 msgr2=0x7f86ac03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 0x7f86ac03b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098c0 tx=0x7f86a8006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 msgr2=0x7f86bc196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86b00099a0 tx=0x7f86b0032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 shutdown_connections 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f86ac039060 0x7f86ac03b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 --2- 172.21.15.22:0/2941600743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86bc102130 0x7f86bc196e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 >> 172.21.15.22:0/2941600743 conn(0x7f86bc0fbcd0 msgr2=0x7f86bc0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.432+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 shutdown_connections 2024-09-11T22:20:35.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:35.433+0000 7f86c3246640 1 -- 172.21.15.22:0/2941600743 wait complete. 2024-09-11T22:20:36.096 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T22:20:36.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T22:20:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:36 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2941600743' entity='client.admin' 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 -- 172.21.15.22:0/2831248257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 msgr2=0x7f7ed80ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/2831248257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed80ffcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009880 tx=0x7f7ed402a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 -- 172.21.15.22:0/2831248257 shutdown_connections 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/2831248257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed80ffcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 -- 172.21.15.22:0/2831248257 >> 172.21.15.22:0/2831248257 conn(0x7f7ed80fb400 msgr2=0x7f7ed80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 -- 172.21.15.22:0/2831248257 shutdown_connections 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.018+0000 7f7ee05b1640 1 -- 172.21.15.22:0/2831248257 wait complete. 2024-09-11T22:20:37.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ee05b1640 1 Processor -- start 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ee05b1640 1 -- start start 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ee05b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ee05b1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8107870 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ede34d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ede34d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35412/0 (socket says 172.21.15.22:35412) 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.019+0000 7f7ede34d640 1 -- 172.21.15.22:0/965228804 learned_addr learned my addr 172.21.15.22:0/965228804 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ede34d640 1 -- 172.21.15.22:0/965228804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed8102670 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ede34d640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009230 tx=0x7f7ed4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ed403f030 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ed4003e30 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed8100860 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ed4035070 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.020+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed8100da0 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.021+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7ed4042030 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.021+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed8107ff0 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.021+0000 7f7ecf7fe640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 0x7f7ec403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.021+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7ed4040070 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.021+0000 7f7eddb4c640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 0x7f7ec403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.022+0000 7f7eddb4c640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 0x7f7ec403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80098c0 tx=0x7f7ec8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.026+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ed404c350 con 0x7f7ed80ff8d0 2024-09-11T22:20:37.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.205+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7ed8190310 con 0x7f7ec4039060 2024-09-11T22:20:37.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.208+0000 7f7ecf7fe640 1 -- 172.21.15.22:0/965228804 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7ed8190310 con 0x7f7ec4039060 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 msgr2=0x7f7ec403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 0x7f7ec403b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80098c0 tx=0x7f7ec8006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 msgr2=0x7f7ed8102130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009230 tx=0x7f7ed4032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 shutdown_connections 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7ec4039060 0x7f7ec403b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 --2- 172.21.15.22:0/965228804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed80ff8d0 0x7f7ed8102130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 >> 172.21.15.22:0/965228804 conn(0x7f7ed80fb400 msgr2=0x7f7ed80fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 shutdown_connections 2024-09-11T22:20:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:37.210+0000 7f7ee05b1640 1 -- 172.21.15.22:0/965228804 wait complete. 2024-09-11T22:20:37.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-11T22:20:37.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:37 smithi022 ceph-mon[30966]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:20:38.002 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi045 2024-09-11T22:20:38.003 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:20:38.003 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/etc/ceph/ceph.conf 2024-09-11T22:20:38.022 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:20:38.022 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:38.080 INFO:tasks.cephadm:Adding host smithi045 to orchestrator... 2024-09-11T22:20:38.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch host add smithi045 2024-09-11T22:20:38.334 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 -- 172.21.15.22:0/78382271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 msgr2=0x7f1224107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 --2- 172.21.15.22:0/78382271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1214009880 tx=0x7f121402a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 -- 172.21.15.22:0/78382271 shutdown_connections 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 --2- 172.21.15.22:0/78382271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 -- 172.21.15.22:0/78382271 >> 172.21.15.22:0/78382271 conn(0x7f12240fd290 msgr2=0x7f12240ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 -- 172.21.15.22:0/78382271 shutdown_connections 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.750+0000 7f1229ed2640 1 -- 172.21.15.22:0/78382271 wait complete. 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.751+0000 7f1229ed2640 1 Processor -- start 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.751+0000 7f1229ed2640 1 -- start start 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f1229ed2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f1229ed2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f122410bdd0 con 0x7f1224107660 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35416/0 (socket says 172.21.15.22:35416) 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12237fe640 1 -- 172.21.15.22:0/1287849127 learned_addr learned my addr 172.21.15.22:0/1287849127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12237fe640 1 -- 172.21.15.22:0/1287849127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1224197740 con 0x7f1224107660 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12237fe640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1214009230 tx=0x7f1214003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.752+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f121403f070 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12241979d0 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1214031d50 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1214035030 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122419bad0 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1214042070 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.753+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1224102cd0 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.754+0000 7f12217fa640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 0x7f121003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.754+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f121406cee0 con 0x7f1224107660 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.754+0000 7f121affd640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 0x7f121003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.754+0000 7f121affd640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 0x7f121003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f120c0098c0 tx=0x7f120c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.759+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1214039350 con 0x7f1224107660 2024-09-11T22:20:38.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:38.936+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi045", "target": ["mon-mgr", ""]}) -- 0x7f1224107ac0 con 0x7f1210039060 2024-09-11T22:20:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:39 smithi022 ceph-mon[30966]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:39 smithi022 ceph-mon[30966]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:20:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:40.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:40 smithi022 ceph-mon[30966]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi045", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:41.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:41 smithi022 ceph-mon[30966]: Deploying cephadm binary to smithi045 2024-09-11T22:20:42.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.838+0000 7f12217fa640 1 -- 172.21.15.22:0/1287849127 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f1224107ac0 con 0x7f1210039060 2024-09-11T22:20:42.839 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi045' with addr '172.21.15.45' 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 msgr2=0x7f121003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 0x7f121003b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f120c0098c0 tx=0x7f120c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 msgr2=0x7f1224197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1214009230 tx=0x7f1214003cb0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 shutdown_connections 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1210039060 0x7f121003b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 --2- 172.21.15.22:0/1287849127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1224107660 0x7f1224197200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.840+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 >> 172.21.15.22:0/1287849127 conn(0x7f12240fd290 msgr2=0x7f12240feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.841+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 shutdown_connections 2024-09-11T22:20:42.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:42.841+0000 7f1229ed2640 1 -- 172.21.15.22:0/1287849127 wait complete. 2024-09-11T22:20:43.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T22:20:43.749 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:44.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:43 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:44.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:43 smithi022 ceph-mon[30966]: Added host smithi045 2024-09-11T22:20:44.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:43 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:44.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:43 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:44.132 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:43 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 -- 172.21.15.22:0/820651131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 msgr2=0x7f0b38106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 --2- 172.21.15.22:0/820651131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b38106920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009810 tx=0x7f0b3402a540 comp rx=0 tx=0).stop 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 -- 172.21.15.22:0/820651131 shutdown_connections 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 --2- 172.21.15.22:0/820651131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b38106920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 -- 172.21.15.22:0/820651131 >> 172.21.15.22:0/820651131 conn(0x7f0b38077310 msgr2=0x7f0b380fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 -- 172.21.15.22:0/820651131 shutdown_connections 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.213+0000 7f0b3f524640 1 -- 172.21.15.22:0/820651131 wait complete. 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3f524640 1 Processor -- start 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3f524640 1 -- start start 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3f524640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3f524640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3810acb0 con 0x7f0b38106540 2024-09-11T22:20:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3d2c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3d2c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35680/0 (socket says 172.21.15.22:35680) 2024-09-11T22:20:44.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.214+0000 7f0b3d2c0640 1 -- 172.21.15.22:0/963201231 learned_addr learned my addr 172.21.15.22:0/963201231 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b3d2c0640 1 -- 172.21.15.22:0/963201231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b380ff250 con 0x7f0b38106540 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b3d2c0640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0b340058e0 tx=0x7f0b340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b34031400 con 0x7f0b38106540 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b340035f0 con 0x7f0b38106540 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b380fd8a0 con 0x7f0b38106540 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b3403c480 con 0x7f0b38106540 2024-09-11T22:20:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.215+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b380fdd60 con 0x7f0b38106540 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.216+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0b34039040 con 0x7f0b38106540 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.216+0000 7f0b2e7fc640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 0x7f0b2403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.216+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b38101bb0 con 0x7f0b38106540 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.216+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0b3406d6b0 con 0x7f0b38106540 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.216+0000 7f0b3cabf640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 0x7f0b2403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.217+0000 7f0b3cabf640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 0x7f0b2403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b280098c0 tx=0x7f0b28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.221+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b34040030 con 0x7f0b38106540 2024-09-11T22:20:44.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.403+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b380fe890 con 0x7f0b240390c0 2024-09-11T22:20:44.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.404+0000 7f0b2e7fc640 1 -- 172.21.15.22:0/963201231 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f0b380fe890 con 0x7f0b240390c0 2024-09-11T22:20:44.405 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:44.405 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}] 2024-09-11T22:20:44.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 msgr2=0x7f0b2403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 0x7f0b2403b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b280098c0 tx=0x7f0b28006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 msgr2=0x7f0b380fd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0b340058e0 tx=0x7f0b340045e0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 shutdown_connections 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0b240390c0 0x7f0b2403b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 --2- 172.21.15.22:0/963201231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b38106540 0x7f0b380fd360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 >> 172.21.15.22:0/963201231 conn(0x7f0b38077310 msgr2=0x7f0b380696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 shutdown_connections 2024-09-11T22:20:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:44.407+0000 7f0b3f524640 1 -- 172.21.15.22:0/963201231 wait complete. 2024-09-11T22:20:45.075 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-11T22:20:45.075 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:20:45.075 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-11T22:20:45.095 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:20:45.095 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:45.154 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-11T22:20:45.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch host add smithi169 2024-09-11T22:20:45.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:45.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:45 smithi022 ceph-mon[30966]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:20:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 -- 172.21.15.22:0/2650899691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 msgr2=0x7f6ad8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 --2- 172.21.15.22:0/2650899691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad8107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009880 tx=0x7f6ad402a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 -- 172.21.15.22:0/2650899691 shutdown_connections 2024-09-11T22:20:45.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 --2- 172.21.15.22:0/2650899691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad8107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 -- 172.21.15.22:0/2650899691 >> 172.21.15.22:0/2650899691 conn(0x7f6ad80fd290 msgr2=0x7f6ad80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 -- 172.21.15.22:0/2650899691 shutdown_connections 2024-09-11T22:20:45.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.837+0000 7f6adf46d640 1 -- 172.21.15.22:0/2650899691 wait complete. 2024-09-11T22:20:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6adf46d640 1 Processor -- start 2024-09-11T22:20:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6adf46d640 1 -- start start 2024-09-11T22:20:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6adf46d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6adf46d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad810bdd0 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6add209640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6add209640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35690/0 (socket says 172.21.15.22:35690) 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.838+0000 7f6add209640 1 -- 172.21.15.22:0/1842440163 learned_addr learned my addr 172.21.15.22:0/1842440163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6add209640 1 -- 172.21.15.22:0/1842440163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad8197720 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6add209640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006010 tx=0x7f6ad4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad403f070 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad81979b0 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ad4031c20 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4035030 con 0x7f6ad8107660 2024-09-11T22:20:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.839+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad819bab0 con 0x7f6ad8107660 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.840+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6ad4042070 con 0x7f6ad8107660 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.840+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad8102cd0 con 0x7f6ad8107660 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.841+0000 7f6ace7fc640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 0x7f6ac403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.841+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6ad406cd20 con 0x7f6ad8107660 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.841+0000 7f6adca08640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 0x7f6ac403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.841+0000 7f6adca08640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 0x7f6ac403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80098c0 tx=0x7f6ac8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:45.845+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ad403b5f0 con 0x7f6ad8107660 2024-09-11T22:20:46.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:46.027+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}) -- 0x7f6ad8198540 con 0x7f6ac4039060 2024-09-11T22:20:46.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:46 smithi022 ceph-mon[30966]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: Deploying cephadm binary to smithi169 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:48.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:49.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:48 smithi022 ceph-mon[30966]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-11T22:20:50.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.035+0000 7f6ace7fc640 1 -- 172.21.15.22:0/1842440163 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6ad8198540 con 0x7f6ac4039060 2024-09-11T22:20:50.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 msgr2=0x7f6ac403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 0x7f6ac403b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80098c0 tx=0x7f6ac8006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 msgr2=0x7f6ad81971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006010 tx=0x7f6ad4003c00 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 shutdown_connections 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6ac4039060 0x7f6ac403b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 --2- 172.21.15.22:0/1842440163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8107660 0x7f6ad81971e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 >> 172.21.15.22:0/1842440163 conn(0x7f6ad80fd290 msgr2=0x7f6ad80feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 shutdown_connections 2024-09-11T22:20:50.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:50.038+0000 7f6adf46d640 1 -- 172.21.15.22:0/1842440163 wait complete. 2024-09-11T22:20:50.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:49 smithi022 ceph-mon[30966]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:50.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T22:20:50.919 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:51.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:51 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:51.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:51 smithi022 ceph-mon[30966]: Added host smithi169 2024-09-11T22:20:51.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:51 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:51.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:51 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:51.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:51 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 -- 172.21.15.22:0/680394744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 msgr2=0x7f67f8106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/680394744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f8106920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009810 tx=0x7f67e802a540 comp rx=0 tx=0).stop 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 -- 172.21.15.22:0/680394744 shutdown_connections 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/680394744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f8106920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 -- 172.21.15.22:0/680394744 >> 172.21.15.22:0/680394744 conn(0x7f67f8077310 msgr2=0x7f67f80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 -- 172.21.15.22:0/680394744 shutdown_connections 2024-09-11T22:20:51.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.354+0000 7f67fe5c5640 1 -- 172.21.15.22:0/680394744 wait complete. 2024-09-11T22:20:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67fe5c5640 1 Processor -- start 2024-09-11T22:20:51.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67fe5c5640 1 -- start start 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67fe5c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67fe5c5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f67f810acb0 con 0x7f67f8106540 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35706/0 (socket says 172.21.15.22:35706) 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67f7fff640 1 -- 172.21.15.22:0/389666590 learned_addr learned my addr 172.21.15.22:0/389666590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.355+0000 7f67f7fff640 1 -- 172.21.15.22:0/389666590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f80ff210 con 0x7f67f8106540 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67f7fff640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67e80058e0 tx=0x7f67e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e8031400 con 0x7f67f8106540 2024-09-11T22:20:51.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67e80035f0 con 0x7f67f8106540 2024-09-11T22:20:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f80fd860 con 0x7f67f8106540 2024-09-11T22:20:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e803c480 con 0x7f67f8106540 2024-09-11T22:20:51.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.356+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f80fdd20 con 0x7f67f8106540 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.357+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f67e8039040 con 0x7f67f8106540 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.357+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f8101bb0 con 0x7f67f8106540 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.357+0000 7f67f5ffb640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 0x7f67e403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.357+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f67e806d600 con 0x7f67f8106540 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.357+0000 7f67effff640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 0x7f67e403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.358+0000 7f67effff640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 0x7f67e403b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67e00098c0 tx=0x7f67e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.362+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67e8040030 con 0x7f67f8106540 2024-09-11T22:20:51.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.544+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67f80fe8c0 con 0x7f67e40390c0 2024-09-11T22:20:51.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.545+0000 7f67f5ffb640 1 -- 172.21.15.22:0/389666590 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f67f80fe8c0 con 0x7f67e40390c0 2024-09-11T22:20:51.546 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:20:51.546 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 msgr2=0x7f67e403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 0x7f67e403b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67e00098c0 tx=0x7f67e0006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 msgr2=0x7f67f80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67e80058e0 tx=0x7f67e80045e0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 shutdown_connections 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f67e40390c0 0x7f67e403b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 --2- 172.21.15.22:0/389666590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8106540 0x7f67f80fd320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 >> 172.21.15.22:0/389666590 conn(0x7f67f8077310 msgr2=0x7f67f80696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 shutdown_connections 2024-09-11T22:20:51.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:51.547+0000 7f67fe5c5640 1 -- 172.21.15.22:0/389666590 wait complete. 2024-09-11T22:20:52.138 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T22:20:52.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T22:20:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:20:52.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:52 smithi022 ceph-mon[30966]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:52.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:52.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.862+0000 7f5e091e6640 1 -- 172.21.15.22:0/594581094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 msgr2=0x7f5e04102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.862+0000 7f5e091e6640 1 --2- 172.21.15.22:0/594581094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e04102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009810 tx=0x7f5df402a540 comp rx=0 tx=0).stop 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.862+0000 7f5e091e6640 1 -- 172.21.15.22:0/594581094 shutdown_connections 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.862+0000 7f5e091e6640 1 --2- 172.21.15.22:0/594581094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e04102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.862+0000 7f5e091e6640 1 -- 172.21.15.22:0/594581094 >> 172.21.15.22:0/594581094 conn(0x7f5e04077310 msgr2=0x7f5e040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.863+0000 7f5e091e6640 1 -- 172.21.15.22:0/594581094 shutdown_connections 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.863+0000 7f5e091e6640 1 -- 172.21.15.22:0/594581094 wait complete. 2024-09-11T22:20:52.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.863+0000 7f5e091e6640 1 Processor -- start 2024-09-11T22:20:52.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.863+0000 7f5e091e6640 1 -- start start 2024-09-11T22:20:52.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e091e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e091e6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0410bdd0 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35730/0 (socket says 172.21.15.22:35730) 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e02d9d640 1 -- 172.21.15.22:0/2797091950 learned_addr learned my addr 172.21.15.22:0/2797091950 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e02d9d640 1 -- 172.21.15.22:0/2797091950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e041977e0 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e02d9d640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058e0 tx=0x7f5df40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df4031400 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df40035f0 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.864+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e04197a70 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.865+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df403c480 con 0x7f5e04102730 2024-09-11T22:20:52.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.865+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e04197ed0 con 0x7f5e04102730 2024-09-11T22:20:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.865+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5df4039040 con 0x7f5e04102730 2024-09-11T22:20:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.866+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e04069f90 con 0x7f5e04102730 2024-09-11T22:20:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.866+0000 7f5debfff640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 0x7f5dec03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.866+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5df406d7e0 con 0x7f5e04102730 2024-09-11T22:20:52.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.866+0000 7f5e0259c640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 0x7f5dec03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.866+0000 7f5e0259c640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 0x7f5dec03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5df80098c0 tx=0x7f5df8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:52.871+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5df4040030 con 0x7f5e04102730 2024-09-11T22:20:53.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.052+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5e04198600 con 0x7f5e04102730 2024-09-11T22:20:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.399+0000 7f5debfff640 1 -- 172.21.15.22:0/2797091950 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5df4042560 con 0x7f5e04102730 2024-09-11T22:20:53.399 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 msgr2=0x7f5dec03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 0x7f5dec03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5df80098c0 tx=0x7f5df8006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 msgr2=0x7f5e041972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058e0 tx=0x7f5df40045e0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 shutdown_connections 2024-09-11T22:20:53.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5dec039060 0x7f5dec03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 --2- 172.21.15.22:0/2797091950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e04102730 0x7f5e041972a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.401+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 >> 172.21.15.22:0/2797091950 conn(0x7f5e04077310 msgr2=0x7f5e041034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.402+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 shutdown_connections 2024-09-11T22:20:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:20:53.402+0000 7f5e091e6640 1 -- 172.21.15.22:0/2797091950 wait complete. 2024-09-11T22:20:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:53 smithi022 ceph-mon[30966]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:20:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:53 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2797091950' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T22:20:53.960 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-09-11T22:20:53.960 INFO:tasks.cephadm:Adding mon.b on smithi045 2024-09-11T22:20:53.960 INFO:tasks.cephadm:Adding mon.c on smithi169 2024-09-11T22:20:53.960 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c' 2024-09-11T22:20:54.209 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T22:20:54.256 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2797091950' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.757+0000 7f0e642da640 1 -- 172.21.15.169:0/2582564882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 msgr2=0x7f0e5c104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.757+0000 7f0e642da640 1 --2- 172.21.15.169:0/2582564882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c104520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009880 tx=0x7f0e5802a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.757+0000 7f0e642da640 1 -- 172.21.15.169:0/2582564882 shutdown_connections 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.757+0000 7f0e642da640 1 --2- 172.21.15.169:0/2582564882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c104520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.757+0000 7f0e642da640 1 -- 172.21.15.169:0/2582564882 >> 172.21.15.169:0/2582564882 conn(0x7f0e5c0fbcd0 msgr2=0x7f0e5c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 -- 172.21.15.169:0/2582564882 shutdown_connections 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 -- 172.21.15.169:0/2582564882 wait complete. 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 Processor -- start 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 -- start start 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e642da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c107820 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e62076640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.758+0000 7f0e62076640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.169:44084/0 (socket says 172.21.15.169:44084) 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e62076640 1 -- 172.21.15.169:0/471493007 learned_addr learned my addr 172.21.15.169:0/471493007 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e62076640 1 -- 172.21.15.169:0/471493007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c197370 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e62076640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009230 tx=0x7f0e58032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e5803f030 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e58003e30 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c197600 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e58035070 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.759+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c19a2f0 con 0x7f0e5c102130 2024-09-11T22:20:54.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.760+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0e58042030 con 0x7f0e5c102130 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.760+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c107fa0 con 0x7f0e5c102130 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.760+0000 7f0e537fe640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 0x7f0e4803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.760+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0e58040070 con 0x7f0e5c102130 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.760+0000 7f0e61875640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 0x7f0e4803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.761+0000 7f0e61875640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 0x7f0e4803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0098c0 tx=0x7f0e4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:54.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.765+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e5804c350 con 0x7f0e5c102130 2024-09-11T22:20:54.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.954+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}) -- 0x7f0e5c02d830 con 0x7f0e480390c0 2024-09-11T22:20:54.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.959+0000 7f0e537fe640 1 -- 172.21.15.169:0/471493007 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0e5c02d830 con 0x7f0e480390c0 2024-09-11T22:20:54.960 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mon update... 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 msgr2=0x7f0e4803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 0x7f0e4803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0098c0 tx=0x7f0e4c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 msgr2=0x7f0e5c196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009230 tx=0x7f0e58032d00 comp rx=0 tx=0).stop 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 shutdown_connections 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0e480390c0 0x7f0e4803b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 --2- 172.21.15.169:0/471493007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e5c102130 0x7f0e5c196e30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 >> 172.21.15.169:0/471493007 conn(0x7f0e5c0fbcd0 msgr2=0x7f0e5c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:54.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 shutdown_connections 2024-09-11T22:20:54.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:54.961+0000 7f0e642da640 1 -- 172.21.15.169:0/471493007 wait complete. 2024-09-11T22:20:55.460 DEBUG:teuthology.orchestra.run.smithi045:mon.b> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T22:20:55.462 DEBUG:teuthology.orchestra.run.smithi169:mon.c> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T22:20:55.465 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:20:55.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:20:55.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-11T22:20:55.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:20:55.735 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:55.744 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 -- 172.21.15.169:0/758298384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 msgr2=0x7fc19c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 --2- 172.21.15.169:0/758298384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc198009810 tx=0x7fc19802a540 comp rx=0 tx=0).stop 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 -- 172.21.15.169:0/758298384 shutdown_connections 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 --2- 172.21.15.169:0/758298384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 -- 172.21.15.169:0/758298384 >> 172.21.15.169:0/758298384 conn(0x7fc19c077310 msgr2=0x7fc19c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 -- 172.21.15.169:0/758298384 shutdown_connections 2024-09-11T22:20:56.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.152+0000 7fc1a442d640 1 -- 172.21.15.169:0/758298384 wait complete. 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.153+0000 7fc1a442d640 1 Processor -- start 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.153+0000 7fc1a442d640 1 -- start start 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.153+0000 7fc1a442d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.153+0000 7fc1a442d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c10acb0 con 0x7fc19c106540 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.153+0000 7fc1a21c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a21c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.169:44100/0 (socket says 172.21.15.169:44100) 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a21c9640 1 -- 172.21.15.169:0/2638529614 learned_addr learned my addr 172.21.15.169:0/2638529614 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:20:56.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a21c9640 1 -- 172.21.15.169:0/2638529614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c1985d0 con 0x7fc19c106540 2024-09-11T22:20:56.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a21c9640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc198009930 tx=0x7fc1980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc198031400 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc1980035f0 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c198860 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19803c5b0 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.154+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c198c60 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.155+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc198039040 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.155+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c198e90 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.155+0000 7fc1937fe640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 0x7fc18803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.155+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc19806d5d0 con 0x7fc19c106540 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.156+0000 7fc1a19c8640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 0x7fc18803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:56.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.156+0000 7fc1a19c8640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 0x7fc18803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:56.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.160+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc198040030 con 0x7fc19c106540 2024-09-11T22:20:56.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.387+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc19c1069a0 con 0x7fc19c106540 2024-09-11T22:20:56.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.388+0000 7fc1937fe640 1 -- 172.21.15.169:0/2638529614 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fc198042b50 con 0x7fc19c106540 2024-09-11T22:20:56.389 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:20:56.389 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:19:27.657074Z","created":"2024-09-11T22:19:27.657074Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T22:20:56.389 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-11T22:20:56.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 msgr2=0x7fc18803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 0x7fc18803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0098c0 tx=0x7fc18c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 msgr2=0x7fc19c198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc198009930 tx=0x7fc1980045e0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 shutdown_connections 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc188039060 0x7fc18803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 --2- 172.21.15.169:0/2638529614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc19c106540 0x7fc19c198090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 >> 172.21.15.169:0/2638529614 conn(0x7fc19c077310 msgr2=0x7fc19c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 shutdown_connections 2024-09-11T22:20:56.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:56.390+0000 7fc1a442d640 1 -- 172.21.15.169:0/2638529614 wait complete. 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c;count:3 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: Reconfiguring daemon mon.a on smithi022 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:56.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:20:56.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:20:56.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:20:56.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:56.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/2638529614' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:20:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:57 smithi022 ceph-mon[30966]: Deploying daemon mon.c on smithi169 2024-09-11T22:20:58.059 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:20:58.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:20:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:20:58 smithi022 ceph-mon[30966]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:58.994 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:20:59.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.560+0000 7f5a77e58640 1 -- 172.21.15.169:0/2450404402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 msgr2=0x7f5a70107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.560+0000 7f5a77e58640 1 --2- 172.21.15.169:0/2450404402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70107a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009880 tx=0x7f5a6c02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.560+0000 7f5a77e58640 1 -- 172.21.15.169:0/2450404402 shutdown_connections 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.560+0000 7f5a77e58640 1 --2- 172.21.15.169:0/2450404402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70107a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.560+0000 7f5a77e58640 1 -- 172.21.15.169:0/2450404402 >> 172.21.15.169:0/2450404402 conn(0x7f5a700fb9a0 msgr2=0x7f5a700fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 -- 172.21.15.169:0/2450404402 shutdown_connections 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 -- 172.21.15.169:0/2450404402 wait complete. 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 Processor -- start 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 -- start start 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.561+0000 7f5a77e58640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010be60 con 0x7f5a70107660 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.562+0000 7f5a75bf4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.562+0000 7f5a75bf4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.169:41556/0 (socket says 172.21.15.169:41556) 2024-09-11T22:20:59.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.562+0000 7f5a75bf4640 1 -- 172.21.15.169:0/745730648 learned_addr learned my addr 172.21.15.169:0/745730648 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.562+0000 7f5a75bf4640 1 -- 172.21.15.169:0/745730648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a70199a90 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a75bf4640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c006010 tx=0x7f5a6c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c03f070 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a70199d80 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5a6c031c20 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7019de20 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.563+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c035030 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.564+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5a6c042070 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.564+0000 7f5a66ffd640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 0x7f5a5c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.564+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5a6c06cce0 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.564+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a70102ed0 con 0x7f5a70107660 2024-09-11T22:20:59.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.564+0000 7f5a753f3640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 0x7f5a5c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:59.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.565+0000 7f5a753f3640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 0x7f5a5c03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a600098c0 tx=0x7f5a60006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:59.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.569+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a6c04c350 con 0x7f5a70107660 2024-09-11T22:20:59.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.821+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5a7019a8b0 con 0x7f5a70107660 2024-09-11T22:20:59.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.822+0000 7f5a66ffd640 1 -- 172.21.15.169:0/745730648 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f5a6c03b5f0 con 0x7f5a70107660 2024-09-11T22:20:59.823 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:20:59.823 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:19:27.657074Z","created":"2024-09-11T22:19:27.657074Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T22:20:59.823 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-11T22:20:59.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 msgr2=0x7f5a5c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 0x7f5a5c03b580 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a600098c0 tx=0x7f5a60006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 msgr2=0x7f5a70199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:59.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c006010 tx=0x7f5a6c003c00 comp rx=0 tx=0).stop 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 shutdown_connections 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5a5c0390c0 0x7f5a5c03b580 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 --2- 172.21.15.169:0/745730648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a70107660 0x7f5a70199550 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 >> 172.21.15.169:0/745730648 conn(0x7f5a700fb9a0 msgr2=0x7f5a700fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 shutdown_connections 2024-09-11T22:20:59.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:20:59.825+0000 7f5a77e58640 1 -- 172.21.15.169:0/745730648 wait complete. 2024-09-11T22:21:00.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 podman[35609]: 2024-09-11 22:21:00.483477978 +0000 UTC m=+0.016569881 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:00.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:00 smithi022 ceph-mon[30966]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:00.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:00 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/745730648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 podman[35609]: 2024-09-11 22:21:00.759826623 +0000 UTC m=+0.292918535 container init 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T22:21:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 podman[35609]: 2024-09-11 22:21:00.762876149 +0000 UTC m=+0.295968047 container start 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T22:21:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T22:21:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T22:21:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pidfile_write: ignore empty --pid-file 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: load: jerasure load: lrc 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: RocksDB version: 7.9.2 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Git sha 0 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: DB SUMMARY 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: DB Session ID: 9RKIRKRQRHHGKD4OXLGQ 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: CURRENT file: CURRENT 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.error_if_exists: 0 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.create_if_missing: 0 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.paranoid_checks: 1 2024-09-11T22:21:01.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.env: 0x55b0645ae940 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.info_log: 0x55b0658196e0 2024-09-11T22:21:01.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.statistics: (nil) 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.use_fsync: 0 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_log_file_size: 0 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_fallocate: 1 2024-09-11T22:21:01.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.use_direct_reads: 0 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.db_log_dir: 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.wal_dir: 2024-09-11T22:21:01.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.write_buffer_manager: 0x55b065828dc0 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T22:21:01.158 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.unordered_write: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.row_cache: None 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.wal_filter: None 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.two_write_queues: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T22:21:01.159 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.wal_compression: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.atomic_flush: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.log_readahead_size: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T22:21:01.160 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_background_jobs: 2 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_background_compactions: -1 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_subcompactions: 1 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_open_files: -1 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T22:21:01.161 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_background_flushes: -1 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Compression algorithms supported: 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kZSTD supported: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kXpressCompression supported: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kBZip2Compression supported: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kLZ4Compression supported: 1 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kZlibCompression supported: 1 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: kSnappyCompression supported: 1 2024-09-11T22:21:01.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.merge_operator: 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_filter: None 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b065819320) 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout: cache_index_and_filter_blocks: 1 2024-09-11T22:21:01.163 INFO:journalctl@ceph.mon.c.smithi169.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: pin_top_level_index_and_filter: 1 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: index_type: 0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: data_block_index_type: 0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: index_shortening: 1 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: checksum: 4 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: no_block_cache: 0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_cache: 0x55b06580d1f0 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_cache_name: BinnedLRUCache 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_cache_options: 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: capacity : 536870912 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: num_shard_bits : 4 2024-09-11T22:21:01.164 INFO:journalctl@ceph.mon.c.smithi169.stdout: strict_capacity_limit : 0 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: high_pri_pool_ratio: 0.000 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_cache_compressed: (nil) 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: persistent_cache: (nil) 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_size: 4096 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_size_deviation: 10 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_restart_interval: 16 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: index_block_restart_interval: 1 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: metadata_block_size: 4096 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: partition_filters: 0 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: use_delta_encoding: 1 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: filter_policy: bloomfilter 2024-09-11T22:21:01.165 INFO:journalctl@ceph.mon.c.smithi169.stdout: whole_key_filtering: 1 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: verify_compression: 0 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: read_amp_bytes_per_bit: 0 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: format_version: 5 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: enable_index_compression: 1 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: block_align: 0 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: max_auto_readahead_size: 262144 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: prepopulate_block_cache: 0 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: initial_auto_readahead_size: 8192 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression: NoCompression 2024-09-11T22:21:01.166 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.num_levels: 7 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T22:21:01.167 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T22:21:01.168 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T22:21:01.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T22:21:01.170 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T22:21:01.171 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.inplace_update_support: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.bloom_locality: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.max_successive_merges: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T22:21:01.172 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.ttl: 2592000 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enable_blob_files: false 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.min_blob_size: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T22:21:01.173 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1ac51b4a-b2bb-48f1-b8f0-e72a578036d2 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093260790619, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093260791184, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726093260, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1ac51b4a-b2bb-48f1-b8f0-e72a578036d2", "db_session_id": "9RKIRKRQRHHGKD4OXLGQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093260791311, "job": 1, "event": "recovery_finished"} 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b06583ae00 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: DB pointer 0x55b065936000 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T22:21:01.174 INFO:journalctl@ceph.mon.c.smithi169.stdout: ** DB Stats ** 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: ** Compaction Stats [default] ** 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:21:01.175 INFO:journalctl@ceph.mon.c.smithi169.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: ** Compaction Stats [default] ** 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T22:21:01.176 INFO:journalctl@ceph.mon.c.smithi169.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: Block cache BinnedLRUCache@0x55b06580d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: using public_addr v2:172.21.15.169:0/0 -> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-11T22:21:01.177 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: starting mon.c rank -1 at public addrs [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] at bind addrs [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(???) e0 preinit fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).mds e1 new map 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: e1 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: btime 2024-09-11T22:19:30:932019+0000 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: legacy client fscid: -1 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout: No filesystems configured 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T22:21:01.178 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2797091950' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2797091950' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.179 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.180 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c;count:3 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T22:21:01.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Reconfiguring daemon mon.a on smithi022 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/2638529614' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:01.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: Deploying daemon mon.c on smithi169 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/745730648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 ceph-mon[35628]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 bash[35609]: 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 2024-09-11T22:21:01.184 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:00 smithi169 systemd[1]: Started Ceph mon.c for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:01.394 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:01.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:01.641 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:06.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:06.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: mon.a calling monitor election 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: mon.c calling monitor election 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: monmap epoch 2 2024-09-11T22:21:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: last_changed 2024-09-11T22:21:00.818372+0000 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: min_mon_release 19 (squid) 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: election_strategy: 1 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: fsmap 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: mgrmap e13: x(active, since 39s) 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: overall HEALTH_OK 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: mon.a calling monitor election 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: mon.c calling monitor election 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:06.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: monmap epoch 2 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: last_changed 2024-09-11T22:21:00.818372+0000 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: min_mon_release 19 (squid) 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: election_strategy: 1 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: fsmap 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: mgrmap e13: x(active, since 39s) 2024-09-11T22:21:06.156 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: overall HEALTH_OK 2024-09-11T22:21:06.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:06.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:06.157 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:06.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 -- 172.21.15.169:0/1335555368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0208005740 msgr2=0x7f0208007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 --2- 172.21.15.169:0/1335555368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0208005740 0x7f0208007bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02201016a0 tx=0x7f021002c490 comp rx=0 tx=0).stop 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 -- 172.21.15.169:0/1335555368 shutdown_connections 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 --2- 172.21.15.169:0/1335555368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0208005740 0x7f0208007bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 -- 172.21.15.169:0/1335555368 >> 172.21.15.169:0/1335555368 conn(0x7f02200fc220 msgr2=0x7f02200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 -- 172.21.15.169:0/1335555368 shutdown_connections 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.481+0000 7f022681d640 1 -- 172.21.15.169:0/1335555368 wait complete. 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.482+0000 7f022681d640 1 Processor -- start 2024-09-11T22:21:06.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.482+0000 7f022681d640 1 -- start start 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f022681d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f022681d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 0x7f02201999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f022681d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0220107710 con 0x7f0220195660 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f022681d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0220107590 con 0x7f0208005740 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55762/0 (socket says 172.21.15.169:55762) 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 -- 172.21.15.169:0/2939732369 learned_addr learned my addr 172.21.15.169:0/2939732369 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021f7fe640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 0x7f02201999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 -- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 msgr2=0x7f0220195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T22:21:06.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 -- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 msgr2=0x7f0220195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021ffff640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021f7fe640 1 -- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 msgr2=0x7f0220195120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021f7fe640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.483+0000 7f021f7fe640 1 -- 172.21.15.169:0/2939732369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220195c80 con 0x7f0220195660 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f021f7fe640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 0x7f02201999f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f021400b3d0 tx=0x7f021400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0214011630 con 0x7f0220195660 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0214011cd0 con 0x7f0220195660 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0220199f30 con 0x7f0220195660 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f021400f2e0 con 0x7f0220195660 2024-09-11T22:21:06.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.484+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022019a4f0 con 0x7f0220195660 2024-09-11T22:21:06.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.485+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0214018020 con 0x7f0220195660 2024-09-11T22:21:06.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.485+0000 7f021d7fa640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 0x7f020c03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.485+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f021404bd50 con 0x7f0220195660 2024-09-11T22:21:06.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.485+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022019a800 con 0x7f0220195660 2024-09-11T22:21:06.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.486+0000 7f021ffff640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 0x7f020c03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.486+0000 7f021ffff640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 0x7f020c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f021002ca00 tx=0x7f021002c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.491+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f021401f020 con 0x7f0220195660 2024-09-11T22:21:06.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.725+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f022018eee0 con 0x7f0220195660 2024-09-11T22:21:06.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.725+0000 7f021d7fa640 1 -- 172.21.15.169:0/2939732369 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0214018310 con 0x7f0220195660 2024-09-11T22:21:06.726 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:21:06.726 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:00.818372Z","created":"2024-09-11T22:19:27.657074Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:06.727 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-11T22:21:06.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.727+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 msgr2=0x7f020c03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.727+0000 7f022681d640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 0x7f020c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f021002ca00 tx=0x7f021002c990 comp rx=0 tx=0).stop 2024-09-11T22:21:06.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 msgr2=0x7f02201999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 0x7f02201999f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f021400b3d0 tx=0x7f021400b890 comp rx=0 tx=0).stop 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 shutdown_connections 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0220195660 0x7f02201999f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f020c038e50 0x7f020c03b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 --2- 172.21.15.169:0/2939732369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0208005740 0x7f0220195120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 >> 172.21.15.169:0/2939732369 conn(0x7f02200fc220 msgr2=0x7f02200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 shutdown_connections 2024-09-11T22:21:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:06.728+0000 7f022681d640 1 -- 172.21.15.169:0/2939732369 wait complete. 2024-09-11T22:21:07.024 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:06 smithi169 ceph-mon[35628]: Deploying daemon mon.b on smithi045 2024-09-11T22:21:07.024 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/2939732369' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:07.024 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:07.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:06 smithi022 ceph-mon[30966]: Deploying daemon mon.b on smithi045 2024-09-11T22:21:07.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/2939732369' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:07.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:08.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:07 smithi022 ceph-mon[30966]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:08.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:07 smithi169 ceph-mon[35628]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:08.260 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:08.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:08.515 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 -- 172.21.15.169:0/403247460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 msgr2=0x7f7bc8102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 --2- 172.21.15.169:0/403247460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8102c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009880 tx=0x7f7bb802a670 comp rx=0 tx=0).stop 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 -- 172.21.15.169:0/403247460 shutdown_connections 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 --2- 172.21.15.169:0/403247460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8102c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 -- 172.21.15.169:0/403247460 >> 172.21.15.169:0/403247460 conn(0x7f7bc80fc280 msgr2=0x7f7bc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:08.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 -- 172.21.15.169:0/403247460 shutdown_connections 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 -- 172.21.15.169:0/403247460 wait complete. 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.906+0000 7f7bce47b640 1 Processor -- start 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bce47b640 1 -- start start 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bce47b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bce47b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bce47b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc810bef0 con 0x7f7bc8102840 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bce47b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc810bd70 con 0x7f7bc8197a40 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54548/0 (socket says 172.21.15.169:54548) 2024-09-11T22:21:08.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 -- 172.21.15.169:0/3588043186 learned_addr learned my addr 172.21.15.169:0/3588043186 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 -- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 msgr2=0x7f7bc819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 -- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 msgr2=0x7f7bc819bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc77fe640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.907+0000 7f7bc7fff640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc7fff640 1 -- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 msgr2=0x7f7bc819bdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc7fff640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc7fff640 1 -- 172.21.15.169:0/3588043186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc8198060 con 0x7f7bc8102840 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc7fff640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8197500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000c00 tx=0x7f7bb8004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7bb8035030 con 0x7f7bc8102840 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bb80053d0 con 0x7f7bc8102840 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc819c310 con 0x7f7bc8102840 2024-09-11T22:21:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7bb8031890 con 0x7f7bc8102840 2024-09-11T22:21:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.908+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc819c7f0 con 0x7f7bc8102840 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.909+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc806a4f0 con 0x7f7bc8102840 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.909+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7bb8042070 con 0x7f7bc8102840 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.910+0000 7f7bc57fa640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 0x7f7bb003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.910+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7bb806ccd0 con 0x7f7bc8102840 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.910+0000 7f7bc77fe640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 0x7f7bb003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.910+0000 7f7bc77fe640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 0x7f7bb003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009100 tx=0x7f7bbc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:08.915+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bb8005580 con 0x7f7bc8102840 2024-09-11T22:21:09.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.147+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7bc819caa0 con 0x7f7bc8102840 2024-09-11T22:21:09.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.147+0000 7f7bc57fa640 1 -- 172.21.15.169:0/3588043186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f7bb80035f0 con 0x7f7bc8102840 2024-09-11T22:21:09.149 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:21:09.149 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:00.818372Z","created":"2024-09-11T22:19:27.657074Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:09.149 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-11T22:21:09.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 msgr2=0x7f7bb003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:09.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 0x7f7bb003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009100 tx=0x7f7bbc008040 comp rx=0 tx=0).stop 2024-09-11T22:21:09.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 msgr2=0x7f7bc8197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8197500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000c00 tx=0x7f7bb8004ef0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 shutdown_connections 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7bb0038e00 0x7f7bb003b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bc8197a40 0x7f7bc819bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 --2- 172.21.15.169:0/3588043186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc8102840 0x7f7bc8197500 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 >> 172.21.15.169:0/3588043186 conn(0x7f7bc80fc280 msgr2=0x7f7bc8103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 shutdown_connections 2024-09-11T22:21:09.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:09.150+0000 7f7bce47b640 1 -- 172.21.15.169:0/3588043186 wait complete. 2024-09-11T22:21:10.668 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:10.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:10.912 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 -- 172.21.15.169:0/3231865968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 msgr2=0x7fa8ec007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 --2- 172.21.15.169:0/3231865968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa8ec007bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa9041016c0 tx=0x7fa8f402c3f0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 -- 172.21.15.169:0/3231865968 shutdown_connections 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 --2- 172.21.15.169:0/3231865968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa8ec007bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 -- 172.21.15.169:0/3231865968 >> 172.21.15.169:0/3231865968 conn(0x7fa9040fc280 msgr2=0x7fa9040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 -- 172.21.15.169:0/3231865968 shutdown_connections 2024-09-11T22:21:14.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.883+0000 7fa908837640 1 -- 172.21.15.169:0/3231865968 wait complete. 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: mon.c calling monitor election 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: mon.a calling monitor election 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.886 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: monmap epoch 3 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: last_changed 2024-09-11T22:21:09.551455+0000 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: min_mon_release 19 (squid) 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: election_strategy: 1 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: 2: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: fsmap 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:14.887 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: mgrmap e13: x(active, since 48s) 2024-09-11T22:21:14.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: overall HEALTH_OK 2024-09-11T22:21:14.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.888 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.884+0000 7fa908837640 1 Processor -- start 2024-09-11T22:21:14.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.884+0000 7fa908837640 1 -- start start 2024-09-11T22:21:14.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa9041951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa904107730 con 0x7fa8ec005740 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa9041075b0 con 0x7fa90419a000 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa908837640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9041078b0 con 0x7fa904195730 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa9041951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54554/0 (socket says 172.21.15.169:54554) 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 -- 172.21.15.169:0/2849060434 learned_addr learned my addr 172.21.15.169:0/2849060434 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 msgr2=0x7fa904199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 msgr2=0x7fa904199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:14.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa902d9d640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa901d9b640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa902d9d640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 msgr2=0x7fa90419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa902d9d640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 msgr2=0x7fa90419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa902d9d640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa902d9d640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 msgr2=0x7fa904199ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 msgr2=0x7fa90419a4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 -- 172.21.15.169:0/2849060434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9041a1d70 con 0x7fa8ec005740 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.885+0000 7fa90259c640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa9041951f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4034430 tx=0x7fa8f4034c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:14.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.886+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4042070 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.886+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8f4005520 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.886+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9041a1f40 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.886+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4012a90 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.886+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9041a2470 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.887+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa8f4045070 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.887+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa904108860 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.887+0000 7fa8f37fe640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 0x7fa8e403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.887+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa8f406db90 con 0x7fa8ec005740 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.887+0000 7fa901d9b640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 0x7fa8e403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:14.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.888+0000 7fa901d9b640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 0x7fa8e403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009100 tx=0x7fa8f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:14.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:14.892+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8f4039230 con 0x7fa8ec005740 2024-09-11T22:21:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: mon.c calling monitor election 2024-09-11T22:21:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: mon.a calling monitor election 2024-09-11T22:21:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: monmap epoch 3 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: last_changed 2024-09-11T22:21:09.551455+0000 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:14.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: min_mon_release 19 (squid) 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: election_strategy: 1 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: 2: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: fsmap 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: mgrmap e13: x(active, since 48s) 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: overall HEALTH_OK 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:14.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:15.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.149+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa9041048e0 con 0x7fa8ec005740 2024-09-11T22:21:15.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.149+0000 7fa8f37fe640 1 -- 172.21.15.169:0/2849060434 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fa8f4003b60 con 0x7fa8ec005740 2024-09-11T22:21:15.151 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:21:15.151 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":3,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:09.551455Z","created":"2024-09-11T22:19:27.657074Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:15.151 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 3 2024-09-11T22:21:15.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 msgr2=0x7fa8e403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 0x7fa8e403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009100 tx=0x7fa8f8008040 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 msgr2=0x7fa9041951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa9041951f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4034430 tx=0x7fa8f4034c80 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 shutdown_connections 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa90419a000 0x7fa90419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8e40394f0 0x7fa8e403b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa904195730 0x7fa904199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 --2- 172.21.15.169:0/2849060434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8ec005740 0x7fa9041951f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 >> 172.21.15.169:0/2849060434 conn(0x7fa9040fc280 msgr2=0x7fa9040fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 shutdown_connections 2024-09-11T22:21:15.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:15.152+0000 7fa908837640 1 -- 172.21.15.169:0/2849060434 wait complete. 2024-09-11T22:21:15.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:15 smithi169 ceph-mon[35628]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:15.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:15 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:15.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:15 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/2849060434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:15.792 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:15 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:15.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:15 smithi022 ceph-mon[30966]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:15 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:15 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/2849060434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:15 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:16.418 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T22:21:16.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T22:21:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:17.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mon.b calling monitor election 2024-09-11T22:21:17.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mon.b calling monitor election 2024-09-11T22:21:17.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mon.c calling monitor election 2024-09-11T22:21:17.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mon.a calling monitor election 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: monmap epoch 3 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: last_changed 2024-09-11T22:21:09.551455+0000 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: min_mon_release 19 (squid) 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: election_strategy: 1 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: 2: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: fsmap 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:17.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: mgrmap e13: x(active, since 50s) 2024-09-11T22:21:17.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: overall HEALTH_OK 2024-09-11T22:21:17.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:17.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mon.b calling monitor election 2024-09-11T22:21:17.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mon.b calling monitor election 2024-09-11T22:21:17.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mon.c calling monitor election 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mon.a calling monitor election 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: monmap epoch 3 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: last_changed 2024-09-11T22:21:09.551455+0000 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: min_mon_release 19 (squid) 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: election_strategy: 1 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: 2: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2024-09-11T22:21:17.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: fsmap 2024-09-11T22:21:17.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:17.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: mgrmap e13: x(active, since 50s) 2024-09-11T22:21:17.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: overall HEALTH_OK 2024-09-11T22:21:17.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:17.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mon.b calling monitor election 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mon.b calling monitor election 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mon.c calling monitor election 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mon.a calling monitor election 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: monmap epoch 3 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: last_changed 2024-09-11T22:21:09.551455+0000 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: created 2024-09-11T22:19:27.657074+0000 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: min_mon_release 19 (squid) 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: election_strategy: 1 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-11T22:21:17.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: 2: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2024-09-11T22:21:17.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: fsmap 2024-09-11T22:21:17.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:17.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: mgrmap e13: x(active, since 50s) 2024-09-11T22:21:17.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: overall HEALTH_OK 2024-09-11T22:21:17.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:17.722 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 -- 172.21.15.22:0/1179056337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102ef0 msgr2=0x7f208010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 --2- 172.21.15.22:0/1179056337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102ef0 0x7f208010da40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2078009ca0 tx=0x7f207802a950 comp rx=0 tx=0).stop 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 -- 172.21.15.22:0/1179056337 shutdown_connections 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 --2- 172.21.15.22:0/1179056337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102ef0 0x7f208010da40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 --2- 172.21.15.22:0/1179056337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102570 0x7f20801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 --2- 172.21.15.22:0/1179056337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 0x7f2080101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 -- 172.21.15.22:0/1179056337 >> 172.21.15.22:0/1179056337 conn(0x7f20800fc7d0 msgr2=0x7f20800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 -- 172.21.15.22:0/1179056337 shutdown_connections 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.169+0000 7f2086284640 1 -- 172.21.15.22:0/1179056337 wait complete. 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 Processor -- start 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 -- start start 2024-09-11T22:21:18.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 0x7f208019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102ef0 0x7f208019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f20801110a0 con 0x7f2080102570 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2080110f20 con 0x7f2080102ef0 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2086284640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2080111220 con 0x7f2080100e20 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46906/0 (socket says 172.21.15.22:46906) 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 -- 172.21.15.22:0/3542006605 learned_addr learned my addr 172.21.15.22:0/3542006605 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f207ffff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 0x7f208019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2084821640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102ef0 0x7f208019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 -- 172.21.15.22:0/3542006605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 msgr2=0x7f208019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 0x7f208019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 -- 172.21.15.22:0/3542006605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102ef0 msgr2=0x7f208019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.170+0000 7f2077fff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102ef0 0x7f208019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f2077fff640 1 -- 172.21.15.22:0/3542006605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208019f660 con 0x7f2080102570 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f2077fff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f206800c920 tx=0x7f206800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068007c70 con 0x7f2080102570 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2068007e10 con 0x7f2080102570 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208019f950 con 0x7f2080102570 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068018940 con 0x7f2080102570 2024-09-11T22:21:18.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.171+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a7230 con 0x7f2080102570 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.172+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2068018b20 con 0x7f2080102570 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.172+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2080101200 con 0x7f2080102570 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.172+0000 7f207dffb640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 0x7f206c03b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.172+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f206804c3e0 con 0x7f2080102570 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.172+0000 7f207ffff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 0x7f206c03b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.173+0000 7f207ffff640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 0x7f206c03b750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20700058c0 tx=0x7f207000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.177+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2068014030 con 0x7f2080102570 2024-09-11T22:21:18.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.352+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f20801a7430 con 0x7f2080102570 2024-09-11T22:21:18.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.353+0000 7f207dffb640 1 -- 172.21.15.22:0/3542006605 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f20680203a0 con 0x7f2080102570 2024-09-11T22:21:18.355 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:18.355 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-09-11T22:21:18.355 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:18.355 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 msgr2=0x7f206c03b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 0x7f206c03b750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f20700058c0 tx=0x7f207000a250 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 msgr2=0x7f208019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f206800c920 tx=0x7f206800cde0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 shutdown_connections 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2080102ef0 0x7f208019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2080102570 0x7f208019abf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f206c039290 0x7f206c03b750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 --2- 172.21.15.22:0/3542006605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2080100e20 0x7f208019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 >> 172.21.15.22:0/3542006605 conn(0x7f20800fc7d0 msgr2=0x7f208006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 shutdown_connections 2024-09-11T22:21:18.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:18.355+0000 7f2086284640 1 -- 172.21.15.22:0/3542006605 wait complete. 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:18.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:18.980 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T22:21:18.981 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:21:18.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:19.011 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:21:19.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:19.080 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:21:19.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:19.109 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:21:19.109 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:19.175 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:21:19.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:19.203 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:21:19.203 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:19.269 INFO:tasks.cephadm:Adding mgr.x on smithi022 2024-09-11T22:21:19.269 INFO:tasks.cephadm:Adding mgr.y on smithi045 2024-09-11T22:21:19.269 INFO:tasks.cephadm:Adding mgr.z on smithi169 2024-09-11T22:21:19.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi022=x;smithi045=y;smithi169=z' 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: Reconfiguring daemon mon.b on smithi045 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3542006605' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: Reconfiguring daemon mon.b on smithi045 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3542006605' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:19.452 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: Reconfiguring daemon mon.b on smithi045 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3542006605' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:20.438 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: Reconfiguring daemon mon.c on smithi169 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:20.439 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 -- 172.21.15.169:0/4044436573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e0102660 msgr2=0x7f03e0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 --2- 172.21.15.169:0/4044436573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e0102660 0x7f03e0104a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009900 tx=0x7f03d002a410 comp rx=0 tx=0).stop 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 -- 172.21.15.169:0/4044436573 shutdown_connections 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 --2- 172.21.15.169:0/4044436573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e01078c0 0x7f03e0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 --2- 172.21.15.169:0/4044436573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 --2- 172.21.15.169:0/4044436573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e0102660 0x7f03e0104a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 -- 172.21.15.169:0/4044436573 >> 172.21.15.169:0/4044436573 conn(0x7f03e00fc280 msgr2=0x7f03e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 -- 172.21.15.169:0/4044436573 shutdown_connections 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.624+0000 7f03e6815640 1 -- 172.21.15.169:0/4044436573 wait complete. 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 Processor -- start 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 -- start start 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e0102660 0x7f03e0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03e010da80 con 0x7f03e0104f90 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f03e010d900 con 0x7f03e0102660 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e6815640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03e010dc00 con 0x7f03e01078c0 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:53280/0 (socket says 172.21.15.169:53280) 2024-09-11T22:21:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 -- 172.21.15.169:0/1753677538 learned_addr learned my addr 172.21.15.169:0/1753677538 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03dffff640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e0102660 0x7f03e0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03d7fff640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 -- 172.21.15.169:0/1753677538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e0102660 msgr2=0x7f03e0101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e0102660 0x7f03e0101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 -- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 msgr2=0x7f03e0100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03e4db2640 1 -- 172.21.15.169:0/1753677538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e0101410 con 0x7f03e01078c0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.625+0000 7f03d7fff640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03e4db2640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03d800cad0 tx=0x7f03d800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800ae20 con 0x7f03e01078c0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03d8004b20 con 0x7f03e01078c0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800f780 con 0x7f03e01078c0 2024-09-11T22:21:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e01a2210 con 0x7f03e01078c0 2024-09-11T22:21:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.626+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e01a27f0 con 0x7f03e01078c0 2024-09-11T22:21:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.627+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f03d800f960 con 0x7f03e01078c0 2024-09-11T22:21:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.627+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e00fdd70 con 0x7f03e01078c0 2024-09-11T22:21:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.627+0000 7f03ddffb640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 0x7f03cc03b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.627+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f03d804c2f0 con 0x7f03e01078c0 2024-09-11T22:21:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.627+0000 7f03dffff640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 0x7f03cc03b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.628+0000 7f03dffff640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 0x7f03cc03b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03d00096c0 tx=0x7f03d0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:20.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.632+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03d8014030 con 0x7f03e01078c0 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: Reconfiguring daemon mon.c on smithi169 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: Reconfiguring daemon mon.c on smithi169 2024-09-11T22:21:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:20.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:20.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:20.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:20.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.809+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi045=y;smithi169=z", "target": ["mon-mgr", ""]}) -- 0x7f03e00626c0 con 0x7f03cc039290 2024-09-11T22:21:20.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.814+0000 7f03ddffb640 1 -- 172.21.15.169:0/1753677538 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f03e00626c0 con 0x7f03cc039290 2024-09-11T22:21:20.815 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mgr update... 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 msgr2=0x7f03cc03b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 0x7f03cc03b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03d00096c0 tx=0x7f03d0005fd0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 msgr2=0x7f03e0100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03d800cad0 tx=0x7f03d800cf90 comp rx=0 tx=0).stop 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 shutdown_connections 2024-09-11T22:21:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f03cc039290 0x7f03cc03b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03e01078c0 0x7f03e0100b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e0104f90 0x7f03e0100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 --2- 172.21.15.169:0/1753677538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03e0102660 0x7f03e0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.816+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 >> 172.21.15.169:0/1753677538 conn(0x7f03e00fc280 msgr2=0x7f03e0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.817+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 shutdown_connections 2024-09-11T22:21:20.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:21:20.817+0000 7f03e6815640 1 -- 172.21.15.169:0/1753677538 wait complete. 2024-09-11T22:21:21.374 DEBUG:teuthology.orchestra.run.smithi045:mgr.y> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T22:21:21.377 DEBUG:teuthology.orchestra.run.smithi169:mgr.z> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T22:21:21.379 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T22:21:21.380 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:21:21.380 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:21.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:21.400 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-11 22:20:34.912558401 +0000 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-11 22:16:09.656080760 +0000 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-11 22:16:09.656080760 +0000 2024-09-11T22:21:21.460 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-11 22:16:09.656080760 +0000 2024-09-11T22:21:21.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-11T22:21:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-11T22:21:21.531 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000119583 s, 4.3 MB/s 2024-09-11T22:21:21.532 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:21.593 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:21.651 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-11 22:20:34.945557945 +0000 2024-09-11T22:21:21.652 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-11 22:16:09.973076677 +0000 2024-09-11T22:21:21.653 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-11 22:16:09.973076677 +0000 2024-09-11T22:21:21.653 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-11 22:16:09.973076677 +0000 2024-09-11T22:21:21.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:21.719 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-11T22:21:21.720 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-11T22:21:21.720 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000122844 s, 4.2 MB/s 2024-09-11T22:21:21.721 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:21.780 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:21.837 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:21.837 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-11 22:20:34.978557490 +0000 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-11 22:16:10.292072567 +0000 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-11 22:16:10.292072567 +0000 2024-09-11T22:21:21.838 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-11 22:16:10.292072567 +0000 2024-09-11T22:21:21.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-11T22:21:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-11T22:21:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000114391 s, 4.5 MB/s 2024-09-11T22:21:21.904 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:21.962 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:22.019 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:22.019 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-11 22:20:35.011557034 +0000 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-11 22:16:10.624068290 +0000 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-11 22:16:10.624068290 +0000 2024-09-11T22:21:22.020 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-11 22:16:10.624068290 +0000 2024-09-11T22:21:22.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi045=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: Saving service mgr spec with placement smithi022=x;smithi045=y;smithi169=z;count:3 2024-09-11T22:21:22.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:21 smithi022 ceph-mon[30966]: Deploying daemon mgr.z on smithi169 2024-09-11T22:21:22.084 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-11T22:21:22.084 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-11T22:21:22.084 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000107119 s, 4.8 MB/s 2024-09-11T22:21:22.086 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:22.143 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-11T22:21:22.144 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:22.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:22.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi045=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: Saving service mgr spec with placement smithi022=x;smithi045=y;smithi169=z;count:3 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:21 smithi169 ceph-mon[35628]: Deploying daemon mgr.z on smithi169 2024-09-11T22:21:22.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:22.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi045=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: Saving service mgr spec with placement smithi022=x;smithi045=y;smithi169=z;count:3 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:21 smithi045 ceph-mon[35556]: Deploying daemon mgr.z on smithi169 2024-09-11T22:21:22.164 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:22.164 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-11 22:21:08.973310461 +0000 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-11 22:16:23.427419798 +0000 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-11 22:16:23.427419798 +0000 2024-09-11T22:21:22.222 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-11 22:16:23.427419798 +0000 2024-09-11T22:21:22.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:22.288 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-11T22:21:22.289 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-11T22:21:22.289 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000121851 s, 4.2 MB/s 2024-09-11T22:21:22.290 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:22.349 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-11T22:21:22.406 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-11 22:21:08.973310461 +0000 2024-09-11T22:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-11 22:16:23.770414553 +0000 2024-09-11T22:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-11 22:16:23.770414553 +0000 2024-09-11T22:21:22.407 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-11 22:16:23.770414553 +0000 2024-09-11T22:21:22.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-11T22:21:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-11T22:21:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000143857 s, 3.6 MB/s 2024-09-11T22:21:22.473 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:22.530 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:22.586 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:22.586 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-11 22:21:08.974310445 +0000 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-11 22:16:24.088409690 +0000 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-11 22:16:24.088409690 +0000 2024-09-11T22:21:22.587 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-11 22:16:24.088409690 +0000 2024-09-11T22:21:22.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000112011 s, 4.6 MB/s 2024-09-11T22:21:22.653 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:22.710 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.766 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-11 22:21:08.974310445 +0000 2024-09-11T22:21:22.767 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-11 22:16:24.426404521 +0000 2024-09-11T22:21:22.767 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-11 22:16:24.426404521 +0000 2024-09-11T22:21:22.767 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-11 22:16:24.426404521 +0000 2024-09-11T22:21:22.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-11T22:21:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-11T22:21:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000110802 s, 4.6 MB/s 2024-09-11T22:21:22.834 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:22.890 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-11T22:21:22.891 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:22.907 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:22.907 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:22.963 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:22.963 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:22.963 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-11 22:21:22.788795785 +0000 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-11 22:16:18.497305416 +0000 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-11 22:16:18.497305416 +0000 2024-09-11T22:21:22.964 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-11 22:16:18.497305416 +0000 2024-09-11T22:21:22.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:23.027 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:22 smithi169 systemd[1]: Starting Ceph mgr.z for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:21:23.030 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-11T22:21:23.030 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-11T22:21:23.030 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000193082 s, 2.7 MB/s 2024-09-11T22:21:23.031 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:23.088 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-11 22:21:22.788795785 +0000 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-11 22:16:18.825298751 +0000 2024-09-11T22:21:23.144 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-11 22:16:18.825298751 +0000 2024-09-11T22:21:23.145 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-11 22:16:18.825298751 +0000 2024-09-11T22:21:23.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:23.222 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-11T22:21:23.222 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-11T22:21:23.222 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.0146271 s, 35.0 kB/s 2024-09-11T22:21:23.224 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:23.280 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:23.311 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 podman[37254]: 2024-09-11 22:21:22.977699492 +0000 UTC m=+0.015744470 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:23.311 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 podman[37254]: 2024-09-11 22:21:23.098184737 +0000 UTC m=+0.136229713 container create 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:21:23.311 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 podman[37254]: 2024-09-11 22:21:23.310896347 +0000 UTC m=+0.348941329 container init 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T22:21:23.326 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-11 22:21:22.788795785 +0000 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-11 22:16:19.138292390 +0000 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-11 22:16:19.138292390 +0000 2024-09-11T22:21:23.327 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-11 22:16:19.138292390 +0000 2024-09-11T22:21:23.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-11T22:21:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-11T22:21:23.391 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00018849 s, 2.7 MB/s 2024-09-11T22:21:23.392 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:23.449 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-11 22:21:22.789795765 +0000 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-11 22:16:19.453285989 +0000 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-11 22:16:19.453285989 +0000 2024-09-11T22:21:23.506 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-11 22:16:19.453285989 +0000 2024-09-11T22:21:23.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:23.568 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 podman[37254]: 2024-09-11 22:21:23.314131147 +0000 UTC m=+0.352176131 container start 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T22:21:23.568 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-mgr[37372]: -- 172.21.15.169:0/3030921918 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f25b510e0 con 0x556f25b2f400 2024-09-11T22:21:23.568 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 bash[37254]: 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a 2024-09-11T22:21:23.568 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 systemd[1]: Started Ceph mgr.z for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:23.569 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:23.438+0000 7fba900a1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:21:23.569 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:23.513+0000 7fba900a1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:21:23.571 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-11T22:21:23.571 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-11T22:21:23.571 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000170627 s, 3.0 MB/s 2024-09-11T22:21:23.572 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:23.632 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-11T22:21:23.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:21:23.879 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:23.667+0000 7fba900a1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:21:23.879 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:23.733+0000 7fba900a1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:21:23.879 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:23.878+0000 7fba900a1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:21:23.895 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:24.152 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:24.019+0000 7fba900a1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:24 smithi022 ceph-mon[30966]: Deploying daemon mgr.y on smithi045 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:24.334+0000 7fba900a1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:24.394+0000 7fba900a1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:24.580+0000 7fba900a1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:24.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:24 smithi169 ceph-mon[35628]: Deploying daemon mgr.y on smithi045 2024-09-11T22:21:24.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:24.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:24.745 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:24.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:24.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:24.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:24.746 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:24 smithi045 ceph-mon[35556]: Deploying daemon mgr.y on smithi045 2024-09-11T22:21:25.381 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 systemd[1]: Starting Ceph mgr.y for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:21:25.636 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 podman[36940]: 2024-09-11 22:21:25.311598774 +0000 UTC m=+0.016600457 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:25.636 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 podman[36940]: 2024-09-11 22:21:25.422293483 +0000 UTC m=+0.127295152 container create d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-11T22:21:25.636 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 podman[36940]: 2024-09-11 22:21:25.636002627 +0000 UTC m=+0.341004308 container init d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:21:25.902 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:25.458+0000 7fba900a1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:21:25.902 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:25.526+0000 7fba900a1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:21:25.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 podman[36940]: 2024-09-11 22:21:25.638683482 +0000 UTC m=+0.343685154 container start d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:21:25.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 ceph-mgr[36959]: -- 172.21.15.45:0/860460441 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581b09270e0 con 0x5581b0904800 2024-09-11T22:21:25.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 bash[36940]: d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 2024-09-11T22:21:25.912 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 systemd[1]: Started Ceph mgr.y for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:25.912 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:25.760+0000 7f977bb51040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:21:25.912 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:25.822+0000 7f977bb51040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:21:26.243 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:21:26.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-11T22:21:26.364 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:25.979+0000 7f977bb51040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:21:26.364 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.049+0000 7f977bb51040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:21:26.364 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.209+0000 7f977bb51040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:21:26.364 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.363+0000 7f977bb51040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:21:26.524 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:26.544 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.275+0000 7fba900a1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:21:26.544 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.395+0000 7fba900a1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:21:26.544 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.543+0000 7fba900a1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.545 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:26.622 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:26.623 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.623 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.623 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.623 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.623 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:26.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:26.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:26.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:26.837 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.616+0000 7fba900a1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:21:26.837 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.768+0000 7fba900a1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:21:26.837 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.836+0000 7fba900a1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:21:26.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.702+0000 7f977bb51040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:21:26.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.766+0000 7f977bb51040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 -- 172.21.15.22:0/1068908111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 msgr2=0x7fd330102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 --2- 172.21.15.22:0/1068908111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330102190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd324009900 tx=0x7fd32402a410 comp rx=0 tx=0).stop 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 -- 172.21.15.22:0/1068908111 shutdown_connections 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 --2- 172.21.15.22:0/1068908111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 0x7fd330108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 --2- 172.21.15.22:0/1068908111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330102190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 --2- 172.21.15.22:0/1068908111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 0x7fd330100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 -- 172.21.15.22:0/1068908111 >> 172.21.15.22:0/1068908111 conn(0x7fd3300fc2a0 msgr2=0x7fd3300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 -- 172.21.15.22:0/1068908111 shutdown_connections 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.970+0000 7fd334abe640 1 -- 172.21.15.22:0/1068908111 wait complete. 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 Processor -- start 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 -- start start 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 0x7fd330198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 0x7fd33019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd33010c8d0 con 0x7fd330101d10 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd33010c750 con 0x7fd3301026d0 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd334abe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd33010ca50 con 0x7fd330100b10 2024-09-11T22:21:26.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd32dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd32dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42624/0 (socket says 172.21.15.22:42624) 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd32dd9b640 1 -- 172.21.15.22:0/113786832 learned_addr learned my addr 172.21.15.22:0/113786832 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd32e59c640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 0x7fd330198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.971+0000 7fd32ed9d640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 0x7fd33019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 -- 172.21.15.22:0/113786832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 msgr2=0x7fd330198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 0x7fd330198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 -- 172.21.15.22:0/113786832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 msgr2=0x7fd33019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 0x7fd33019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 -- 172.21.15.22:0/113786832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33019fc30 con 0x7fd330101d10 2024-09-11T22:21:26.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd32dd9b640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd324009a20 tx=0x7fd3240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32403f030 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd324003d00 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33019fec0 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324035070 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.972+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301a0310 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.973+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd324042030 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.973+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3301a0540 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.973+0000 7fd31f7fe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 0x7fd31803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.973+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd32406cb40 con 0x7fd330101d10 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.973+0000 7fd32e59c640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 0x7fd31803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.974+0000 7fd32e59c640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 0x7fd31803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd330101b70 tx=0x7fd320005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:26.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:26.978+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd32403bd00 con 0x7fd330101d10 2024-09-11T22:21:27.133 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:26.900+0000 7fba900a1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:21:27.134 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.065+0000 7fba900a1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:21:27.134 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.133+0000 7fba900a1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:21:27.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:27.167+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd33006af90 con 0x7fd3180392c0 2024-09-11T22:21:27.396 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.198+0000 7fba900a1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:21:27.397 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.279+0000 7fba900a1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:21:27.397 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.337+0000 7fba900a1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:21:27.397 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:27.396+0000 7fba900a1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:21:27.411 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:26.967+0000 7f977bb51040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:21:27.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: Reconfiguring daemon mgr.x on smithi022 2024-09-11T22:21:27.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:27.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:27.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:27.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:27.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: Reconfiguring daemon mgr.x on smithi022 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:27.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:27.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.890 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:27.890 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.890 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.890 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.890 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: Reconfiguring daemon mgr.x on smithi022 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:27.891 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:28.161 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:27.889+0000 7f977bb51040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:21:28.161 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:27.959+0000 7f977bb51040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:21:28.589 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:21:28.182+0000 7fba900a1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:21:28.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:28.591+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fd32403b460 con 0x7fd330101d10 2024-09-11T22:21:28.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:28 smithi022 ceph-mon[30966]: Standby manager daemon z started 2024-09-11T22:21:28.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:28 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:21:28.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:28 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:28.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:28 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:21:28.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:28 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-mon[35628]: Standby manager daemon z started 2024-09-11T22:21:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:21:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:21:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:28 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:28.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:28.705+0000 7f977bb51040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:21:28.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:28.824+0000 7f977bb51040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:21:28.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-mon[35556]: Standby manager daemon z started 2024-09-11T22:21:28.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:21:28.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:28.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:21:28.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/2430011135' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:29.263 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:28.971+0000 7f977bb51040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:21:29.263 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.034+0000 7f977bb51040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:21:29.263 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.191+0000 7f977bb51040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:21:29.263 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.261+0000 7f977bb51040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:21:29.556 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.323+0000 7f977bb51040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:21:29.556 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.487+0000 7f977bb51040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:21:29.556 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.554+0000 7f977bb51040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:21:29.832 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.623+0000 7f977bb51040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.708+0000 7f977bb51040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.770+0000 7f977bb51040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:29.831+0000 7f977bb51040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:21:29.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:29.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:29.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:29.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:30.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:21:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:21:30.651+0000 7f977bb51040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:21:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:31.600+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd32403aca0 con 0x7fd330101d10 2024-09-11T22:21:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: Standby manager daemon y started 2024-09-11T22:21:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:21:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]: dispatch 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]': finished 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:31.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3275354945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: Standby manager daemon y started 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]': finished 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:31.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3275354945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:21:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: Standby manager daemon y started 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/2677213620' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4098134712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ce2c7a9-daf0-4fe8-b457-6fd038545b3d"}]': finished 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:31.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3275354945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:21:32.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:32 smithi022 ceph-mon[30966]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-11T22:21:32.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:21:32.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:32 smithi169 ceph-mon[35628]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-11T22:21:32.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:21:32.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:32 smithi045 ceph-mon[35556]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-11T22:21:32.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:21:33.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:33 smithi022 ceph-mon[30966]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:33 smithi169 ceph-mon[35628]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:33 smithi045 ceph-mon[35556]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:35.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:35 smithi022 ceph-mon[30966]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:35 smithi169 ceph-mon[35628]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:35 smithi045 ceph-mon[35556]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:37.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:37 smithi022 ceph-mon[30966]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:37 smithi169 ceph-mon[35628]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:37 smithi045 ceph-mon[35556]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:39 smithi022 ceph-mon[30966]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:21:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:39 smithi022 ceph-mon[30966]: Deploying daemon osd.0 on smithi022 2024-09-11T22:21:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:39 smithi169 ceph-mon[35628]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:39 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:21:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:39 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:39 smithi169 ceph-mon[35628]: Deploying daemon osd.0 on smithi022 2024-09-11T22:21:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:39 smithi045 ceph-mon[35556]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:39 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:21:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:39 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:39 smithi045 ceph-mon[35556]: Deploying daemon osd.0 on smithi022 2024-09-11T22:21:41.741 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:41 smithi022 ceph-mon[30966]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:41 smithi169 ceph-mon[35628]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:41 smithi045 ceph-mon[35556]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:43 smithi022 ceph-mon[30966]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:43.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:43 smithi169 ceph-mon[35628]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:43 smithi045 ceph-mon[35556]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:45.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:45 smithi022 ceph-mon[30966]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:45 smithi169 ceph-mon[35628]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:45.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:45 smithi045 ceph-mon[35556]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:48.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:47 smithi022 ceph-mon[30966]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:48.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:47 smithi169 ceph-mon[35628]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:48.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:47 smithi045 ceph-mon[35556]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:49.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:49.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:49.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:49.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:49.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.077+0000 7fd31f7fe640 1 -- 172.21.15.22:0/113786832 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd33006af90 con 0x7fd3180392c0 2024-09-11T22:21:50.078 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 msgr2=0x7fd31803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 0x7fd31803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd330101b70 tx=0x7fd320005f90 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 msgr2=0x7fd330198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd324009a20 tx=0x7fd3240042f0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 shutdown_connections 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3301026d0 0x7fd33019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd330101d10 0x7fd330198540 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd3180392c0 0x7fd31803b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 --2- 172.21.15.22:0/113786832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd330100b10 0x7fd330198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 >> 172.21.15.22:0/113786832 conn(0x7fd3300fc2a0 msgr2=0x7fd33006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 shutdown_connections 2024-09-11T22:21:50.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:21:50.080+0000 7fd334abe640 1 -- 172.21.15.22:0/113786832 wait complete. 2024-09-11T22:21:50.742 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:50 smithi022 ceph-mon[30966]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.743 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:50.743 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.743 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.769 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T22:21:50.772 INFO:tasks.cephadm:Deploying osd.1 on smithi045 with /dev/vg_nvme/lv_4... 2024-09-11T22:21:50.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:21:50.800 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:50 smithi045 ceph-mon[35556]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.800 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:50.800 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.800 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:50 smithi169 ceph-mon[35628]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:50.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:50.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:52.204 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:21:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:21:52.018+0000 7f962c007640 -1 osd.0 0 log_to_monitors true 2024-09-11T22:21:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:52 smithi022 ceph-mon[30966]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:52 smithi022 ceph-mon[30966]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:21:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:52 smithi045 ceph-mon[35556]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:52 smithi045 ceph-mon[35556]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:21:52.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:52 smithi169 ceph-mon[35628]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:52 smithi169 ceph-mon[35628]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:21:53.437 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_4 2024-09-11T22:21:53.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:21:53.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:21:53.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:21:53.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:53.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:21:53.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:21:53.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:53.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:21:53.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:21:53.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:21:53.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:53.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:21:53.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:21:53.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:53.727 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:21:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:21:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:21:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:21:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:21:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:21:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 -- 172.21.15.45:0/1717131370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 msgr2=0x7f89c0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 --2- 172.21.15.45:0/1717131370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c0102190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009900 tx=0x7f89b402a410 comp rx=0 tx=0).stop 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 -- 172.21.15.45:0/1717131370 shutdown_connections 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 --2- 172.21.15.45:0/1717131370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c01026d0 0x7f89c0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 --2- 172.21.15.45:0/1717131370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c0102190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 --2- 172.21.15.45:0/1717131370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c0100b10 0x7f89c0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 -- 172.21.15.45:0/1717131370 >> 172.21.15.45:0/1717131370 conn(0x7f89c00fc2a0 msgr2=0x7f89c00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 -- 172.21.15.45:0/1717131370 shutdown_connections 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.169+0000 7f89c56e2640 1 -- 172.21.15.45:0/1717131370 wait complete. 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 Processor -- start 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 -- start start 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 0x7f89c0104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c01026d0 0x7f89c0103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010c920 con 0x7f89c0100b10 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010c7a0 con 0x7f89c0101d10 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.170+0000 7f89c56e2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89c010caa0 con 0x7f89c01026d0 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43932/0 (socket says 172.21.15.45:43932) 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 -- 172.21.15.45:0/3320904966 learned_addr learned my addr 172.21.15.45:0/3320904966 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89beffd640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 0x7f89c0104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89bf7fe640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c01026d0 0x7f89c0103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 -- 172.21.15.45:0/3320904966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c01026d0 msgr2=0x7f89c0103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c01026d0 0x7f89c0103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 -- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 msgr2=0x7f89c0104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 0x7f89c0104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 -- 172.21.15.45:0/3320904966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c0103ef0 con 0x7f89c0101d10 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89beffd640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 0x7f89c0104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89be7fc640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89b40316a0 tx=0x7f89b4032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b403f030 con 0x7f89c0101d10 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f89b4003d00 con 0x7f89c0101d10 2024-09-11T22:21:54.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c01a2130 con 0x7f89c0101d10 2024-09-11T22:21:54.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4035070 con 0x7f89c0101d10 2024-09-11T22:21:54.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.171+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c01a25e0 con 0x7f89c0101d10 2024-09-11T22:21:54.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.172+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c01a2810 con 0x7f89c0101d10 2024-09-11T22:21:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.174+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f89b4042030 con 0x7f89c0101d10 2024-09-11T22:21:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.175+0000 7f89a7fff640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 0x7f89a80a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.175+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f89b40edc50 con 0x7f89c0101d10 2024-09-11T22:21:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.175+0000 7f89beffd640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 0x7f89a80a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.175+0000 7f89beffd640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 0x7f89a80a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009fd0 tx=0x7f89b0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.178+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89b40bc0f0 con 0x7f89c0101d10 2024-09-11T22:21:54.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:21:54.364+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f89c00fe460 con 0x7f89a80a2af0 2024-09-11T22:21:54.463 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:21:54.152+0000 7f9627767640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T22:21:54.463 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:21:54.155+0000 7f961fd99640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.770 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.771 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' 2024-09-11T22:21:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455]' entity='osd.0' 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi022 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] boot 2024-09-11T22:21:55.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:21:55.774 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:55 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi022 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] boot 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:21:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi022 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: osd.0 [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] boot 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:21:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:55 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:21:56.637 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:56 smithi045 ceph-mon[35556]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:56.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:56 smithi022 ceph-mon[30966]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:56.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:56 smithi169 ceph-mon[35628]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/1225129476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]': finished 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:21:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:21:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/1225129476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]': finished 2024-09-11T22:21:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:21:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/1225129476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]: dispatch 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "068e27f1-5aa0-45db-b7b3-510f8a0ad96a"}]': finished 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:21:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:21:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:58 smithi022 ceph-mon[30966]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:21:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:21:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/1226454635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:21:58.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:58 smithi169 ceph-mon[35628]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:21:58.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:21:58 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/1226454635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:21:58.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:58 smithi045 ceph-mon[35556]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:21:58.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:21:58 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/1226454635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:00.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:00 smithi022 ceph-mon[30966]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:00.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:00 smithi169 ceph-mon[35628]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:00.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:00 smithi045 ceph-mon[35556]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:02.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:02 smithi045 ceph-mon[35556]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:02.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:02 smithi022 ceph-mon[30966]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:02.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:02 smithi169 ceph-mon[35628]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:04.610 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:04 smithi045 ceph-mon[35556]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:04.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:04 smithi022 ceph-mon[30966]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:04.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:04 smithi169 ceph-mon[35628]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:05.776 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:05 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:05.776 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:05 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:05.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:05.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:06.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:06 smithi045 ceph-mon[35556]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:06.773 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:06 smithi045 ceph-mon[35556]: Deploying daemon osd.1 on smithi045 2024-09-11T22:22:06.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:06 smithi022 ceph-mon[30966]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:06.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:06 smithi022 ceph-mon[30966]: Deploying daemon osd.1 on smithi045 2024-09-11T22:22:06.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:06 smithi169 ceph-mon[35628]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:06.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:06 smithi169 ceph-mon[35628]: Deploying daemon osd.1 on smithi045 2024-09-11T22:22:08.617 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:08 smithi045 ceph-mon[35556]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:08.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:08 smithi022 ceph-mon[30966]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:08.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:08 smithi169 ceph-mon[35628]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:10.762 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:10 smithi045 ceph-mon[35556]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:10.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:10 smithi022 ceph-mon[30966]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:10 smithi169 ceph-mon[35628]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:12 smithi045 ceph-mon[35556]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:12.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:12.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:12.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:12 smithi022 ceph-mon[30966]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:12 smithi169 ceph-mon[35628]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:15.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.796+0000 7f89a7fff640 1 -- 172.21.15.45:0/3320904966 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f89c00fe460 con 0x7f89a80a2af0 2024-09-11T22:22:15.797 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 1 on host 'smithi045' 2024-09-11T22:22:15.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 msgr2=0x7f89a80a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 0x7f89a80a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009fd0 tx=0x7f89b0009680 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 msgr2=0x7f89c01030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f89b40316a0 tx=0x7f89b4032d70 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 shutdown_connections 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89a80a2af0 0x7f89a80a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c01026d0 0x7f89c0103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c0101d10 0x7f89c01030f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 --2- 172.21.15.45:0/3320904966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89c0100b10 0x7f89c0104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 >> 172.21.15.45:0/3320904966 conn(0x7f89c00fc2a0 msgr2=0x7f89c00fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 shutdown_connections 2024-09-11T22:22:15.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:22:15.799+0000 7f89c56e2640 1 -- 172.21.15.45:0/3320904966 wait complete. 2024-09-11T22:22:16.383 DEBUG:teuthology.orchestra.run.smithi045:osd.1> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T22:22:16.385 INFO:tasks.cephadm:Deploying osd.2 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-11T22:22:16.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:22:16.601 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:16 smithi045 ceph-mon[35556]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:16.601 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:16.601 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:16.601 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:22:16.763 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:16 smithi169 ceph-mon[35628]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:16.763 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:16.763 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:16.763 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:16.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:16 smithi022 ceph-mon[30966]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:18.089 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:22:17.957+0000 7f4b3f320640 -1 osd.1 0 log_to_monitors true 2024-09-11T22:22:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:18 smithi169 ceph-mon[35628]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:18 smithi169 ceph-mon[35628]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:18 smithi169 ceph-mon[35628]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.887 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:18 smithi045 ceph-mon[35556]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:18.887 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:18 smithi045 ceph-mon[35556]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.887 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:18 smithi045 ceph-mon[35556]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:18 smithi022 ceph-mon[30966]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:18 smithi022 ceph-mon[30966]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:18 smithi022 ceph-mon[30966]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:18.993 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:22:19.022 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-11T22:22:19.281 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:22:19.643 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:19.643 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:19.643 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.643 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:19.644 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.644 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.644 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.644 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:19.644 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.645 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:19.645 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:19.645 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.645 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:19 smithi169 ceph-mon[35628]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:22:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.726+0000 7fbccf87d640 1 -- 172.21.15.169:0/3983648745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8102690 msgr2=0x7fbcc8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.726+0000 7fbccf87d640 1 --2- 172.21.15.169:0/3983648745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8102690 0x7fbcc8108f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009ca0 tx=0x7fbcc002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 -- 172.21.15.169:0/3983648745 shutdown_connections 2024-09-11T22:22:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 --2- 172.21.15.169:0/3983648745 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8102690 0x7fbcc8108f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 --2- 172.21.15.169:0/3983648745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8101cd0 0x7fbcc8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 --2- 172.21.15.169:0/3983648745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8100ad0 0x7fbcc8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 -- 172.21.15.169:0/3983648745 >> 172.21.15.169:0/3983648745 conn(0x7fbcc80fc280 msgr2=0x7fbcc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 -- 172.21.15.169:0/3983648745 shutdown_connections 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 -- 172.21.15.169:0/3983648745 wait complete. 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 Processor -- start 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.727+0000 7fbccf87d640 1 -- start start 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8100ad0 0x7fbcc8197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 0x7fbcc819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810c890 con 0x7fbcc8102690 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810c710 con 0x7fbcc8100ad0 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810ca10 con 0x7fbcc8101cd0 2024-09-11T22:22:19.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:37846/0 (socket says 172.21.15.169:37846) 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccd619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8100ad0 0x7fbcc8197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 -- 172.21.15.169:0/2980448773 learned_addr learned my addr 172.21.15.169:0/2980448773 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccde1a640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 0x7fbcc819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 -- 172.21.15.169:0/2980448773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8100ad0 msgr2=0x7fbcc8197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8100ad0 0x7fbcc8197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 -- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 msgr2=0x7fbcc819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 0x7fbcc819f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 -- 172.21.15.169:0/2980448773 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc819fab0 con 0x7fbcc8101cd0 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccde1a640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 0x7fbcc819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:19.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccce18640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400d950 tx=0x7fbcc400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4017030 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcc4004020 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc819fda0 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.728+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4004a00 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.729+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81a0260 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.730+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc81a0520 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.731+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fbcc40041d0 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.732+0000 7fbcbe7fc640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 0x7fbcb40a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.732+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fbcc40cd650 con 0x7fbcc8101cd0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.732+0000 7fbccd619640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 0x7fbcb40a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.733+0000 7fbccd619640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 0x7fbcb40a5060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8101b30 tx=0x7fbcb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:19.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.735+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbcc409bfa0 con 0x7fbcc8101cd0 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:19 smithi022 ceph-mon[30966]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:22:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:19.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:19 smithi045 ceph-mon[35556]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:22:19.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:19.919+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbcc81a06f0 con 0x7fbcb40a2ba0 2024-09-11T22:22:20.411 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:22:20.151+0000 7f4b3aa80640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T22:22:20.411 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:22:20.155+0000 7f4b330b2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:22:20.563 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi045 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='osd.1 ' entity='osd.1' 2024-09-11T22:22:20.564 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:20.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi045 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='osd.1 ' entity='osd.1' 2024-09-11T22:22:20.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi045 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='osd.1 ' entity='osd.1' 2024-09-11T22:22:20.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:21.796 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:22:21.797 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:22:21.797 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:21.797 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] boot 2024-09-11T22:22:21.797 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:21.797 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:21 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] boot 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:21 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:22:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:22:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:21.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: osd.1 [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] boot 2024-09-11T22:22:21.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:21.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:21 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:22.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/2614268638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:22 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:22 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]': finished 2024-09-11T22:22:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:22 smithi169 ceph-mon[35628]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T22:22:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/2614268638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:22 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:22 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]': finished 2024-09-11T22:22:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:22 smithi022 ceph-mon[30966]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T22:22:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:22.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/2614268638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:22 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]: dispatch 2024-09-11T22:22:22.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:22 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba0cdee8-b78e-4cff-8899-6108f3a3f633"}]': finished 2024-09-11T22:22:22.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:22 smithi045 ceph-mon[35556]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T22:22:22.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:23 smithi022 ceph-mon[30966]: pgmap v62: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:23 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/4031347517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:23 smithi169 ceph-mon[35628]: pgmap v62: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:23 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/4031347517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:23 smithi045 ceph-mon[35556]: pgmap v62: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:23 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/4031347517' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:25.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:25 smithi022 ceph-mon[30966]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:25 smithi169 ceph-mon[35628]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:25 smithi045 ceph-mon[35556]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:27.866 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:27 smithi169 ceph-mon[35628]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:27.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:27 smithi022 ceph-mon[30966]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:27 smithi045 ceph-mon[35556]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:29 smithi022 ceph-mon[30966]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:29.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:29 smithi169 ceph-mon[35628]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:29 smithi045 ceph-mon[35556]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:30 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:22:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:30 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:30.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:22:30.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:30.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:30 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:22:30.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:30 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:31.802 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:31 smithi169 ceph-mon[35628]: Deploying daemon osd.2 on smithi169 2024-09-11T22:22:31.802 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:31 smithi169 ceph-mon[35628]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:31 smithi022 ceph-mon[30966]: Deploying daemon osd.2 on smithi169 2024-09-11T22:22:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:31 smithi022 ceph-mon[30966]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:31 smithi045 ceph-mon[35556]: Deploying daemon osd.2 on smithi169 2024-09-11T22:22:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:31 smithi045 ceph-mon[35556]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:33.829 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:33 smithi169 ceph-mon[35628]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:33.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:33 smithi022 ceph-mon[30966]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:33 smithi045 ceph-mon[35556]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:35.640 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:35 smithi169 ceph-mon[35628]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:35.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:35 smithi022 ceph-mon[30966]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:35 smithi045 ceph-mon[35556]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:37 smithi022 ceph-mon[30966]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:37 smithi169 ceph-mon[35628]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:37.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:37.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:37.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:37 smithi045 ceph-mon[35556]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:40.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.876+0000 7fbcbe7fc640 1 -- 172.21.15.169:0/2980448773 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbcc81a06f0 con 0x7fbcb40a2ba0 2024-09-11T22:22:40.877 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 2 on host 'smithi169' 2024-09-11T22:22:40.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 msgr2=0x7fbcb40a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:40.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 0x7fbcb40a5060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8101b30 tx=0x7fbcb8005f90 comp rx=0 tx=0).stop 2024-09-11T22:22:40.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 msgr2=0x7fbcc81983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:40.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400d950 tx=0x7fbcc400de10 comp rx=0 tx=0).stop 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 shutdown_connections 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102690 0x7fbcc819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcb40a2ba0 0x7fbcb40a5060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcc8101cd0 0x7fbcc81983c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 --2- 172.21.15.169:0/2980448773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc8100ad0 0x7fbcc8197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.878+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 >> 172.21.15.169:0/2980448773 conn(0x7fbcc80fc280 msgr2=0x7fbcc80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.879+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 shutdown_connections 2024-09-11T22:22:40.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:22:40.879+0000 7fbccf87d640 1 -- 172.21.15.169:0/2980448773 wait complete. 2024-09-11T22:22:41.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:41.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:41.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:41.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:41.473 DEBUG:teuthology.orchestra.run.smithi169:osd.2> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T22:22:41.476 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-11T22:22:41.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:22:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:22:42.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:42 smithi022 ceph-mon[30966]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:42.348 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:42 smithi169 ceph-mon[35628]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:42.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:42 smithi045 ceph-mon[35556]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:43.403 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:22:43.155+0000 7fd270388640 -1 osd.2 0 log_to_monitors true 2024-09-11T22:22:44.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:44 smithi169 ceph-mon[35628]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:44.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:44 smithi169 ceph-mon[35628]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:44 smithi169 ceph-mon[35628]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.224 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:44 smithi022 ceph-mon[30966]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:44.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:44 smithi022 ceph-mon[30966]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:44 smithi022 ceph-mon[30966]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:44 smithi045 ceph-mon[35556]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:44 smithi045 ceph-mon[35556]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:44 smithi045 ceph-mon[35556]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:22:44.536 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:22:44.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-11T22:22:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:22:45.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:22:45.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:45.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:45.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi169 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:45.314 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:22:45.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:45.319 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi169 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:45.320 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:22:45.043+0000 7fd26bae8640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T22:22:45.403 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:22:45.047+0000 7fd268122640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi169 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:45.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-11T22:22:45.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:45.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:45.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 -- 172.21.15.22:0/610438813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 msgr2=0x7f9f0c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 --2- 172.21.15.22:0/610438813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c108f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009ca0 tx=0x7f9f0402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 -- 172.21.15.22:0/610438813 shutdown_connections 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 --2- 172.21.15.22:0/610438813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c108f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 --2- 172.21.15.22:0/610438813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 --2- 172.21.15.22:0/610438813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c100ad0 0x7f9f0c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 -- 172.21.15.22:0/610438813 >> 172.21.15.22:0/610438813 conn(0x7f9f0c0fc280 msgr2=0x7f9f0c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 -- 172.21.15.22:0/610438813 shutdown_connections 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.406+0000 7f9f124a7640 1 -- 172.21.15.22:0/610438813 wait complete. 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 Processor -- start 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 -- start start 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c100ad0 0x7f9f0c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c10c890 con 0x7f9f0c102690 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c10c710 con 0x7f9f0c101cd0 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f124a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c10ca10 con 0x7f9f0c100ad0 2024-09-11T22:22:45.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33064/0 (socket says 172.21.15.22:33064) 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 -- 172.21.15.22:0/3673061780 learned_addr learned my addr 172.21.15.22:0/3673061780 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f0bfff640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c100ad0 0x7f9f0c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 -- 172.21.15.22:0/3673061780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c100ad0 msgr2=0x7f9f0c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c100ad0 0x7f9f0c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 -- 172.21.15.22:0/3673061780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 msgr2=0x7f9f0c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.407+0000 7f9f10a44640 1 -- 172.21.15.22:0/3673061780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c19fbb0 con 0x7f9f0c102690 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f0b7fe640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f10a44640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031ae0 tx=0x7f9f04031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0402fae0 con 0x7f9f0c102690 2024-09-11T22:22:45.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f0402fc80 con 0x7f9f0c102690 2024-09-11T22:22:45.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c19fde0 con 0x7f9f0c102690 2024-09-11T22:22:45.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040468a0 con 0x7f9f0c102690 2024-09-11T22:22:45.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.408+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a0340 con 0x7f9f0c102690 2024-09-11T22:22:45.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.409+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0c107e80 con 0x7f9f0c102690 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.411+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f9f04030b50 con 0x7f9f0c102690 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.412+0000 7f9f097fa640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 0x7f9ef40a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.412+0000 7f9f0bfff640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 0x7f9ef40a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.412+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f9f040ef010 con 0x7f9f0c102690 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.413+0000 7f9f0bfff640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 0x7f9ef40a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c101b30 tx=0x7f9efc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:45.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.415+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f040821b0 con 0x7f9f0c102690 2024-09-11T22:22:45.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:45.600+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9f0c062630 con 0x7f9ef40a2b70 2024-09-11T22:22:46.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:46.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:22:46.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:22:46.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:46.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:46.275 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:46.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:46.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:46.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] boot 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T22:22:47.092 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:47.093 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:47.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] boot 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:47.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:47 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:47.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:22:47.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:22:47.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:47.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: osd.2 [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] boot 2024-09-11T22:22:47.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T22:22:47.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:47.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:47 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:48.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:48 smithi022 ceph-mon[30966]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:48.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:48 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:48.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:48 smithi022 ceph-mon[30966]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:22:48.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:48 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:48 smithi169 ceph-mon[35628]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:48.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:48 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:48.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:48 smithi169 ceph-mon[35628]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:22:48.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:48 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:48 smithi045 ceph-mon[35556]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:48 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:48.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:48 smithi045 ceph-mon[35556]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:22:48.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:48 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:22:48.901 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:48 smithi022 sudo[46985]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:48.902 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:48 smithi022 sudo[46985]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:48.902 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:48 smithi022 sudo[46985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:48.902 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:48 smithi022 sudo[46985]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:22:49.076+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9f040b9590 con 0x7f9f0c102690 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]: dispatch 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]': finished 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:22:49.342 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:49.343 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:49 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1981502072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]: dispatch 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]': finished 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:49 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1981502072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:49.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:49 smithi022 sudo[47037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:49.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:49 smithi022 sudo[47037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:49.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:49 smithi022 sudo[47037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:49.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:22:49 smithi022 sudo[47037]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:49.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:22:49.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:22:49.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]: dispatch 2024-09-11T22:22:49.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3184389771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22b6ed2c-e6fe-4acc-86b8-802ab9dc3732"}]': finished 2024-09-11T22:22:49.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:22:49.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:49.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:49 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1981502072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:49.610 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43805]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:49.610 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43805]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:49.610 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:49.610 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43805]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:49.911 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43808]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:49.911 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:49.911 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:49.911 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:22:49 smithi045 sudo[43808]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.139 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.139 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:49 smithi169 sudo[44722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:50.139 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:49 smithi169 sudo[44722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:50.139 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:49 smithi169 sudo[44722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:50.140 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:49 smithi169 sudo[44722]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:50 smithi169 sudo[44725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:50.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:50 smithi169 sudo[44725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:50.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:50 smithi169 sudo[44725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:50.403 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:22:50 smithi169 sudo[44725]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:22:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:22:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:22:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:50.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 sudo[47418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:50.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 sudo[47418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:50.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 sudo[47418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:50.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:50 smithi022 sudo[47418]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:51 smithi022 sudo[47455]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:51 smithi022 sudo[47455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:51 smithi022 sudo[47455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:51 smithi022 sudo[47455]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:51.566 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44728]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:51.567 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44728]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:51.567 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:51.567 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44728]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44731]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44731]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:51 smithi169 sudo[44731]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:52.127 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:51 smithi045 sudo[43811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:22:52.128 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:51 smithi045 sudo[43811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:52.128 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:51 smithi045 sudo[43811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:52.128 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:51 smithi045 sudo[43811]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:52.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:52.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:52.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:52.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:52 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:52.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:52.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:52.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:52.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:52.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:52 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:52.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 sudo[43814]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:22:52.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 sudo[43814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:22:52.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 sudo[43814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:22:52.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 sudo[43814]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:22:52.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:22:52.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:52.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:52.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:52.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:52.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:52.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:52 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:53 smithi022 ceph-mon[30966]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:53.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:53 smithi169 ceph-mon[35628]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:22:53.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:22:53.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:22:53.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:53 smithi045 ceph-mon[35556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:22:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:54 smithi022 ceph-mon[30966]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:54.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:54 smithi169 ceph-mon[35628]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:54.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:54 smithi045 ceph-mon[35556]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:56 smithi022 ceph-mon[30966]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:56.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:56 smithi169 ceph-mon[35628]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:56 smithi045 ceph-mon[35556]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:22:57.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:22:57.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:57.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:22:57.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:57.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:22:57.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:58.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:58 smithi022 ceph-mon[30966]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T22:22:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:22:58 smithi022 ceph-mon[30966]: Deploying daemon osd.3 on smithi022 2024-09-11T22:22:58.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:58 smithi169 ceph-mon[35628]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T22:22:58.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:22:58 smithi169 ceph-mon[35628]: Deploying daemon osd.3 on smithi022 2024-09-11T22:22:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:58 smithi045 ceph-mon[35556]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-11T22:22:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:22:58 smithi045 ceph-mon[35556]: Deploying daemon osd.3 on smithi022 2024-09-11T22:23:00.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:00 smithi169 ceph-mon[35628]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T22:23:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:00 smithi045 ceph-mon[35556]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T22:23:00.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:00 smithi022 ceph-mon[30966]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-11T22:23:02.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:02 smithi022 ceph-mon[30966]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T22:23:02.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:02 smithi045 ceph-mon[35556]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T22:23:02.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:02 smithi169 ceph-mon[35628]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-11T22:23:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:04 smithi022 ceph-mon[30966]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T22:23:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:04 smithi045 ceph-mon[35556]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T22:23:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:04.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:04 smithi169 ceph-mon[35628]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-11T22:23:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:07.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.691+0000 7f9f097fa640 1 -- 172.21.15.22:0/3673061780 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9f0c062630 con 0x7f9ef40a2b70 2024-09-11T22:23:07.693 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 msgr2=0x7f9ef40a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 0x7f9ef40a5030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c101b30 tx=0x7f9efc005f90 comp rx=0 tx=0).stop 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 msgr2=0x7f9f0c19f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f04031ae0 tx=0x7f9f04031ee0 comp rx=0 tx=0).stop 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 shutdown_connections 2024-09-11T22:23:07.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f0c102690 0x7f9f0c19f2a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f0c101cd0 0x7f9f0c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9ef40a2b70 0x7f9ef40a5030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 --2- 172.21.15.22:0/3673061780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f0c100ad0 0x7f9f0c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.694+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 >> 172.21.15.22:0/3673061780 conn(0x7f9f0c0fc280 msgr2=0x7f9f0c105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.695+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 shutdown_connections 2024-09-11T22:23:07.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:23:07.695+0000 7f9f124a7640 1 -- 172.21.15.22:0/3673061780 wait complete. 2024-09-11T22:23:08.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:08 smithi022 ceph-mon[30966]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:08.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.389 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T22:23:08.392 INFO:tasks.cephadm:Deploying osd.4 on smithi045 with /dev/vg_nvme/lv_3... 2024-09-11T22:23:08.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:23:08.419 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:08 smithi045 ceph-mon[35556]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:08.420 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.420 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.420 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:08 smithi169 ceph-mon[35628]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-11T22:23:08.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:23:09.550 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:23:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:23:09.374+0000 7ff5c6a79640 -1 osd.3 0 log_to_monitors true 2024-09-11T22:23:10.368 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:10 smithi045 ceph-mon[35556]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:10.369 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:10 smithi045 ceph-mon[35556]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:10 smithi022 ceph-mon[30966]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:10 smithi022 ceph-mon[30966]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:10.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:10 smithi169 ceph-mon[35628]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:10.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:10 smithi169 ceph-mon[35628]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:11.176 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:23:11.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_3 2024-09-11T22:23:11.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-mon[30966]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:11.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-mon[30966]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:11.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-mon[30966]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:23:11.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:11.241 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:23:11.176+0000 7ff5c21d9640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T22:23:11.241 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:23:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:23:11.183+0000 7ff5be813640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:23:11.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:11 smithi169 ceph-mon[35628]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:11.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:11 smithi169 ceph-mon[35628]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:11.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:11 smithi169 ceph-mon[35628]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:23:11.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:11 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:11.480 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:11 smithi045 ceph-mon[35556]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:11.480 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:11 smithi045 ceph-mon[35556]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:11.480 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:11 smithi045 ceph-mon[35556]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:23:11.481 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:11 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:11.505 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:23:11.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 -- 172.21.15.45:0/3191452509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8102ef0 msgr2=0x7f62f8103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:11.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 --2- 172.21.15.45:0/3191452509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8102ef0 0x7f62f8103370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec02a410 comp rx=0 tx=0).stop 2024-09-11T22:23:11.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 -- 172.21.15.45:0/3191452509 shutdown_connections 2024-09-11T22:23:11.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 --2- 172.21.15.45:0/3191452509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f81038b0 0x7f62f810a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 --2- 172.21.15.45:0/3191452509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8102ef0 0x7f62f8103370 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 --2- 172.21.15.45:0/3191452509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 -- 172.21.15.45:0/3191452509 >> 172.21.15.45:0/3191452509 conn(0x7f62f80fba80 msgr2=0x7f62f80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 -- 172.21.15.45:0/3191452509 shutdown_connections 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.960+0000 7f62ff328640 1 -- 172.21.15.45:0/3191452509 wait complete. 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 Processor -- start 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 -- start start 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102ef0 0x7f62f8100ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810d9c0 con 0x7f62f80fff10 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810d840 con 0x7f62f81038b0 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62ff328640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62f810db40 con 0x7f62f8102ef0 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62fd8c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62fd8c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54302/0 (socket says 172.21.15.45:54302) 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62fd8c5640 1 -- 172.21.15.45:0/2241661391 learned_addr learned my addr 172.21.15.45:0/2241661391 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.961+0000 7f62fd0c4640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fc8c3640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102ef0 0x7f62f8100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 -- 172.21.15.45:0/2241661391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102ef0 msgr2=0x7f62f8100ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102ef0 0x7f62f8100ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 -- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 msgr2=0x7f62f8102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 -- 172.21.15.45:0/2241661391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f8101ca0 con 0x7f62f81038b0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd0c4640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62fd8c5640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62f000d750 tx=0x7f62f000dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0017070 con 0x7f62f81038b0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62f0005520 con 0x7f62f81038b0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f81a2180 con 0x7f62f81038b0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0004e00 con 0x7f62f81038b0 2024-09-11T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.962+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a2640 con 0x7f62f81038b0 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.964+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f81090f0 con 0x7f62f81038b0 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.964+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f62f0004fa0 con 0x7f62f81038b0 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.965+0000 7f62f67fc640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 0x7f62e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.965+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f62f00cd660 con 0x7f62f81038b0 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.966+0000 7f62fd0c4640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 0x7f62e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.966+0000 7f62fd0c4640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 0x7f62e00a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62f8069d70 tx=0x7f62e800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:11.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:11.970+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62f009b2b0 con 0x7f62f81038b0 2024-09-11T22:23:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:12.155+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f62f8062630 con 0x7f62e00a2b80 2024-09-11T22:23:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi022 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:12.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:12.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:12.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:12.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi022 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi022 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:12.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:12.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:13.505 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] boot 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.506 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:13 smithi045 ceph-mon[35556]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] boot 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:13 smithi169 ceph-mon[35628]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:13.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: osd.3 [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] boot 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:13 smithi022 ceph-mon[30966]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:14 smithi045 ceph-mon[35556]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:14 smithi045 ceph-mon[35556]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:14.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:14 smithi022 ceph-mon[30966]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:14.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:14 smithi022 ceph-mon[30966]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:14.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:14 smithi169 ceph-mon[35628]: pgmap v97: 1 pgs: 1 peering; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:14.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:14 smithi169 ceph-mon[35628]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:15.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/1881283918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]': finished 2024-09-11T22:23:15.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T22:23:15.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:15.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:15 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/727280037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/1881283918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]': finished 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:15.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:15 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/727280037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/1881283918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]: dispatch 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d411e693-5da4-47da-b529-f9d158ac5586"}]': finished 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:15.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:15 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/727280037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:16.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:16 smithi022 ceph-mon[30966]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:16 smithi022 ceph-mon[30966]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T22:23:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:16 smithi169 ceph-mon[35628]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:16 smithi169 ceph-mon[35628]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T22:23:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:16 smithi045 ceph-mon[35556]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:16 smithi045 ceph-mon[35556]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T22:23:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:18.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:18 smithi022 ceph-mon[30966]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:23:18.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:18 smithi169 ceph-mon[35628]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:23:18.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:18 smithi045 ceph-mon[35556]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:23:20.804 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:20 smithi045 ceph-mon[35556]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:23:20.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:20 smithi022 ceph-mon[30966]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:23:20.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:20 smithi169 ceph-mon[35628]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:23:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:22 smithi022 ceph-mon[30966]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:23:22.792 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:22 smithi045 ceph-mon[35556]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:23:22.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:22 smithi169 ceph-mon[35628]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:23:23.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:23 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:23 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:23 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:23 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:23 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:23 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:24.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:24 smithi045 ceph-mon[35556]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:24.784 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:24 smithi045 ceph-mon[35556]: Deploying daemon osd.4 on smithi045 2024-09-11T22:23:24.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:24 smithi022 ceph-mon[30966]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:24.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:24 smithi022 ceph-mon[30966]: Deploying daemon osd.4 on smithi045 2024-09-11T22:23:24.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:24 smithi169 ceph-mon[35628]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:24.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:24 smithi169 ceph-mon[35628]: Deploying daemon osd.4 on smithi045 2024-09-11T22:23:26.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:26 smithi045 ceph-mon[35556]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:23:26.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:26 smithi022 ceph-mon[30966]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:23:26.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:26 smithi169 ceph-mon[35628]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:23:28.877 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:28 smithi045 ceph-mon[35556]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T22:23:28.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:28 smithi022 ceph-mon[30966]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T22:23:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:28 smithi169 ceph-mon[35628]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T22:23:29.800 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:29.801 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:29.801 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:29.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:30.785 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:30 smithi045 ceph-mon[35556]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:30.803 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:30 smithi169 ceph-mon[35628]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:30.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:30 smithi022 ceph-mon[30966]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:31.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:31 smithi022 ceph-mon[30966]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:31 smithi169 ceph-mon[35628]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:31 smithi045 ceph-mon[35556]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:32.946 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:32.947 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:32.947 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:32.947 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:32.947 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:32 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:32.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.987+0000 7f62f67fc640 1 -- 172.21.15.45:0/2241661391 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62f8062630 con 0x7f62e00a2b80 2024-09-11T22:23:32.989 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 4 on host 'smithi045' 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 msgr2=0x7f62e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 0x7f62e00a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62f8069d70 tx=0x7f62e800a590 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 msgr2=0x7f62f81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62f000d750 tx=0x7f62f000dc10 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 shutdown_connections 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f81038b0 0x7f62f81013e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f62e00a2b80 0x7f62e00a5040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102ef0 0x7f62f8100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 --2- 172.21.15.45:0/2241661391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f80fff10 0x7f62f8102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:32.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 >> 172.21.15.45:0/2241661391 conn(0x7f62f80fba80 msgr2=0x7f62f81062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:32.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 shutdown_connections 2024-09-11T22:23:32.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:23:32.989+0000 7f62ff328640 1 -- 172.21.15.45:0/2241661391 wait complete. 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:32 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:33.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:33.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:32 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.652 DEBUG:teuthology.orchestra.run.smithi045:osd.4> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T22:23:33.654 INFO:tasks.cephadm:Deploying osd.5 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-11T22:23:33.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:23:33.908 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:23:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:33 smithi045 ceph-mon[35556]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:34.024 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:33 smithi169 ceph-mon[35628]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:34.025 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:34.025 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:34.025 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:33 smithi022 ceph-mon[30966]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:34.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:35.730 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:23:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:23:35.440+0000 7f60cd87d640 -1 osd.4 0 log_to_monitors true 2024-09-11T22:23:36.111 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:35 smithi169 ceph-mon[35628]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:36.111 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:35 smithi169 ceph-mon[35628]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.111 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:35 smithi169 ceph-mon[35628]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:35 smithi022 ceph-mon[30966]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:36.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:35 smithi022 ceph-mon[30966]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:35 smithi022 ceph-mon[30966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:35 smithi045 ceph-mon[35556]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:36.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:35 smithi045 ceph-mon[35556]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:35 smithi045 ceph-mon[35556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:23:36.448 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:23:36.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-11T22:23:36.741 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi045 2024-09-11T22:23:37.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:37.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi045 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:37.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.161 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:23:36.742+0000 7f60c8fdd640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T22:23:37.161 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:23:36.748+0000 7f60c5617640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:23:37.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi045 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:37.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:37.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:37.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 -- 172.21.15.169:0/511270578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 msgr2=0x7fee68107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 --2- 172.21.15.169:0/511270578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee68107420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009900 tx=0x7fee5c02a410 comp rx=0 tx=0).stop 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 -- 172.21.15.169:0/511270578 shutdown_connections 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 --2- 172.21.15.169:0/511270578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68107960 0x7fee68109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 --2- 172.21.15.169:0/511270578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee68107420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 --2- 172.21.15.169:0/511270578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68102700 0x7fee68104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 -- 172.21.15.169:0/511270578 >> 172.21.15.169:0/511270578 conn(0x7fee680fc280 msgr2=0x7fee680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 -- 172.21.15.169:0/511270578 shutdown_connections 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.216+0000 7fee6dde5640 1 -- 172.21.15.169:0/511270578 wait complete. 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 Processor -- start 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 -- start start 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68102700 0x7fee68102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68107960 0x7fee68100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee6810d9b0 con 0x7fee68102700 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fee6810d830 con 0x7fee68107960 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.217+0000 7fee6dde5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fee6810db30 con 0x7fee68105030 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59244/0 (socket says 172.21.15.169:59244) 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 -- 172.21.15.169:0/2282615231 learned_addr learned my addr 172.21.15.169:0/2282615231 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee677fe640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68102700 0x7fee68102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee67fff640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68107960 0x7fee68100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 -- 172.21.15.169:0/2282615231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68107960 msgr2=0x7fee68100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68107960 0x7fee68100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 -- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68102700 msgr2=0x7fee68102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:37.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68102700 0x7fee68102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 -- 172.21.15.169:0/2282615231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee681014b0 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee66ffd640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee5c005ab0 tx=0x7fee5c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c03f030 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee681a2120 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee5c003d00 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c035070 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.218+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee681a2620 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.219+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee680fdd70 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.221+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fee5c042030 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.222+0000 7fee64ff9640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 0x7fee500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.222+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fee5c0ee6e0 con 0x7fee68105030 2024-09-11T22:23:37.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.223+0000 7fee677fe640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 0x7fee500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:37.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.223+0000 7fee677fe640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 0x7fee500a5040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee580058c0 tx=0x7fee5800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:37.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.225+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee5c0bc0e0 con 0x7fee68105030 2024-09-11T22:23:37.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:37.399+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fee68062630 con 0x7fee500a2b80 2024-09-11T22:23:38.043 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:38.043 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:38.044 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:37 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:37 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:38.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:38.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:38.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:38.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:37 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:38.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:38 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:23:38.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:38 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:23:38.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:38 smithi169 ceph-mon[35628]: osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] boot 2024-09-11T22:23:38.889 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:38 smithi169 ceph-mon[35628]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T22:23:38.890 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:38 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:39.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:38 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:23:39.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:38 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:23:39.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:38 smithi022 ceph-mon[30966]: osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] boot 2024-09-11T22:23:39.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:38 smithi022 ceph-mon[30966]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T22:23:39.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:38 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:39.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:38 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:23:39.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:38 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:23:39.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:38 smithi045 ceph-mon[35556]: osd.4 [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] boot 2024-09-11T22:23:39.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:38 smithi045 ceph-mon[35556]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T22:23:39.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:38 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/1001388544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]': finished 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T22:23:40.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:39 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/1001388544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]': finished 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T22:23:40.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:39 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:23:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:23:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/1001388544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]: dispatch 2024-09-11T22:23:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19566e6c-1e79-48d6-ba3b-2e61d38e21fc"}]': finished 2024-09-11T22:23:40.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T22:23:40.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:39 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:23:41.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:40 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/3202182863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:41.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:40 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/3202182863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:41.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:40 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/3202182863' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:42.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:41 smithi022 ceph-mon[30966]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:42.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:41 smithi169 ceph-mon[35628]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:42.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:41 smithi045 ceph-mon[35556]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:44.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:43 smithi022 ceph-mon[30966]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:44.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:43 smithi169 ceph-mon[35628]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:44.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:43 smithi045 ceph-mon[35556]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:46.070 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:45 smithi169 ceph-mon[35628]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:46.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:45 smithi022 ceph-mon[30966]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:46.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:45 smithi045 ceph-mon[35556]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:48.000 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:47 smithi169 ceph-mon[35628]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:48.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:47 smithi022 ceph-mon[30966]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:48.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:47 smithi045 ceph-mon[35556]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:49.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:48 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:23:49.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:48 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:49.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:48 smithi022 ceph-mon[30966]: Deploying daemon osd.5 on smithi169 2024-09-11T22:23:49.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:48 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:23:49.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:48 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:49.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:48 smithi169 ceph-mon[35628]: Deploying daemon osd.5 on smithi169 2024-09-11T22:23:49.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:48 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:23:49.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:48 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:49.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:48 smithi045 ceph-mon[35556]: Deploying daemon osd.5 on smithi169 2024-09-11T22:23:49.965 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:49 smithi169 ceph-mon[35628]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:50.070 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:49 smithi022 ceph-mon[30966]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:50.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:49 smithi045 ceph-mon[35556]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:52.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:51 smithi022 ceph-mon[30966]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:52.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:51 smithi169 ceph-mon[35628]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:52.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:51 smithi045 ceph-mon[35556]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:54.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:53 smithi022 ceph-mon[30966]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:54.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:53 smithi169 ceph-mon[35628]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:54.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:53 smithi045 ceph-mon[35556]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:55.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:55.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:55.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:55.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:56.295 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:56 smithi169 ceph-mon[35628]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:56.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:56 smithi022 ceph-mon[30966]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:56 smithi045 ceph-mon[35556]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:57.957 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:57.957 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:57.957 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:57.957 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:57.958 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:57.958 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.000+0000 7fee64ff9640 1 -- 172.21.15.169:0/2282615231 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fee68062630 con 0x7fee500a2b80 2024-09-11T22:23:58.001 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 5 on host 'smithi169' 2024-09-11T22:23:58.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.002+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 msgr2=0x7fee500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:58.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.002+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 0x7fee500a5040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee580058c0 tx=0x7fee5800a250 comp rx=0 tx=0).stop 2024-09-11T22:23:58.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.002+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 msgr2=0x7fee681006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:58.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.002+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee5c005ab0 tx=0x7fee5c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 shutdown_connections 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee68107960 0x7fee68100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fee500a2b80 0x7fee500a5040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fee68105030 0x7fee681006b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 --2- 172.21.15.169:0/2282615231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee68102700 0x7fee68102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 >> 172.21.15.169:0/2282615231 conn(0x7fee680fc280 msgr2=0x7fee681030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 shutdown_connections 2024-09-11T22:23:58.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:23:58.003+0000 7fee6dde5640 1 -- 172.21.15.169:0/2282615231 wait complete. 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:23:58.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:58.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:58.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.589 DEBUG:teuthology.orchestra.run.smithi169:osd.5> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T22:23:58.591 INFO:tasks.cephadm:Deploying osd.6 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-11T22:23:58.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:23:58.839 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:58.840 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.840 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.861 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:23:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:59.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:59.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:23:59.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:23:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:00.074 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:23:59 smithi169 ceph-mon[35628]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:00.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:23:59 smithi022 ceph-mon[30966]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:00.402 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:24:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:24:00.161+0000 7fc930a68640 -1 osd.5 0 log_to_monitors true 2024-09-11T22:24:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:00 smithi045 ceph-mon[35556]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:01.115 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:01 smithi169 ceph-mon[35628]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.115 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:01 smithi169 ceph-mon[35628]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:01 smithi022 ceph-mon[30966]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:01 smithi022 ceph-mon[30966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:01 smithi045 ceph-mon[35556]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:01 smithi045 ceph-mon[35556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:01.687 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:24:01.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-11T22:24:01.982 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:24:02.011 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:02.011 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:02.011 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi169 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:02.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:02 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi169 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:02.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi169 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:02.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:02 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- 172.21.15.22:0/4042366583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8100ad0 msgr2=0x7facc8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 --2- 172.21.15.22:0/4042366583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8100ad0 0x7facc8100ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facc4009900 tx=0x7facc402a410 comp rx=0 tx=0).stop 2024-09-11T22:24:02.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- 172.21.15.22:0/4042366583 shutdown_connections 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 --2- 172.21.15.22:0/4042366583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 0x7facc8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 --2- 172.21.15.22:0/4042366583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8101cd0 0x7facc8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 --2- 172.21.15.22:0/4042366583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8100ad0 0x7facc8100ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- 172.21.15.22:0/4042366583 >> 172.21.15.22:0/4042366583 conn(0x7facc80fc280 msgr2=0x7facc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- 172.21.15.22:0/4042366583 shutdown_connections 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- 172.21.15.22:0/4042366583 wait complete. 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 Processor -- start 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.551+0000 7faccfb18640 1 -- start start 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8100ad0 0x7facc8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 0x7facc819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:02.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7facc810c880 con 0x7facc8101cd0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7facc810c700 con 0x7facc8100ad0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7facc810ca00 con 0x7facc8102690 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44126/0 (socket says 172.21.15.22:44126) 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 -- 172.21.15.22:0/2911406370 learned_addr learned my addr 172.21.15.22:0/2911406370 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd8b4640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8100ad0 0x7facc8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7facce0b5640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 0x7facc819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 -- 172.21.15.22:0/2911406370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 msgr2=0x7facc819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 0x7facc819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 -- 172.21.15.22:0/2911406370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8100ad0 msgr2=0x7facc8198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8100ad0 0x7facc8198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 -- 172.21.15.22:0/2911406370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc819fc30 con 0x7facc8101cd0 2024-09-11T22:24:02.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccd0b3640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb800d950 tx=0x7facb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:02.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8017070 con 0x7facc8101cd0 2024-09-11T22:24:02.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc819ff20 con 0x7facc8101cd0 2024-09-11T22:24:02.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facb8009c30 con 0x7facc8101cd0 2024-09-11T22:24:02.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.552+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb800f740 con 0x7facc8101cd0 2024-09-11T22:24:02.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.553+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81a0420 con 0x7facc8101cd0 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.554+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc81a05f0 con 0x7facc8101cd0 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.555+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7facb8010a80 con 0x7facc8101cd0 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.556+0000 7facbeffd640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 0x7facb40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.556+0000 7faccd8b4640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 0x7facb40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.556+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7facb80cdbc0 con 0x7facc8101cd0 2024-09-11T22:24:02.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.556+0000 7faccd8b4640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 0x7facb40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facc4031570 tx=0x7facc4031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:02.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.560+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facb809b4b0 con 0x7facc8101cd0 2024-09-11T22:24:02.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:02.763+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7facc806a730 con 0x7facb40a2bb0 2024-09-11T22:24:03.018 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:24:02.783+0000 7fc92c1c8640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T22:24:03.019 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:24:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:24:02.794+0000 7fc9247fa640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='osd.5 ' entity='osd.5' 2024-09-11T22:24:03.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] boot 2024-09-11T22:24:03.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T22:24:03.292 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:03 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='osd.5 ' entity='osd.5' 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] boot 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T22:24:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:03 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='osd.5 ' entity='osd.5' 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: osd.5 [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] boot 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T22:24:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:03 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:04.261 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:04 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:24:04.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:04 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:24:04.433 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:04 smithi022 ceph-mon[30966]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:04.433 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:04 smithi022 ceph-mon[30966]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:04.433 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:04 smithi022 ceph-mon[30966]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:04.433 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:04 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:04 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:04 smithi045 ceph-mon[35556]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:04 smithi045 ceph-mon[35556]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:04 smithi045 ceph-mon[35556]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:04 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:04 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:04 smithi169 ceph-mon[35628]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:04 smithi169 ceph-mon[35628]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:04.434 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:04 smithi169 ceph-mon[35628]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:05 smithi022 ceph-mon[30966]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:05.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:05 smithi169 ceph-mon[35628]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:05.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:05 smithi045 ceph-mon[35556]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]: dispatch 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]': finished 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2409169232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]: dispatch 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]': finished 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:06.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2409169232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:06.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:06.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:06.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]: dispatch 2024-09-11T22:24:06.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2470619389' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "231d0816-5eb1-4a2c-aced-20a92e18523b"}]': finished 2024-09-11T22:24:06.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T22:24:06.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:06.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:06 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2409169232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:08 smithi022 ceph-mon[30966]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 162 KiB/s, 0 objects/s recovering 2024-09-11T22:24:08.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:08 smithi169 ceph-mon[35628]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 162 KiB/s, 0 objects/s recovering 2024-09-11T22:24:08.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:08 smithi045 ceph-mon[35556]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 536 GiB / 536 GiB avail; 162 KiB/s, 0 objects/s recovering 2024-09-11T22:24:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:10 smithi022 ceph-mon[30966]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:24:10.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:10 smithi169 ceph-mon[35628]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:24:10.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:10 smithi045 ceph-mon[35556]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-11T22:24:12.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:12 smithi022 ceph-mon[30966]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:24:12.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:12 smithi169 ceph-mon[35628]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:24:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:12 smithi045 ceph-mon[35556]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-11T22:24:14.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:14 smithi022 ceph-mon[30966]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:14.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:14.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:14 smithi169 ceph-mon[35628]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:14.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:14 smithi045 ceph-mon[35556]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:14.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:14.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:15.563 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:15 smithi045 ceph-mon[35556]: Deploying daemon osd.6 on smithi022 2024-09-11T22:24:15.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:15 smithi022 ceph-mon[30966]: Deploying daemon osd.6 on smithi022 2024-09-11T22:24:15.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:15 smithi169 ceph-mon[35628]: Deploying daemon osd.6 on smithi022 2024-09-11T22:24:16.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:16 smithi022 ceph-mon[30966]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T22:24:16.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:16 smithi169 ceph-mon[35628]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T22:24:16.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:16 smithi045 ceph-mon[35556]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-11T22:24:18.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:18 smithi022 ceph-mon[30966]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T22:24:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:18 smithi169 ceph-mon[35628]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T22:24:18.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:18 smithi045 ceph-mon[35556]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T22:24:20.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:20 smithi022 ceph-mon[30966]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:20.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:20.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:20.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:20.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:20 smithi169 ceph-mon[35628]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:20.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:20.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:20.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:20 smithi045 ceph-mon[35556]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:22.348 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:22 smithi022 ceph-mon[30966]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:22.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:22 smithi169 ceph-mon[35628]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:22 smithi045 ceph-mon[35556]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:24.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.291+0000 7facbeffd640 1 -- 172.21.15.22:0/2911406370 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7facc806a730 con 0x7facb40a2bb0 2024-09-11T22:24:24.293 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 6 on host 'smithi022' 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 msgr2=0x7facb40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 0x7facb40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facc4031570 tx=0x7facc4031640 comp rx=0 tx=0).stop 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 msgr2=0x7facc8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7facb800d950 tx=0x7facb800de10 comp rx=0 tx=0).stop 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 shutdown_connections 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7facb40a2bb0 0x7facb40a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7facc8102690 0x7facc819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facc8101cd0 0x7facc8198540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 --2- 172.21.15.22:0/2911406370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facc8100ad0 0x7facc8198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:24.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 >> 172.21.15.22:0/2911406370 conn(0x7facc80fc280 msgr2=0x7facc806a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:24.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 shutdown_connections 2024-09-11T22:24:24.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:24:24.294+0000 7faccfb18640 1 -- 172.21.15.22:0/2911406370 wait complete. 2024-09-11T22:24:24.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:24.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:24.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:24.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:24 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:24 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:24.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:24.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:24 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.220 DEBUG:teuthology.orchestra.run.smithi022:osd.6> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T22:24:25.222 INFO:tasks.cephadm:Deploying osd.7 on smithi045 with /dev/vg_nvme/lv_2... 2024-09-11T22:24:25.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:24:25.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:25 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:25.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:25 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:25 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:25 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:25.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:25 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:25 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:25 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:25.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:25 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:25 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:25.484 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:24:26.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:26 smithi022 ceph-mon[30966]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:26.582 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:26 smithi045 ceph-mon[35556]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:26.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:26 smithi169 ceph-mon[35628]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:26.700 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:24:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:24:26.423+0000 7f5313398640 -1 osd.6 0 log_to_monitors true 2024-09-11T22:24:27.435 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:27 smithi045 ceph-mon[35556]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:24:27.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:27 smithi022 ceph-mon[30966]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:24:27.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:27 smithi169 ceph-mon[35628]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:24:27.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:24:27.976 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_2 2024-09-11T22:24:28.225 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:24:28.556 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:28 smithi045 ceph-mon[35556]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:28.556 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:28 smithi045 ceph-mon[35556]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:24:28.556 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:28 smithi045 ceph-mon[35556]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T22:24:28.556 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:28 smithi045 ceph-mon[35556]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:24:28.556 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:28.652 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:24:28.305+0000 7f530eaf8640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T22:24:28.652 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:24:28.314+0000 7f530b132640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:24:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-mon[30966]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-mon[30966]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:24:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-mon[30966]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T22:24:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-mon[30966]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:24:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:28.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:28 smithi169 ceph-mon[35628]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:28.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:28 smithi169 ceph-mon[35628]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:24:28.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:28 smithi169 ceph-mon[35628]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T22:24:28.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:28 smithi169 ceph-mon[35628]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:24:28.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/880982717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 msgr2=0x7fd0b0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/880982717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b0109d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009ca0 tx=0x7fd0a802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/880982717 shutdown_connections 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/880982717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b0109d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/880982717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0105030 0x7fd0b0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/880982717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0102700 0x7fd0b0104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/880982717 >> 172.21.15.45:0/880982717 conn(0x7fd0b00fc2a0 msgr2=0x7fd0b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.752+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/880982717 shutdown_connections 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/880982717 wait complete. 2024-09-11T22:24:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 Processor -- start 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 -- start start 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0102700 0x7fd0b0198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0105030 0x7fd0b01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b010da50 con 0x7fd0b0102700 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b010d8d0 con 0x7fd0b0107960 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b7dbd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b010dbd0 con 0x7fd0b0105030 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b635a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b635a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43388/0 (socket says 172.21.15.45:43388) 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.753+0000 7fd0b635a640 1 -- 172.21.15.45:0/4185476064 learned_addr learned my addr 172.21.15.45:0/4185476064 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-11T22:24:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b5b59640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0102700 0x7fd0b0198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b5358640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0105030 0x7fd0b01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 -- 172.21.15.45:0/4185476064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0105030 msgr2=0x7fd0b01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0105030 0x7fd0b01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 -- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0102700 msgr2=0x7fd0b0198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0102700 0x7fd0b0198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 -- 172.21.15.45:0/4185476064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b019fca0 con 0x7fd0b0107960 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b635a640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009dc0 tx=0x7fd0a802f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a802fe40 con 0x7fd0b0107960 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b019ff30 con 0x7fd0b0107960 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0a8031df0 con 0x7fd0b0107960 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8046ac0 con 0x7fd0b0107960 2024-09-11T22:24:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.754+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b01a04b0 con 0x7fd0b0107960 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.755+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b00fdd90 con 0x7fd0b0107960 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.756+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd0a80305c0 con 0x7fd0b0107960 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.757+0000 7fd0a6ffd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 0x7fd09c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.757+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7fd0a80ef920 con 0x7fd0b0107960 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.757+0000 7fd0b5b59640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 0x7fd09c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.757+0000 7fd0b5b59640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 0x7fd09c0a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009990 tx=0x7fd0ac009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.761+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0a80bd6b0 con 0x7fd0b0107960 2024-09-11T22:24:28.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:28.946+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd0b0062630 con 0x7fd09c0a2bb0 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi022 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:29.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi022 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.654 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:29.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi022 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:29.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:29.657 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:29.657 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:30.539 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] boot 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T22:24:30.540 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:30 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] boot 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T22:24:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: osd.6 [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] boot 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T22:24:30.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:30 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:31.819 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T22:24:31.819 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/3103138438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.819 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.819 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]': finished 2024-09-11T22:24:31.819 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T22:24:31.820 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:31 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:31.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T22:24:31.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/3103138438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]': finished 2024-09-11T22:24:31.827 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T22:24:31.828 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:31 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/3103138438' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]: dispatch 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65301ecd-9ff7-4221-bfb2-fffea68443e2"}]': finished 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T22:24:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:31 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:32.784 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:32 smithi169 ceph-mon[35628]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:32.784 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:32 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/3256692158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:32.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:32 smithi022 ceph-mon[30966]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:32.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:32 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/3256692158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:32.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:32 smithi045 ceph-mon[35556]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:32.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:32 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/3256692158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:34.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:34 smithi022 ceph-mon[30966]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:34.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:34 smithi169 ceph-mon[35628]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:34.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:34 smithi045 ceph-mon[35556]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:36 smithi045 ceph-mon[35556]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:36.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:36 smithi022 ceph-mon[30966]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:36.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:36 smithi169 ceph-mon[35628]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:38 smithi045 ceph-mon[35556]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:38.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:38 smithi022 ceph-mon[30966]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:38.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:38 smithi169 ceph-mon[35628]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:40.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:40 smithi045 ceph-mon[35556]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:40.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:24:40.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:40.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:40 smithi022 ceph-mon[30966]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:40.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:24:40.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:40.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:40 smithi169 ceph-mon[35628]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:40.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:24:40.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:41.618 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:41 smithi045 ceph-mon[35556]: Deploying daemon osd.7 on smithi045 2024-09-11T22:24:41.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:41 smithi022 ceph-mon[30966]: Deploying daemon osd.7 on smithi045 2024-09-11T22:24:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:41 smithi169 ceph-mon[35628]: Deploying daemon osd.7 on smithi045 2024-09-11T22:24:42.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:42 smithi169 ceph-mon[35628]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:42 smithi045 ceph-mon[35556]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:42.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:42 smithi022 ceph-mon[30966]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:44.755 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:44 smithi045 ceph-mon[35556]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:44.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:44 smithi022 ceph-mon[30966]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:44.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:44 smithi169 ceph-mon[35628]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:46 smithi045 ceph-mon[35556]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:46 smithi022 ceph-mon[30966]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:46 smithi169 ceph-mon[35628]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:48.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:48 smithi022 ceph-mon[30966]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:48.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:48 smithi169 ceph-mon[35628]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:48.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:48 smithi045 ceph-mon[35556]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.286+0000 7fd0a6ffd640 1 -- 172.21.15.45:0/4185476064 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd0b0062630 con 0x7fd09c0a2bb0 2024-09-11T22:24:49.287 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 7 on host 'smithi045' 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 msgr2=0x7fd09c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 0x7fd09c0a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009990 tx=0x7fd0ac009110 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 msgr2=0x7fd0b019f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009dc0 tx=0x7fd0a802f840 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 shutdown_connections 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0b0107960 0x7fd0b019f630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd09c0a2bb0 0x7fd09c0a5070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0b0105030 0x7fd0b01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 --2- 172.21.15.45:0/4185476064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b0102700 0x7fd0b0198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 >> 172.21.15.45:0/4185476064 conn(0x7fd0b00fc2a0 msgr2=0x7fd0b0102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 shutdown_connections 2024-09-11T22:24:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:24:49.288+0000 7fd0b7dbd640 1 -- 172.21.15.45:0/4185476064 wait complete. 2024-09-11T22:24:49.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:49.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:49.881 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:49.882 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.883 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:49.883 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.883 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:49 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:49 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:49 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:49.907 DEBUG:teuthology.orchestra.run.smithi045:osd.7> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T22:24:49.910 INFO:tasks.cephadm:Deploying osd.8 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-11T22:24:49.910 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:24:50.167 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:24:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:51 smithi169 ceph-mon[35628]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:51 smithi045 ceph-mon[35556]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:51.911 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:24:51 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:24:51.734+0000 7f7ae9a6e640 -1 osd.7 0 log_to_monitors true 2024-09-11T22:24:52.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:51 smithi022 ceph-mon[30966]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:52.596 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:24:52.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-11T22:24:52.877 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:52 smithi045 ceph-mon[35556]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:52.877 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:52 smithi045 ceph-mon[35556]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:52.880 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:24:52.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:52 smithi169 ceph-mon[35628]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:52.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:52 smithi169 ceph-mon[35628]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:52.995 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:52 smithi022 ceph-mon[30966]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:52.995 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:52 smithi022 ceph-mon[30966]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:24:53.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 -- 172.21.15.169:0/977170266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce0102df0 msgr2=0x7fbce0103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 --2- 172.21.15.169:0/977170266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce0102df0 0x7fbce0103270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009900 tx=0x7fbcd402a410 comp rx=0 tx=0).stop 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 -- 172.21.15.169:0/977170266 shutdown_connections 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 --2- 172.21.15.169:0/977170266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce01037b0 0x7fbce010a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 --2- 172.21.15.169:0/977170266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce0102df0 0x7fbce0103270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 --2- 172.21.15.169:0/977170266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 -- 172.21.15.169:0/977170266 >> 172.21.15.169:0/977170266 conn(0x7fbce00fd3c0 msgr2=0x7fbce00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 -- 172.21.15.169:0/977170266 shutdown_connections 2024-09-11T22:24:53.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.323+0000 7fbce5f12640 1 -- 172.21.15.169:0/977170266 wait complete. 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.324+0000 7fbce5f12640 1 Processor -- start 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.324+0000 7fbce5f12640 1 -- start start 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.324+0000 7fbce5f12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce0102df0 0x7fbce01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbce010d9b0 con 0x7fbce0101bf0 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbce010d830 con 0x7fbce0102df0 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbce010db30 con 0x7fbce01037b0 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:53.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.169:43728/0 (socket says 172.21.15.169:43728) 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:58724/0 (socket says 172.21.15.169:58724) 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 -- 172.21.15.169:0/3239324127 learned_addr learned my addr 172.21.15.169:0/3239324127 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 -- 172.21.15.169:0/3239324127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce0102df0 msgr2=0x7fbce01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdeffd640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce0102df0 0x7fbce01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce0102df0 0x7fbce01984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 -- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 msgr2=0x7fbce0197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 -- 172.21.15.169:0/3239324127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce019fbc0 con 0x7fbce01037b0 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdf7fe640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdffff640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009fd0 tx=0x7fbcd800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8017070 con 0x7fbce01037b0 2024-09-11T22:24:53.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce019feb0 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcd8004020 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.325+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80106c0 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.326+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce01a0360 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.327+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce0108f20 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.329+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbcd80041d0 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.329+0000 7fbcdcff9640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 0x7fbcc80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.329+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5101+0+0 (secure 0 0 0) 0x7fbcd80ce0b0 con 0x7fbce01037b0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.329+0000 7fbcdf7fe640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 0x7fbcc80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.330+0000 7fbcdf7fe640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 0x7fbcc80a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbce0102c50 tx=0x7fbcd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:53.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.334+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbcd809bca0 con 0x7fbce01037b0 2024-09-11T22:24:53.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:24:53.513+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbce0062630 con 0x7fbcc80a2bb0 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:53.922 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi045 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:53.923 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:53.924 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:53 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:54.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:54.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:24:54.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:54.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T22:24:54.027 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi045 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:54.028 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:54.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:54.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:54.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:54.029 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:53 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:54.161 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:24:53.669+0000 7f7ae51ce640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T22:24:54.162 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:24:53.680+0000 7f7ae1808640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:24:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:24:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi045 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:54.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:54.165 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:53 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:54.820 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:54 smithi169 ceph-mon[35628]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:24:54.820 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:54 smithi169 ceph-mon[35628]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:24:54.820 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:54.820 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:54 smithi022 ceph-mon[30966]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:24:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:54 smithi022 ceph-mon[30966]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:24:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:54 smithi045 ceph-mon[35556]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:24:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:54 smithi045 ceph-mon[35556]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:24:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:24:55.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:24:55.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:55.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:55.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] boot 2024-09-11T22:24:55.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T22:24:55.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:55 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:24:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:24:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:56.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:56.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] boot 2024-09-11T22:24:56.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T22:24:56.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: osd.7 [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] boot 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T22:24:56.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:55 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/3926769575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]': finished 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:57.042 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:56 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/3854155967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/3926769575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]': finished 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/3854155967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/3926769575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]: dispatch 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a824e3-0c3e-4315-86e2-e3a1684c94b3"}]': finished 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:57.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:56 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/3854155967' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:57 smithi045 ceph-mon[35556]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:24:57.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:57 smithi045 ceph-mon[35556]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:24:57.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:57 smithi022 ceph-mon[30966]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:24:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:57 smithi022 ceph-mon[30966]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:24:58.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:58.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:57 smithi169 ceph-mon[35628]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:24:58.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:57 smithi169 ceph-mon[35628]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T22:24:58.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:59.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:58 smithi022 ceph-mon[30966]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:24:59.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:59.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:58 smithi169 ceph-mon[35628]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:24:59.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:24:59.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:58 smithi045 ceph-mon[35556]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T22:24:59.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:00.074 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:24:59 smithi169 ceph-mon[35628]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:00.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:24:59 smithi022 ceph-mon[30966]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:00.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:24:59 smithi045 ceph-mon[35556]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:02.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:01 smithi022 ceph-mon[30966]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:02.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:01 smithi169 ceph-mon[35628]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:02.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:01 smithi045 ceph-mon[35556]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:04.082 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:03 smithi169 ceph-mon[35628]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:04.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:03 smithi022 ceph-mon[30966]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:04.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:03 smithi045 ceph-mon[35556]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:05.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:05.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:05.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:04 smithi022 ceph-mon[30966]: Deploying daemon osd.8 on smithi169 2024-09-11T22:25:05.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:05.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:05.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:04 smithi169 ceph-mon[35628]: Deploying daemon osd.8 on smithi169 2024-09-11T22:25:05.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:05.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:05.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:04 smithi045 ceph-mon[35556]: Deploying daemon osd.8 on smithi169 2024-09-11T22:25:06.110 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:05 smithi169 ceph-mon[35628]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:06.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:05 smithi022 ceph-mon[30966]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:06.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:05 smithi045 ceph-mon[35556]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:07.992 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:07 smithi169 ceph-mon[35628]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:08.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:07 smithi022 ceph-mon[30966]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:08.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:07 smithi045 ceph-mon[35556]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:10.008 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:09 smithi169 ceph-mon[35628]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:10.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:09 smithi022 ceph-mon[30966]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:10.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:09 smithi045 ceph-mon[35556]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:11.004 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:10 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:11.004 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:10 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:11.005 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:10 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:11.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:10 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:11.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:10 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:11.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:10 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:11.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:10 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:11.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:10 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:11.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:10 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:12.511 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:12 smithi169 ceph-mon[35628]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:12 smithi022 ceph-mon[30966]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:12 smithi045 ceph-mon[35556]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:13.807 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 8 on host 'smithi169' 2024-09-11T22:25:13.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.805+0000 7fbcdcff9640 1 -- 172.21.15.169:0/3239324127 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbce0062630 con 0x7fbcc80a2bb0 2024-09-11T22:25:13.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 msgr2=0x7fbcc80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:13.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 0x7fbcc80a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbce0102c50 tx=0x7fbcd0005f90 comp rx=0 tx=0).stop 2024-09-11T22:25:13.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 msgr2=0x7fbce019f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:13.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009fd0 tx=0x7fbcd800b260 comp rx=0 tx=0).stop 2024-09-11T22:25:13.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 shutdown_connections 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbcc80a2bb0 0x7fbcc80a5070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbce01037b0 0x7fbce019f550 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce0102df0 0x7fbce01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 --2- 172.21.15.169:0/3239324127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce0101bf0 0x7fbce0197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 >> 172.21.15.169:0/3239324127 conn(0x7fbce00fd3c0 msgr2=0x7fbce01060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 shutdown_connections 2024-09-11T22:25:13.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:25:13.808+0000 7fbce5f12640 1 -- 172.21.15.169:0/3239324127 wait complete. 2024-09-11T22:25:14.128 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:14.128 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:13 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:13 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:14.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:14.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:13 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:14.443 DEBUG:teuthology.orchestra.run.smithi169:osd.8> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T22:25:14.446 INFO:tasks.cephadm:Deploying osd.9 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-11T22:25:14.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:25:14.715 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:25:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:15 smithi022 ceph-mon[30966]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:16.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:15 smithi169 ceph-mon[35628]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:16.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:15 smithi045 ceph-mon[35556]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:16.561 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:25:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:25:16.276+0000 7fd9812ed640 -1 osd.8 0 log_to_monitors true 2024-09-11T22:25:17.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:16 smithi022 ceph-mon[30966]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:16 smithi022 ceph-mon[30966]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:16 smithi169 ceph-mon[35628]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:16 smithi169 ceph-mon[35628]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:16 smithi045 ceph-mon[35556]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:16 smithi045 ceph-mon[35556]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:17.746 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:25:17.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-11T22:25:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi169 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:18.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi169 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:18.154 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:18.155 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:18.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi169 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:18.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:18.163 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3590943985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec101cd0 msgr2=0x7f76ec102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3590943985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec101cd0 0x7f76ec102150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009900 tx=0x7f76dc02a410 comp rx=0 tx=0).stop 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3590943985 shutdown_connections 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3590943985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec102690 0x7f76ec108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3590943985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec101cd0 0x7f76ec102150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3590943985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3590943985 >> 172.21.15.22:0/3590943985 conn(0x7f76ec0fc280 msgr2=0x7f76ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:18.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3590943985 shutdown_connections 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.658+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3590943985 wait complete. 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 Processor -- start 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 -- start start 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec101cd0 0x7f76ec1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10c890 con 0x7f76ec102690 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10c710 con 0x7f76ec100ad0 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f3d3f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10ca10 con 0x7f76ec101cd0 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38554/0 (socket says 172.21.15.22:38554) 2024-09-11T22:25:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 -- 172.21.15.22:0/3180432536 learned_addr learned my addr 172.21.15.22:0/3180432536 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f12da640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec101cd0 0x7f76ec1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f1adb640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 -- 172.21.15.22:0/3180432536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec101cd0 msgr2=0x7f76ec1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec101cd0 0x7f76ec1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 -- 172.21.15.22:0/3180432536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 msgr2=0x7f76ec196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f22dc640 1 -- 172.21.15.22:0/3180432536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec19eae0 con 0x7f76ec102690 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.659+0000 7f76f1adb640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76f22dc640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f76e400eb10 tx=0x7f76e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4004b20 con 0x7f76ec102690 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76e4004cc0 con 0x7f76ec102690 2024-09-11T22:25:18.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec19edd0 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e40107f0 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.660+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec19f2d0 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.661+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec107e20 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.662+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f76e4010990 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.663+0000 7f76e2ffd640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 0x7f76d80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.663+0000 7f76f1adb640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 0x7f76d80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.663+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5582+0+0 (secure 0 0 0) 0x7f76e40cec80 con 0x7f76ec102690 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.663+0000 7f76f1adb640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 0x7f76d80a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76e80058c0 tx=0x7f76e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.666+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76e40541b0 con 0x7f76ec102690 2024-09-11T22:25:18.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:18.854+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f76ec062630 con 0x7f76d80a2c30 2024-09-11T22:25:18.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:25:18.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:18.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:18.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:18.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-mon[35628]: from='osd.8 ' entity='osd.8' 2024-09-11T22:25:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:25:18.649+0000 7fd97da84640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T22:25:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:25:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:25:18.663+0000 7fd97507f640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:18 smithi022 ceph-mon[30966]: from='osd.8 ' entity='osd.8' 2024-09-11T22:25:19.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:25:19.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:19.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:19.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:18 smithi045 ceph-mon[35556]: from='osd.8 ' entity='osd.8' 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] boot 2024-09-11T22:25:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T22:25:19.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:19 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] boot 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T22:25:20.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:19 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:20.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: osd.8 [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] boot 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T22:25:20.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:19 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:21 smithi022 ceph-mon[30966]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:25:21.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:21 smithi169 ceph-mon[35628]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:25:21.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:21 smithi045 ceph-mon[35556]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]: dispatch 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]': finished 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/766952954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]: dispatch 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]': finished 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:22.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/766952954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:25:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]: dispatch 2024-09-11T22:25:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2325730661' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba20c169-e5d6-418a-82b3-ee96748875d4"}]': finished 2024-09-11T22:25:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T22:25:22.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:22.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/766952954' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:23.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:23 smithi022 ceph-mon[30966]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:25:23.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:23 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:23.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:23 smithi169 ceph-mon[35628]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:25:23.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:23 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:23.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:23 smithi045 ceph-mon[35556]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T22:25:23.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:23 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:24 smithi022 ceph-mon[30966]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:24.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:24 smithi169 ceph-mon[35628]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:24.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:24 smithi045 ceph-mon[35556]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:26.526 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:26 smithi022 ceph-mon[30966]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:26.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:26 smithi169 ceph-mon[35628]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:26.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:26 smithi045 ceph-mon[35556]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:28 smithi022 ceph-mon[30966]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:25:28.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:28 smithi169 ceph-mon[35628]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:25:28.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:28 smithi045 ceph-mon[35556]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:25:30.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:30 smithi022 ceph-mon[30966]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T22:25:30.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:25:30.644 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:30 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:30 smithi169 ceph-mon[35628]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T22:25:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:30 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:25:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:30 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:30.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:30 smithi045 ceph-mon[35556]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T22:25:30.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:30 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:25:30.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:30 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:31.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:31 smithi022 ceph-mon[30966]: Deploying daemon osd.9 on smithi022 2024-09-11T22:25:31.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:31 smithi169 ceph-mon[35628]: Deploying daemon osd.9 on smithi022 2024-09-11T22:25:31.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:31 smithi045 ceph-mon[35556]: Deploying daemon osd.9 on smithi022 2024-09-11T22:25:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:32 smithi022 ceph-mon[30966]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T22:25:32.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:32 smithi169 ceph-mon[35628]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T22:25:32.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:32 smithi045 ceph-mon[35556]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T22:25:34.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:34 smithi022 ceph-mon[30966]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T22:25:34.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:34 smithi169 ceph-mon[35628]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T22:25:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:34 smithi045 ceph-mon[35556]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:36 smithi022 ceph-mon[30966]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:36 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:36 smithi169 ceph-mon[35628]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:36.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:36 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:36 smithi045 ceph-mon[35556]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:36 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:38.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:38 smithi022 ceph-mon[30966]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:38.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:38 smithi169 ceph-mon[35628]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:38.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:38 smithi045 ceph-mon[35556]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:25:39.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.849+0000 7f76e2ffd640 1 -- 172.21.15.22:0/3180432536 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76ec062630 con 0x7f76d80a2c30 2024-09-11T22:25:39.850 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 9 on host 'smithi022' 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 msgr2=0x7f76d80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 0x7f76d80a50f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76e80058c0 tx=0x7f76e8005850 comp rx=0 tx=0).stop 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 msgr2=0x7f76ec19e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f76e400eb10 tx=0x7f76e400c2d0 comp rx=0 tx=0).stop 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 shutdown_connections 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76ec102690 0x7f76ec19e470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:39.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76d80a2c30 0x7f76d80a50f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:39.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76ec101cd0 0x7f76ec1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:39.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 --2- 172.21.15.22:0/3180432536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec100ad0 0x7f76ec196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:39.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 >> 172.21.15.22:0/3180432536 conn(0x7f76ec0fc280 msgr2=0x7f76ec104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:39.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 shutdown_connections 2024-09-11T22:25:39.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:25:39.851+0000 7f76f3d3f640 1 -- 172.21.15.22:0/3180432536 wait complete. 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:40 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:40 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:40 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:40.579 DEBUG:teuthology.orchestra.run.smithi022:osd.9> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T22:25:40.582 INFO:tasks.cephadm:Deploying osd.10 on smithi045 with /dev/vg_nvme/lv_1... 2024-09-11T22:25:40.582 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:25:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:25:42.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:42 smithi022 ceph-mon[30966]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:42.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:42 smithi169 ceph-mon[35628]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:42.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:42 smithi045 ceph-mon[35556]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:42.902 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:25:42 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:25:42.516+0000 7fc0c45f1640 -1 osd.9 0 log_to_monitors true 2024-09-11T22:25:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-11T22:25:43.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_1 2024-09-11T22:25:43.225 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:43 smithi045 ceph-mon[35556]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:25:43.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:43 smithi022 ceph-mon[30966]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:25:43.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:43 smithi169 ceph-mon[35628]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:25:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:25:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 -- 172.21.15.45:0/2292369179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74100ad0 msgr2=0x7f8d74100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/2292369179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74100ad0 0x7f8d74100ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009900 tx=0x7f8d7002a410 comp rx=0 tx=0).stop 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 -- 172.21.15.45:0/2292369179 shutdown_connections 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/2292369179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74102690 0x7f8d74108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/2292369179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74101cd0 0x7f8d74102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/2292369179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74100ad0 0x7f8d74100ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 -- 172.21.15.45:0/2292369179 >> 172.21.15.45:0/2292369179 conn(0x7f8d740fc280 msgr2=0x7f8d740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 -- 172.21.15.45:0/2292369179 shutdown_connections 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.967+0000 7f8d7b92d640 1 -- 172.21.15.45:0/2292369179 wait complete. 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 Processor -- start 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 -- start start 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74100ad0 0x7f8d7410b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74102690 0x7f8d74109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7410d9a0 con 0x7f8d74102690 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7410d820 con 0x7f8d74101cd0 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d7b92d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7410db20 con 0x7f8d74100ad0 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48656/0 (socket says 172.21.15.45:48656) 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 -- 172.21.15.45:0/3338535773 learned_addr learned my addr 172.21.15.45:0/3338535773 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d796c9640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74100ad0 0x7f8d7410b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d79eca640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74102690 0x7f8d74109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 -- 172.21.15.45:0/3338535773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74100ad0 msgr2=0x7f8d7410b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74100ad0 0x7f8d7410b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 -- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74102690 msgr2=0x7f8d74109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74102690 0x7f8d74109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.968+0000 7f8d78ec8640 1 -- 172.21.15.45:0/3338535773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7410a8a0 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d78ec8640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400d950 tx=0x7f8d6400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64017030 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d741a20e0 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d64004020 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64004a00 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.969+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d741a25f0 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.970+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d74107ea0 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.971+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8d640041d0 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.971+0000 7f8d6a7fc640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 0x7f8d600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.972+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5965+0+0 (secure 0 0 0) 0x7f8d640ce100 con 0x7f8d74101cd0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.972+0000 7f8d796c9640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 0x7f8d600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.972+0000 7f8d796c9640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 0x7f8d600a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d70031570 tx=0x7f8d70031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:43.976+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d6409b990 con 0x7f8d74101cd0 2024-09-11T22:25:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:25:44.164+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8d74062630 con 0x7f8d600a2b80 2024-09-11T22:25:44.485 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:44.485 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:25:44.485 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:25:44.485 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:25:44.485 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi022 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:44.486 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi022 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi022 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:44.655 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:25:45.152 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:25:44.861+0000 7fc0bfd51640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T22:25:45.152 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:25:44 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:25:44.873+0000 7fc0b8383640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:45.572 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:45.573 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.573 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:45 smithi045 ceph-mon[35556]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:45.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:45 smithi022 ceph-mon[30966]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:45 smithi169 ceph-mon[35628]: from='osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329]' entity='osd.9' 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] boot 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T22:25:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:25:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:25:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] boot 2024-09-11T22:25:46.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T22:25:46.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:25:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:25:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:25:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: osd.9 [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] boot 2024-09-11T22:25:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T22:25:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:25:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:47 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/2862682745' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:47 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:47 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]': finished 2024-09-11T22:25:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:47 smithi022 ceph-mon[30966]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T22:25:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:25:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:47 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/2862682745' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:47 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:47 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]': finished 2024-09-11T22:25:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:47 smithi169 ceph-mon[35628]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T22:25:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:47 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:25:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:47 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/2862682745' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:47 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]: dispatch 2024-09-11T22:25:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:47 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed65f590-5c01-40d7-83dc-681d043f5203"}]': finished 2024-09-11T22:25:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:47 smithi045 ceph-mon[35556]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T22:25:47.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:47 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:25:48.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:48 smithi022 ceph-mon[30966]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:48.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:48 smithi022 ceph-mon[30966]: from='client.? 172.21.15.45:0/1330436109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:48 smithi169 ceph-mon[35628]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:48.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:48 smithi169 ceph-mon[35628]: from='client.? 172.21.15.45:0/1330436109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:48 smithi045 ceph-mon[35556]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:48 smithi045 ceph-mon[35556]: from='client.? 172.21.15.45:0/1330436109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:50 smithi022 ceph-mon[30966]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:50.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:50 smithi169 ceph-mon[35628]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:50 smithi045 ceph-mon[35556]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:52 smithi045 ceph-mon[35556]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:52.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:52 smithi022 ceph-mon[30966]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:52.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:52 smithi169 ceph-mon[35628]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:54.511 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:54 smithi045 ceph-mon[35556]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:54 smithi022 ceph-mon[30966]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:54.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:54 smithi169 ceph-mon[35628]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:55.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:55 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:25:55.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:55 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:55.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:25:55.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:55 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:55.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:55 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:25:55.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:55 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:56.525 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:56 smithi045 ceph-mon[35556]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:56.525 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:56 smithi045 ceph-mon[35556]: Deploying daemon osd.10 on smithi045 2024-09-11T22:25:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:56 smithi022 ceph-mon[30966]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:56.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:56 smithi022 ceph-mon[30966]: Deploying daemon osd.10 on smithi045 2024-09-11T22:25:56.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:56 smithi169 ceph-mon[35628]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:56.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:56 smithi169 ceph-mon[35628]: Deploying daemon osd.10 on smithi045 2024-09-11T22:25:58.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:25:58 smithi045 ceph-mon[35556]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:58.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:25:58 smithi022 ceph-mon[30966]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:25:58.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:25:58 smithi169 ceph-mon[35628]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:00.455 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:00 smithi169 ceph-mon[35628]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:00.461 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:00 smithi045 ceph-mon[35556]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:00.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:00 smithi022 ceph-mon[30966]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:01.503 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:01.504 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:01.504 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:01.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:02.489 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:02 smithi045 ceph-mon[35556]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:02.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:02 smithi022 ceph-mon[30966]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:02.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:02 smithi169 ceph-mon[35628]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:04.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.232+0000 7f8d6a7fc640 1 -- 172.21.15.45:0/3338535773 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f8d74062630 con 0x7f8d600a2b80 2024-09-11T22:26:04.233 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 10 on host 'smithi045' 2024-09-11T22:26:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 msgr2=0x7f8d600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 0x7f8d600a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d70031570 tx=0x7f8d70031640 comp rx=0 tx=0).stop 2024-09-11T22:26:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 msgr2=0x7f8d74109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400d950 tx=0x7f8d6400de10 comp rx=0 tx=0).stop 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 shutdown_connections 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d74102690 0x7f8d74109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d74101cd0 0x7f8d74109aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f8d600a2b80 0x7f8d600a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 --2- 172.21.15.45:0/3338535773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d74100ad0 0x7f8d7410b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 >> 172.21.15.45:0/3338535773 conn(0x7f8d740fc280 msgr2=0x7f8d74105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 shutdown_connections 2024-09-11T22:26:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-11T22:26:04.234+0000 7f8d7b92d640 1 -- 172.21.15.45:0/3338535773 wait complete. 2024-09-11T22:26:04.603 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:04.604 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.604 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.604 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:04.604 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:04.604 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:04.899 DEBUG:teuthology.orchestra.run.smithi045:osd.10> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T22:26:04.942 INFO:tasks.cephadm:Deploying osd.11 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-11T22:26:04.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:26:05.199 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:26:05.320 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:05.321 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:05.321 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:05 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:05 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:05.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:05 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:05.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:05 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:05.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:05 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:06.329 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:06 smithi045 ceph-mon[35556]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:06.540 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:06 smithi169 ceph-mon[35628]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:06.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:06 smithi022 ceph-mon[30966]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:07.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:07 smithi169 ceph-mon[35628]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:07 smithi169 ceph-mon[35628]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:07 smithi045 ceph-mon[35556]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:07 smithi045 ceph-mon[35556]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:26:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:26:07.192+0000 7f2b5417f640 -1 osd.10 0 log_to_monitors true 2024-09-11T22:26:07.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:07 smithi022 ceph-mon[30966]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:07 smithi022 ceph-mon[30966]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:07.766 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-11T22:26:07.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-11T22:26:08.052 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:26:08.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:08.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:08.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T22:26:08.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:08.466 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:08 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1091715065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958101cd0 msgr2=0x7ff958102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1091715065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958101cd0 0x7ff958102150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff940009900 tx=0x7ff94002a410 comp rx=0 tx=0).stop 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1091715065 shutdown_connections 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1091715065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 0x7ff958108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1091715065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958101cd0 0x7ff958102150 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1091715065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958100ad0 0x7ff958100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1091715065 >> 172.21.15.169:0/1091715065 conn(0x7ff9580fc280 msgr2=0x7ff9580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1091715065 shutdown_connections 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1091715065 wait complete. 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.501+0000 7ff95d6c4640 1 Processor -- start 2024-09-11T22:26:08.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 -- start start 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 0x7ff95819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 0x7ff95819f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff95810c890 con 0x7ff958101cd0 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff95810c710 con 0x7ff958102690 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff95d6c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff95810ca10 con 0x7ff958100ad0 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55182/0 (socket says 172.21.15.169:55182) 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 -- 172.21.15.169:0/1313459969 learned_addr learned my addr 172.21.15.169:0/1313459969 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff9577fe640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 0x7ff95819f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff94e7fc640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 0x7ff95819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:08.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 -- 172.21.15.169:0/1313459969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 msgr2=0x7ff95819f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 0x7ff95819f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 -- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 msgr2=0x7ff95819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 0x7ff95819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 -- 172.21.15.169:0/1313459969 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95819fb40 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff94e7fc640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 0x7ff95819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff956ffd640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c970 tx=0x7ff94800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.502+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff948007c10 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.503+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95819fe30 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.503+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff948007db0 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.503+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94800f9b0 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.503+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9581a02e0 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.504+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff958107e50 con 0x7ff958100ad0 2024-09-11T22:26:08.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.505+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff94800fb50 con 0x7ff958100ad0 2024-09-11T22:26:08.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.506+0000 7ff954ff9640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 0x7ff9440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:08.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.506+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7ff9480cef80 con 0x7ff958100ad0 2024-09-11T22:26:08.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.506+0000 7ff94e7fc640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 0x7ff9440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:08.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.506+0000 7ff94e7fc640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 0x7ff9440a5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:08.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.509+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff948026080 con 0x7ff958100ad0 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:08 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:08.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:08.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:08.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:08.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:08.685+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff958062630 con 0x7ff9440a2b80 2024-09-11T22:26:09.161 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:26:08.893+0000 7f2b4f8df640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T22:26:09.161 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:26:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:26:08.904+0000 7f2b47f11640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:26:09.395 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi045 2024-09-11T22:26:09.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-11T22:26:09.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:26:09.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:26:09.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] boot 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T22:26:09.401 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi045 2024-09-11T22:26:09.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-11T22:26:09.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:26:09.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] boot 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T22:26:09.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi045 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:09.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: osd.10 [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] boot 2024-09-11T22:26:09.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T22:26:09.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:10.383 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:10 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:26:10.384 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:10 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:26:10.384 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:10 smithi169 ceph-mon[35628]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:10.384 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:10 smithi169 ceph-mon[35628]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:10.384 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:10 smithi169 ceph-mon[35628]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T22:26:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:10 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:26:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:10 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:26:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:10 smithi022 ceph-mon[30966]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:10 smithi022 ceph-mon[30966]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:10 smithi022 ceph-mon[30966]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T22:26:10.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:10 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:26:10.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:10 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:26:10.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:10 smithi045 ceph-mon[35556]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:10.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:10 smithi045 ceph-mon[35556]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:10.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:10 smithi045 ceph-mon[35556]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T22:26:11.529 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:11 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/3259606754' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.530 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:11 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.530 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:11 smithi169 ceph-mon[35628]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]': finished 2024-09-11T22:26:11.530 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:11 smithi169 ceph-mon[35628]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T22:26:11.530 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:11 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:11 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/3259606754' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:11 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:11 smithi022 ceph-mon[30966]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]': finished 2024-09-11T22:26:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:11 smithi022 ceph-mon[30966]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T22:26:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:11 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:11.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:11 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/3259606754' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:11 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]: dispatch 2024-09-11T22:26:11.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:11 smithi045 ceph-mon[35556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb6aa919-e469-40a8-a10a-533d098108e8"}]': finished 2024-09-11T22:26:11.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:11 smithi045 ceph-mon[35556]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T22:26:11.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:11 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:12 smithi022 ceph-mon[30966]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:12 smithi022 ceph-mon[30966]: from='client.? 172.21.15.169:0/4089126083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:12 smithi022 ceph-mon[30966]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T22:26:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:12.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:12 smithi169 ceph-mon[35628]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:12.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:12 smithi169 ceph-mon[35628]: from='client.? 172.21.15.169:0/4089126083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:12.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:12 smithi169 ceph-mon[35628]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T22:26:12.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:12 smithi045 ceph-mon[35556]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:12 smithi045 ceph-mon[35556]: from='client.? 172.21.15.169:0/4089126083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:12 smithi045 ceph-mon[35556]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T22:26:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:14 smithi022 ceph-mon[30966]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:14 smithi022 ceph-mon[30966]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:14 smithi169 ceph-mon[35628]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:14 smithi169 ceph-mon[35628]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:26:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:14 smithi045 ceph-mon[35556]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:14 smithi045 ceph-mon[35556]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T22:26:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:16.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:16 smithi022 ceph-mon[30966]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:16.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:16 smithi169 ceph-mon[35628]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:16.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:16 smithi045 ceph-mon[35556]: pgmap v235: 1 pgs: 1 remapped+peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:18.380 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:18 smithi169 ceph-mon[35628]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:18.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:18 smithi022 ceph-mon[30966]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:18.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:18 smithi045 ceph-mon[35556]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:20 smithi022 ceph-mon[30966]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:20 smithi169 ceph-mon[35628]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:26:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:20 smithi045 ceph-mon[35556]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T22:26:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:26:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:21.300 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:21 smithi169 ceph-mon[35628]: Deploying daemon osd.11 on smithi169 2024-09-11T22:26:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:21 smithi022 ceph-mon[30966]: Deploying daemon osd.11 on smithi169 2024-09-11T22:26:21.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:21 smithi045 ceph-mon[35556]: Deploying daemon osd.11 on smithi169 2024-09-11T22:26:22.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:22 smithi022 ceph-mon[30966]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T22:26:22.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:22 smithi169 ceph-mon[35628]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T22:26:22.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:22 smithi045 ceph-mon[35556]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T22:26:24.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:24 smithi022 ceph-mon[30966]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:24.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:24 smithi169 ceph-mon[35628]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:24 smithi045 ceph-mon[35556]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:26.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:26 smithi022 ceph-mon[30966]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T22:26:26.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:26.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:26.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:26 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:26.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:26 smithi169 ceph-mon[35628]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T22:26:26.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:26.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:26.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:26 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:26 smithi045 ceph-mon[35556]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T22:26:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:26 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:26:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:28.764 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 11 on host 'smithi169' 2024-09-11T22:26:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.763+0000 7ff954ff9640 1 -- 172.21.15.169:0/1313459969 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff958062630 con 0x7ff9440a2b80 2024-09-11T22:26:28.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 msgr2=0x7ff9440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 0x7ff9440a5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940009560 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 msgr2=0x7ff95806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c970 tx=0x7ff94800ce30 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 shutdown_connections 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff958102690 0x7ff95819f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff958101cd0 0x7ff95819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9440a2b80 0x7ff9440a5040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 --2- 172.21.15.169:0/1313459969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff958100ad0 0x7ff95806ab10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 >> 172.21.15.169:0/1313459969 conn(0x7ff9580fc280 msgr2=0x7ff958105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 shutdown_connections 2024-09-11T22:26:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:28.766+0000 7ff95d6c4640 1 -- 172.21.15.169:0/1313459969 wait complete. 2024-09-11T22:26:29.391 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:29.392 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.392 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:29 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:29.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:29 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:29.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:29 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:29.419 DEBUG:teuthology.orchestra.run.smithi169:osd.11> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T22:26:29.421 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T22:26:29.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:26:29.692 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 -- 172.21.15.22:0/195510386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4101c00 msgr2=0x7fb8e4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 --2- 172.21.15.22:0/195510386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4101c00 0x7fb8e4102000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009900 tx=0x7fb8d402a410 comp rx=0 tx=0).stop 2024-09-11T22:26:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 -- 172.21.15.22:0/195510386 shutdown_connections 2024-09-11T22:26:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 --2- 172.21.15.22:0/195510386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e41037c0 0x7fb8e410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 --2- 172.21.15.22:0/195510386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e4102e00 0x7fb8e4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 --2- 172.21.15.22:0/195510386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4101c00 0x7fb8e4102000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 -- 172.21.15.22:0/195510386 >> 172.21.15.22:0/195510386 conn(0x7fb8e40fd390 msgr2=0x7fb8e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 -- 172.21.15.22:0/195510386 shutdown_connections 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.199+0000 7fb8e89de640 1 -- 172.21.15.22:0/195510386 wait complete. 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 Processor -- start 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 -- start start 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e4101c00 0x7fb8e4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:30.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e41037c0 0x7fb8e4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410d9c0 con 0x7fb8e4102e00 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410d840 con 0x7fb8e4101c00 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e89de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410db40 con 0x7fb8e41037c0 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.200+0000 7fb8e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e4101c00 0x7fb8e4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38024/0 (socket says 172.21.15.22:38024) 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 -- 172.21.15.22:0/2208196077 learned_addr learned my addr 172.21.15.22:0/2208196077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e2d9d640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e41037c0 0x7fb8e4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 -- 172.21.15.22:0/2208196077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e41037c0 msgr2=0x7fb8e4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e41037c0 0x7fb8e4074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 -- 172.21.15.22:0/2208196077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e4101c00 msgr2=0x7fb8e4075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e4101c00 0x7fb8e4075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 -- 172.21.15.22:0/2208196077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e40753e0 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e1d9b640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00c920 tx=0x7fb8cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc007c70 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8cc007e10 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e41a20a0 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc018940 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.201+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e41a2600 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.202+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e4108f30 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.203+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb8cc018b20 con 0x7fb8e4102e00 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.204+0000 7fb8db7fe640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 0x7fb8d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:30.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.204+0000 7fb8e259c640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 0x7fb8d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:30.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.204+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fb8cc0ceb50 con 0x7fb8e4102e00 2024-09-11T22:26:30.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.205+0000 7fb8e259c640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 0x7fb8d00a50c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4031570 tx=0x7fb8d4031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:30.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.208+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8cc014030 con 0x7fb8e4102e00 2024-09-11T22:26:30.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.382+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb8e402da10 con 0x7fb8e4102e00 2024-09-11T22:26:30.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.382+0000 7fb8db7fe640 1 -- 172.21.15.22:0/2208196077 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fb8cc09c090 con 0x7fb8e4102e00 2024-09-11T22:26:30.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:30 smithi022 ceph-mon[30966]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 msgr2=0x7fb8d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 0x7fb8d00a50c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4031570 tx=0x7fb8d4031640 comp rx=0 tx=0).stop 2024-09-11T22:26:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 msgr2=0x7fb8e40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:30.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00c920 tx=0x7fb8cc00cde0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 shutdown_connections 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8d00a2c00 0x7fb8d00a50c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8e41037c0 0x7fb8e4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e4102e00 0x7fb8e40745e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 --2- 172.21.15.22:0/2208196077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8e4101c00 0x7fb8e4075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:30.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 >> 172.21.15.22:0/2208196077 conn(0x7fb8e40fd390 msgr2=0x7fb8e4106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:30.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 shutdown_connections 2024-09-11T22:26:30.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:30.385+0000 7fb8e89de640 1 -- 172.21.15.22:0/2208196077 wait complete. 2024-09-11T22:26:30.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:30 smithi169 ceph-mon[35628]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:30 smithi045 ceph-mon[35556]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:31.090 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726093569,"num_in_osds":12,"osd_in_since":1726093571,"num_remapped_pgs":0} 2024-09-11T22:26:31.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2208196077' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:31.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2208196077' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:31.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2208196077' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:31.817 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:26:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:26:31.580+0000 7f5cd8f17640 -1 osd.11 0 log_to_monitors true 2024-09-11T22:26:32.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:26:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:32.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:32 smithi022 ceph-mon[30966]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:32.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:32 smithi022 ceph-mon[30966]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:32 smithi022 ceph-mon[30966]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:32 smithi169 ceph-mon[35628]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:32.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:32 smithi169 ceph-mon[35628]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:32 smithi169 ceph-mon[35628]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:32 smithi045 ceph-mon[35556]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:32 smithi045 ceph-mon[35556]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:32 smithi045 ceph-mon[35556]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:26:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 -- 172.21.15.22:0/67046224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 msgr2=0x7fce88103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 --2- 172.21.15.22:0/67046224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce88103280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009900 tx=0x7fce7c02a410 comp rx=0 tx=0).stop 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 -- 172.21.15.22:0/67046224 shutdown_connections 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 --2- 172.21.15.22:0/67046224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 0x7fce8810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 --2- 172.21.15.22:0/67046224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce88103280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 --2- 172.21.15.22:0/67046224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 0x7fce88102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 -- 172.21.15.22:0/67046224 >> 172.21.15.22:0/67046224 conn(0x7fce880fd390 msgr2=0x7fce880ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 -- 172.21.15.22:0/67046224 shutdown_connections 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.833+0000 7fce8dd18640 1 -- 172.21.15.22:0/67046224 wait complete. 2024-09-11T22:26:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 Processor -- start 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 -- start start 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 0x7fce8819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 0x7fce881a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fce8810dac0 con 0x7fce88102e00 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce8810d940 con 0x7fce881037c0 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce8dd18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce8810dc40 con 0x7fce88101c00 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38048/0 (socket says 172.21.15.22:38048) 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce86ffd640 1 -- 172.21.15.22:0/4148670079 learned_addr learned my addr 172.21.15.22:0/4148670079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce877fe640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 0x7fce8819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.834+0000 7fce87fff640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 0x7fce881a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 -- 172.21.15.22:0/4148670079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 msgr2=0x7fce8819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 0x7fce8819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 -- 172.21.15.22:0/4148670079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 msgr2=0x7fce881a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 0x7fce881a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 -- 172.21.15.22:0/4148670079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce881a1fc0 con 0x7fce88102e00 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce86ffd640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009a20 tx=0x7fce7c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c03f030 con 0x7fce88102e00 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce7c003d00 con 0x7fce88102e00 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce881a2250 con 0x7fce88102e00 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c035070 con 0x7fce88102e00 2024-09-11T22:26:32.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.835+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce881a27b0 con 0x7fce88102e00 2024-09-11T22:26:32.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.836+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce881a2a10 con 0x7fce88102e00 2024-09-11T22:26:32.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.837+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fce7c042030 con 0x7fce88102e00 2024-09-11T22:26:32.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.838+0000 7fce84ff9640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 0x7fce700a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:32.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.839+0000 7fce877fe640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 0x7fce700a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:32.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.839+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7fce7c0ef1c0 con 0x7fce88102e00 2024-09-11T22:26:32.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.839+0000 7fce877fe640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 0x7fce700a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce88102c60 tx=0x7fce78009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:32.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:32.843+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce7c0bc6f0 con 0x7fce88102e00 2024-09-11T22:26:33.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.018+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fce881a30e0 con 0x7fce88102e00 2024-09-11T22:26:33.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.018+0000 7fce84ff9640 1 -- 172.21.15.22:0/4148670079 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fce7c0bbff0 con 0x7fce88102e00 2024-09-11T22:26:33.019 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 msgr2=0x7fce700a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 0x7fce700a5070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce88102c60 tx=0x7fce78009110 comp rx=0 tx=0).stop 2024-09-11T22:26:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 msgr2=0x7fce8819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009a20 tx=0x7fce7c004430 comp rx=0 tx=0).stop 2024-09-11T22:26:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 shutdown_connections 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce881037c0 0x7fce881a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce88102e00 0x7fce8819a8d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce700a2bb0 0x7fce700a5070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.020+0000 7fce8dd18640 1 --2- 172.21.15.22:0/4148670079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce88101c00 0x7fce8819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.021+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 >> 172.21.15.22:0/4148670079 conn(0x7fce880fd390 msgr2=0x7fce881085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.021+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 shutdown_connections 2024-09-11T22:26:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:33.021+0000 7fce8dd18640 1 -- 172.21.15.22:0/4148670079 wait complete. 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: Detected new or changed devices on smithi169 2024-09-11T22:26:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:33 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4148670079' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:33.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: Detected new or changed devices on smithi169 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-11T22:26:33.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:33.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:33.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4148670079' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:33.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:26:33.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: Detected new or changed devices on smithi169 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:33.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:33.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:33.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:33 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4148670079' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:33.743 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726093569,"num_in_osds":12,"osd_in_since":1726093571,"num_remapped_pgs":0} 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:34 smithi022 ceph-mon[30966]: from='osd.11 ' entity='osd.11' 2024-09-11T22:26:34.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:26:33.952+0000 7f5cd4677640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T22:26:34.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:26:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:26:33.967+0000 7f5cccca9640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:34 smithi169 ceph-mon[35628]: from='osd.11 ' entity='osd.11' 2024-09-11T22:26:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-11T22:26:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:26:34.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:34.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:34 smithi045 ceph-mon[35556]: from='osd.11 ' entity='osd.11' 2024-09-11T22:26:34.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:26:35.013 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: purged_snaps scrub starts 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: purged_snaps scrub ok 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] boot 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T22:26:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:35 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: purged_snaps scrub starts 2024-09-11T22:26:35.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: purged_snaps scrub ok 2024-09-11T22:26:35.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] boot 2024-09-11T22:26:35.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T22:26:35.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:35 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1998586084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 msgr2=0x7f82d8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1998586084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8104a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009900 tx=0x7f82d402a410 comp rx=0 tx=0).stop 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1998586084 shutdown_connections 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1998586084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 0x7f82d8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1998586084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1998586084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8104a50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.500+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1998586084 >> 172.21.15.22:0/1998586084 conn(0x7f82d80fc280 msgr2=0x7f82d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1998586084 shutdown_connections 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1998586084 wait complete. 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 Processor -- start 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- start start 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 0x7f82d819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f82d810d990 con 0x7f82d8102660 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f82d810d810 con 0x7f82d81078c0 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.501+0000 7f82dfa8f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82d810db10 con 0x7f82d8104f90 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55382/0 (socket says 172.21.15.22:55382) 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 -- 172.21.15.22:0/1387473060 learned_addr learned my addr 172.21.15.22:0/1387473060 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82de02c640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 0x7f82d819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd02a640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 -- 172.21.15.22:0/1387473060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 msgr2=0x7f82d81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 -- 172.21.15.22:0/1387473060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 msgr2=0x7f82d819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 0x7f82d819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 -- 172.21.15.22:0/1387473060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d819fbc0 con 0x7f82d8102660 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd02a640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dd82b640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a20 tx=0x7f82d4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d403f030 con 0x7f82d8102660 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f82d4003dc0 con 0x7f82d8102660 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4035070 con 0x7f82d8102660 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.502+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d819fe50 con 0x7f82d8102660 2024-09-11T22:26:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.503+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d81a02a0 con 0x7f82d8102660 2024-09-11T22:26:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.504+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80fdd70 con 0x7f82d8102660 2024-09-11T22:26:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.505+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f82d4042030 con 0x7f82d8102660 2024-09-11T22:26:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.505+0000 7f82ceffd640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 0x7f82c40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.506+0000 7f82dd02a640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 0x7f82c40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.506+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f82d40ef6c0 con 0x7f82d8102660 2024-09-11T22:26:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.506+0000 7f82dd02a640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 0x7f82c40a50f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82d81994b0 tx=0x7f82c8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:35.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.509+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82d40bcac0 con 0x7f82d8102660 2024-09-11T22:26:35.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: purged_snaps scrub starts 2024-09-11T22:26:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: purged_snaps scrub ok 2024-09-11T22:26:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: osd.11 [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] boot 2024-09-11T22:26:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T22:26:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:35 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.684+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f82d802da30 con 0x7f82d8102660 2024-09-11T22:26:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.684+0000 7f82ceffd640 1 -- 172.21.15.22:0/1387473060 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f82d40bc3c0 con 0x7f82d8102660 2024-09-11T22:26:35.685 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 msgr2=0x7f82c40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 0x7f82c40a50f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82d81994b0 tx=0x7f82c8005d90 comp rx=0 tx=0).stop 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 msgr2=0x7f82d8197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a20 tx=0x7f82d4004430 comp rx=0 tx=0).stop 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 shutdown_connections 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d81078c0 0x7f82d819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f82c40a2c30 0x7f82c40a50f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82d8104f90 0x7f82d81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 --2- 172.21.15.22:0/1387473060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82d8102660 0x7f82d8197f90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 >> 172.21.15.22:0/1387473060 conn(0x7f82d80fc280 msgr2=0x7f82d8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.686+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 shutdown_connections 2024-09-11T22:26:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:35.687+0000 7f82dfa8f640 1 -- 172.21.15.22:0/1387473060 wait complete. 2024-09-11T22:26:36.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:36 smithi022 ceph-mon[30966]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:36.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:36 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1387473060' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:36.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:36 smithi045 ceph-mon[35556]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:36.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:36 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1387473060' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:36.412 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726093594,"num_in_osds":12,"osd_in_since":1726093571,"num_remapped_pgs":0} 2024-09-11T22:26:36.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:26:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:36 smithi169 ceph-mon[35628]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:36 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1387473060' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:26:36.669 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- 172.21.15.22:0/3983968426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 msgr2=0x7f3638114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 --2- 172.21.15.22:0/3983968426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f3638114f80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3630009ca0 tx=0x7f363002a950 comp rx=0 tx=0).stop 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- 172.21.15.22:0/3983968426 shutdown_connections 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 --2- 172.21.15.22:0/3983968426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f3638114f80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 --2- 172.21.15.22:0/3983968426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074eb0 0x7f3638112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 --2- 172.21.15.22:0/3983968426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074590 0x7f3638074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- 172.21.15.22:0/3983968426 >> 172.21.15.22:0/3983968426 conn(0x7f36380fd8c0 msgr2=0x7f36380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:37.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- 172.21.15.22:0/3983968426 shutdown_connections 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- 172.21.15.22:0/3983968426 wait complete. 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 Processor -- start 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.115+0000 7f363edeb640 1 -- start start 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 0x7f36381a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 0x7f36381a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36381186b0 con 0x7f3638112b90 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3638118530 con 0x7f3638074eb0 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363edeb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3638118830 con 0x7f3638074590 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55406/0 (socket says 172.21.15.22:55406) 2024-09-11T22:26:37.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 -- 172.21.15.22:0/3931851114 learned_addr learned my addr 172.21.15.22:0/3931851114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363cb87640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 0x7f36381a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f3637fff640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 0x7f36381a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 -- 172.21.15.22:0/3931851114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 msgr2=0x7f36381a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 0x7f36381a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 -- 172.21.15.22:0/3931851114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 msgr2=0x7f36381a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 0x7f36381a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 -- 172.21.15.22:0/3931851114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363819f090 con 0x7f3638112b90 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f3637fff640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 0x7f36381a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363cb87640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 0x7f36381a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.116+0000 7f363d388640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3630005cc0 tx=0x7f363002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.117+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630034040 con 0x7f3638112b90 2024-09-11T22:26:37.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.117+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3630030940 con 0x7f3638112b90 2024-09-11T22:26:37.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.117+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363819f320 con 0x7f3638112b90 2024-09-11T22:26:37.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.117+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630045480 con 0x7f3638112b90 2024-09-11T22:26:37.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.117+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36381ab670 con 0x7f3638112b90 2024-09-11T22:26:37.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.118+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3638074970 con 0x7f3638112b90 2024-09-11T22:26:37.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.119+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3630037020 con 0x7f3638112b90 2024-09-11T22:26:37.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.120+0000 7f3635ffb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 0x7f36280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.120+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f36300efcd0 con 0x7f3638112b90 2024-09-11T22:26:37.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.120+0000 7f363cb87640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 0x7f36280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.121+0000 7f363cb87640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 0x7f36280a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f362c005d00 tx=0x7f362c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:37.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.123+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36300bd150 con 0x7f3638112b90 2024-09-11T22:26:37.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.303+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36381ab8a0 con 0x7f3638112b90 2024-09-11T22:26:37.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.304+0000 7f3635ffb640 1 -- 172.21.15.22:0/3931851114 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18444 (secure 0 0 0) 0x7f3630030b10 con 0x7f3638112b90 2024-09-11T22:26:37.305 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:37.305 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":75,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:26:36.154190+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:26:37.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 msgr2=0x7f36280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:37.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 0x7f36280a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f362c005d00 tx=0x7f362c005c70 comp rx=0 tx=0).stop 2024-09-11T22:26:37.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 msgr2=0x7f363819e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3630005cc0 tx=0x7f363002f790 comp rx=0 tx=0).stop 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 shutdown_connections 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3638112b90 0x7f363819e960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3638074eb0 0x7f36381a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f36280a2c00 0x7f36280a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 --2- 172.21.15.22:0/3931851114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3638074590 0x7f36381a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 >> 172.21.15.22:0/3931851114 conn(0x7f36380fd8c0 msgr2=0x7f36380fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 shutdown_connections 2024-09-11T22:26:37.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:37.307+0000 7f363edeb640 1 -- 172.21.15.22:0/3931851114 wait complete. 2024-09-11T22:26:37.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:37 smithi022 ceph-mon[30966]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T22:26:37.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:37 smithi169 ceph-mon[35628]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T22:26:37.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:37 smithi045 ceph-mon[35556]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T22:26:38.036 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:22:47.028188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:26:38.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T22:26:38.293 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:38.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:38 smithi022 ceph-mon[30966]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:38.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:38 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3931851114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:26:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:38 smithi169 ceph-mon[35628]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:38 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3931851114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:26:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:38 smithi045 ceph-mon[35556]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:38 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3931851114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/1436326918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 msgr2=0x7f9fc8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/1436326918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009930 tx=0x7f9fb802a420 comp rx=0 tx=0).stop 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/1436326918 shutdown_connections 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/1436326918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fc8101420 0x7f9fc810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/1436326918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/1436326918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8106a80 0x7f9fc8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/1436326918 >> 172.21.15.22:0/1436326918 conn(0x7f9fc80fc7a0 msgr2=0x7f9fc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/1436326918 shutdown_connections 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.751+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/1436326918 wait complete. 2024-09-11T22:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 Processor -- start 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 -- start start 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8101420 0x7f9fc8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fc8106a80 0x7f9fc81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc8110f60 con 0x7f9fc8100a80 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc8110de0 con 0x7f9fc8101420 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcf5f7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc81110e0 con 0x7f9fc8106a80 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcd393640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcd393640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55434/0 (socket says 172.21.15.22:55434) 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fcd393640 1 -- 172.21.15.22:0/2451521004 learned_addr learned my addr 172.21.15.22:0/2451521004 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.752+0000 7f9fccb92640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8101420 0x7f9fc8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 -- 172.21.15.22:0/2451521004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fc8106a80 msgr2=0x7f9fc81030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fc8106a80 0x7f9fc81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 -- 172.21.15.22:0/2451521004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8101420 msgr2=0x7f9fc8102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8101420 0x7f9fc8102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 -- 172.21.15.22:0/2451521004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc81a69e0 con 0x7f9fc8100a80 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcd393640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400d950 tx=0x7f9fc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4017070 con 0x7f9fc8100a80 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc4009c30 con 0x7f9fc8100a80 2024-09-11T22:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc81a6cd0 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400f740 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.753+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc81a71d0 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.754+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc8100ee0 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.755+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9fc4010a80 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.756+0000 7f9fbe7fc640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 0x7f9fb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.756+0000 7f9fccb92640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 0x7f9fb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.756+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f9fc40ce700 con 0x7f9fc8100a80 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.756+0000 7f9fccb92640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 0x7f9fb40a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.760+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fc4009de0 con 0x7f9fc8100a80 2024-09-11T22:26:38.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.935+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9fc81a7520 con 0x7f9fc8100a80 2024-09-11T22:26:38.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.935+0000 7f9fbe7fc640 1 -- 172.21.15.22:0/2451521004 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f9fc409bb00 con 0x7f9fc8100a80 2024-09-11T22:26:38.936 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-11T22:26:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.937+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 msgr2=0x7f9fb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.937+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 0x7f9fb40a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb80058d0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.937+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 msgr2=0x7f9fc8102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:38.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.937+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400d950 tx=0x7f9fc400de10 comp rx=0 tx=0).stop 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 shutdown_connections 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9fb40a2c00 0x7f9fb40a50c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fc8106a80 0x7f9fc81030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fc8101420 0x7f9fc8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 --2- 172.21.15.22:0/2451521004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fc8100a80 0x7f9fc8102650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 >> 172.21.15.22:0/2451521004 conn(0x7f9fc80fc7a0 msgr2=0x7f9fc8104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 shutdown_connections 2024-09-11T22:26:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:38.938+0000 7f9fcf5f7640 1 -- 172.21.15.22:0/2451521004 wait complete. 2024-09-11T22:26:39.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:39 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2451521004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:26:39.653 INFO:tasks.cephadm:Adding mds.a on smithi022 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.d on smithi022 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.g on smithi022 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.j on smithi022 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.b on smithi045 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.e on smithi045 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.h on smithi045 2024-09-11T22:26:39.663 INFO:tasks.cephadm:Adding mds.k on smithi045 2024-09-11T22:26:39.664 INFO:tasks.cephadm:Adding mds.c on smithi169 2024-09-11T22:26:39.664 INFO:tasks.cephadm:Adding mds.f on smithi169 2024-09-11T22:26:39.664 INFO:tasks.cephadm:Adding mds.i on smithi169 2024-09-11T22:26:39.664 INFO:tasks.cephadm:Adding mds.l on smithi169 2024-09-11T22:26:39.664 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l' 2024-09-11T22:26:39.665 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:39 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2451521004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:26:39.665 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:39 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2451521004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:26:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:26:40.369 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:40 smithi169 ceph-mon[35628]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 -- 172.21.15.169:0/2759940323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a60101d10 msgr2=0x7f9a60102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 --2- 172.21.15.169:0/2759940323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a60101d10 0x7f9a60102190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009900 tx=0x7f9a4802a410 comp rx=0 tx=0).stop 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 -- 172.21.15.169:0/2759940323 shutdown_connections 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 --2- 172.21.15.169:0/2759940323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a601026d0 0x7f9a60108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 --2- 172.21.15.169:0/2759940323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a60101d10 0x7f9a60102190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 --2- 172.21.15.169:0/2759940323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60100b10 0x7f9a60100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 -- 172.21.15.169:0/2759940323 >> 172.21.15.169:0/2759940323 conn(0x7f9a600fc2a0 msgr2=0x7f9a600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 -- 172.21.15.169:0/2759940323 shutdown_connections 2024-09-11T22:26:40.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.367+0000 7f9a6660f640 1 -- 172.21.15.169:0/2759940323 wait complete. 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 Processor -- start 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 -- start start 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a60100b10 0x7f9a6006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60101d10 0x7f9a6019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6010c8d0 con 0x7f9a60101d10 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6010c750 con 0x7f9a60100b10 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a6660f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6010ca50 con 0x7f9a601026d0 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a64bac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a64bac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:37380/0 (socket says 172.21.15.169:37380) 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.368+0000 7f9a64bac640 1 -- 172.21.15.169:0/1428933999 learned_addr learned my addr 172.21.15.169:0/1428933999 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a5ffff640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a60100b10 0x7f9a6006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a5f7fe640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60101d10 0x7f9a6019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 -- 172.21.15.169:0/1428933999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a60100b10 msgr2=0x7f9a6006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a60100b10 0x7f9a6006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 -- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60101d10 msgr2=0x7f9a6019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60101d10 0x7f9a6019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 -- 172.21.15.169:0/1428933999 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6019fc50 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a64bac640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800eaa0 tx=0x7f9a5800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800cdb0 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6019fee0 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a58004b20 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58011760 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.369+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a601a0390 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.370+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a60107ee0 con 0x7f9a601026d0 2024-09-11T22:26:40.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.371+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9a58011900 con 0x7f9a601026d0 2024-09-11T22:26:40.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.372+0000 7f9a5d7fa640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 0x7f9a4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.372+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f9a580ced80 con 0x7f9a601026d0 2024-09-11T22:26:40.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.372+0000 7f9a5ffff640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 0x7f9a4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.372+0000 7f9a5ffff640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 0x7f9a4c0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9a60101b70 tx=0x7f9a5000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.376+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a58016030 con 0x7f9a601026d0 2024-09-11T22:26:40.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.554+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}) -- 0x7f9a600627f0 con 0x7f9a4c0a2b80 2024-09-11T22:26:40.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.562+0000 7f9a5d7fa640 1 -- 172.21.15.169:0/1428933999 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9a600627f0 con 0x7f9a4c0a2b80 2024-09-11T22:26:40.563 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mds.all update... 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 msgr2=0x7f9a4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 0x7f9a4c0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9a60101b70 tx=0x7f9a5000b390 comp rx=0 tx=0).stop 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 msgr2=0x7f9a6019f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800eaa0 tx=0x7f9a5800ef60 comp rx=0 tx=0).stop 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 shutdown_connections 2024-09-11T22:26:40.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9a4c0a2b80 0x7f9a4c0a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a601026d0 0x7f9a6019f340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a60101d10 0x7f9a6019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 --2- 172.21.15.169:0/1428933999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a60100b10 0x7f9a6006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 >> 172.21.15.169:0/1428933999 conn(0x7f9a600fc2a0 msgr2=0x7f9a601050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 shutdown_connections 2024-09-11T22:26:40.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-11T22:26:40.565+0000 7f9a6660f640 1 -- 172.21.15.169:0/1428933999 wait complete. 2024-09-11T22:26:40.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:40 smithi022 ceph-mon[30966]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:40 smithi045 ceph-mon[35556]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:41.202 DEBUG:teuthology.orchestra.run.smithi022:mds.a> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T22:26:41.205 DEBUG:teuthology.orchestra.run.smithi022:mds.d> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T22:26:41.248 DEBUG:teuthology.orchestra.run.smithi022:mds.g> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T22:26:41.291 DEBUG:teuthology.orchestra.run.smithi022:mds.j> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T22:26:41.334 DEBUG:teuthology.orchestra.run.smithi045:mds.b> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T22:26:41.337 DEBUG:teuthology.orchestra.run.smithi045:mds.e> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T22:26:41.363 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:41.364 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:41 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.379 DEBUG:teuthology.orchestra.run.smithi045:mds.h> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T22:26:41.423 DEBUG:teuthology.orchestra.run.smithi045:mds.k> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T22:26:41.442 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:41.442 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-11T22:26:41.442 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:41.443 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:41 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.444 DEBUG:teuthology.orchestra.run.smithi169:mds.c> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T22:26:41.446 DEBUG:teuthology.orchestra.run.smithi169:mds.f> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T22:26:41.490 DEBUG:teuthology.orchestra.run.smithi169:mds.i> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T22:26:41.533 DEBUG:teuthology.orchestra.run.smithi169:mds.l> sudo journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T22:26:41.576 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T22:26:41.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:41.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:41 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.834 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:42.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:42 smithi022 ceph-mon[30966]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:42.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:42 smithi022 ceph-mon[30966]: Deploying daemon mds.l on smithi169 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 -- 172.21.15.22:0/27808673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10102de0 msgr2=0x7f9b101031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/27808673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10102de0 0x7f9b101031c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009900 tx=0x7f9b0002a480 comp rx=0 tx=0).stop 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 -- 172.21.15.22:0/27808673 shutdown_connections 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/27808673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 0x7f9b1010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/27808673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10103700 0x7f9b1010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/27808673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10102de0 0x7f9b101031c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 -- 172.21.15.22:0/27808673 >> 172.21.15.22:0/27808673 conn(0x7f9b100fc7a0 msgr2=0x7f9b100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 -- 172.21.15.22:0/27808673 shutdown_connections 2024-09-11T22:26:42.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.299+0000 7f9b15cbb640 1 -- 172.21.15.22:0/27808673 wait complete. 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 Processor -- start 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 -- start start 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 0x7f9b10198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 0x7f9b1019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101120f0 con 0x7f9b10103700 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10111f70 con 0x7f9b10102de0 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b15cbb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10112270 con 0x7f9b1010c180 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b07fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55454/0 (socket says 172.21.15.22:55454) 2024-09-11T22:26:42.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.300+0000 7f9b07fff640 1 -- 172.21.15.22:0/1119984496 learned_addr learned my addr 172.21.15.22:0/1119984496 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0f7fe640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 0x7f9b10198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0ffff640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 0x7f9b1019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 -- 172.21.15.22:0/1119984496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 msgr2=0x7f9b1019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 0x7f9b1019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 -- 172.21.15.22:0/1119984496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 msgr2=0x7f9b10198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 0x7f9b10198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 -- 172.21.15.22:0/1119984496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1019d4c0 con 0x7f9b10103700 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0f7fe640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 0x7f9b10198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b07fff640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9af800b4a0 tx=0x7f9af800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8014070 con 0x7f9b10103700 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9af8010b10 con 0x7f9b10103700 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1019d7b0 con 0x7f9b10103700 2024-09-11T22:26:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8017d60 con 0x7f9b10103700 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.301+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b101a5090 con 0x7f9b10103700 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.302+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b101031c0 con 0x7f9b10103700 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.303+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9af8017070 con 0x7f9b10103700 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.304+0000 7f9b0d7fa640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 0x7f9afc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.304+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f9af80cdff0 con 0x7f9b10103700 2024-09-11T22:26:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.304+0000 7f9b0f7fe640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 0x7f9afc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:42.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.305+0000 7f9b0f7fe640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 0x7f9afc0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005ab0 tx=0x7f9b00005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:42.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.308+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9af809b3f0 con 0x7f9b10103700 2024-09-11T22:26:42.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:42 smithi169 ceph-mon[35628]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:42.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:42 smithi169 ceph-mon[35628]: Deploying daemon mds.l on smithi169 2024-09-11T22:26:42.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.517+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b101072a0 con 0x7f9b10103700 2024-09-11T22:26:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.517+0000 7f9b0d7fa640 1 -- 172.21.15.22:0/1119984496 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f9af809acf0 con 0x7f9b10103700 2024-09-11T22:26:42.518 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:42.518 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"btime":"2024-09-11T22:19:30:932019+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T22:26:42.518 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2024-09-11T22:26:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 msgr2=0x7f9afc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 0x7f9afc0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005ab0 tx=0x7f9b00005a20 comp rx=0 tx=0).stop 2024-09-11T22:26:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 msgr2=0x7f9b10198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9af800b4a0 tx=0x7f9af800b960 comp rx=0 tx=0).stop 2024-09-11T22:26:42.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 shutdown_connections 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f9afc0a2b80 0x7f9afc0a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b1010c180 0x7f9b1019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b10103700 0x7f9b10198a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 --2- 172.21.15.22:0/1119984496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b10102de0 0x7f9b10198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.519+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 >> 172.21.15.22:0/1119984496 conn(0x7f9b100fc7a0 msgr2=0x7f9b100fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.520+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 shutdown_connections 2024-09-11T22:26:42.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:42.520+0000 7f9b15cbb640 1 -- 172.21.15.22:0/1119984496 wait complete. 2024-09-11T22:26:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:42 smithi045 ceph-mon[35556]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:42 smithi045 ceph-mon[35556]: Deploying daemon mds.l on smithi169 2024-09-11T22:26:42.903 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:42 smithi169 systemd[1]: Starting Ceph mds.l for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:43.301 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:43 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1119984496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:43.301 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 podman[65232]: 2024-09-11 22:26:43.038179269 +0000 UTC m=+0.111871733 container create 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:26:43.301 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 podman[65232]: 2024-09-11 22:26:42.942247598 +0000 UTC m=+0.015940028 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:43.301 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 podman[65232]: 2024-09-11 22:26:43.273642596 +0000 UTC m=+0.347335015 container init 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-11T22:26:43.301 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 podman[65232]: 2024-09-11 22:26:43.276958004 +0000 UTC m=+0.350650433 container start 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T22:26:43.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:43 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1119984496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:43.652 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 ceph-mds[65251]: -- 172.21.15.169:0/2578280915 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557df1d5b860 con 0x557df1d39000 2024-09-11T22:26:43.652 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l[65247]: starting mds.l at 2024-09-11T22:26:43.653 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 bash[65232]: 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 2024-09-11T22:26:43.653 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:26:43 smithi169 systemd[1]: Started Ceph mds.l for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:43.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:43 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1119984496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.169:6832/1952933585,v1:172.21.15.169:6833/1952933585] up:boot 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: fsmap 1 up:standby 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:44 smithi022 ceph-mon[30966]: Deploying daemon mds.k on smithi045 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.169:6832/1952933585,v1:172.21.15.169:6833/1952933585] up:boot 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: fsmap 1 up:standby 2024-09-11T22:26:44.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:44.654 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:44 smithi169 ceph-mon[35628]: Deploying daemon mds.k on smithi045 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.169:6832/1952933585,v1:172.21.15.169:6833/1952933585] up:boot 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: fsmap 1 up:standby 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:44.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:44.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:44.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:44.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:44 smithi045 ceph-mon[35556]: Deploying daemon mds.k on smithi045 2024-09-11T22:26:45.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:26:45.546 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:45.636 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 systemd[1]: Starting Ceph mds.k for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:45.912 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 podman[64750]: 2024-09-11 22:26:45.538331815 +0000 UTC m=+0.015660936 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:45.912 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 podman[64750]: 2024-09-11 22:26:45.667378868 +0000 UTC m=+0.144708023 container create 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T22:26:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 -- 172.21.15.22:0/2373992265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 msgr2=0x7f1fc4114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:46.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 --2- 172.21.15.22:0/2373992265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc4114f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009ca0 tx=0x7f1fbc02a950 comp rx=0 tx=0).stop 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 -- 172.21.15.22:0/2373992265 shutdown_connections 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 --2- 172.21.15.22:0/2373992265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc4114f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 --2- 172.21.15.22:0/2373992265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 0x7f1fc4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 --2- 172.21.15.22:0/2373992265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 0x7f1fc4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.012+0000 7f1fcc114640 1 -- 172.21.15.22:0/2373992265 >> 172.21.15.22:0/2373992265 conn(0x7f1fc40fd8c0 msgr2=0x7f1fc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 -- 172.21.15.22:0/2373992265 shutdown_connections 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 -- 172.21.15.22:0/2373992265 wait complete. 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 Processor -- start 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 -- start start 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 0x7f1fc41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.013+0000 7f1fcc114640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 0x7f1fc41a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:46.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc41186b0 con 0x7f1fc4112b90 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4118530 con 0x7f1fc4074eb0 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4118830 con 0x7f1fc4074590 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42140/0 (socket says 172.21.15.22:42140) 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 -- 172.21.15.22:0/3662248161 learned_addr learned my addr 172.21.15.22:0/3662248161 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fc96af640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 0x7f1fc41a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fc9eb0640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 0x7f1fc41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 -- 172.21.15.22:0/3662248161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 msgr2=0x7f1fc41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 0x7f1fc41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 -- 172.21.15.22:0/3662248161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 msgr2=0x7f1fc41a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 0x7f1fc41a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 -- 172.21.15.22:0/3662248161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc419f070 con 0x7f1fc4112b90 2024-09-11T22:26:46.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fca6b1640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc005cc0 tx=0x7f1fbc02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc034040 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1fbc030940 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc045480 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc419f300 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.014+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc41ab650 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.015+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc4074970 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.017+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1fbc037020 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.017+0000 7f1fbaffd640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 0x7f1fb00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.017+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1fbc0efb50 con 0x7f1fc4112b90 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.017+0000 7f1fc9eb0640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 0x7f1fb00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.018+0000 7f1fc9eb0640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 0x7f1fb00a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fc419fa80 tx=0x7f1fc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.020+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fbc0bcfd0 con 0x7f1fc4112b90 2024-09-11T22:26:46.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.236+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fc41ab8f0 con 0x7f1fc4112b90 2024-09-11T22:26:46.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.237+0000 7f1fbaffd640 1 -- 172.21.15.22:0/3662248161 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f1fbc030b10 con 0x7f1fc4112b90 2024-09-11T22:26:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:46.238 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"btime":"2024-09-11T22:26:43:305544+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:26:46.238 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2024-09-11T22:26:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 msgr2=0x7f1fb00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 0x7f1fb00a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fc419fa80 tx=0x7f1fc000b390 comp rx=0 tx=0).stop 2024-09-11T22:26:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 msgr2=0x7f1fc419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc005cc0 tx=0x7f1fbc02f790 comp rx=0 tx=0).stop 2024-09-11T22:26:46.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 shutdown_connections 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fc4112b90 0x7f1fc419e940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc4074eb0 0x7f1fc41a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1fb00a2c00 0x7f1fb00a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 --2- 172.21.15.22:0/3662248161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1fc4074590 0x7f1fc41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.240+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 >> 172.21.15.22:0/3662248161 conn(0x7f1fc40fd8c0 msgr2=0x7f1fc40fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.241+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 shutdown_connections 2024-09-11T22:26:46.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:46.241+0000 7f1fcc114640 1 -- 172.21.15.22:0/3662248161 wait complete. 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 podman[64750]: 2024-09-11 22:26:45.919422367 +0000 UTC m=+0.396751478 container init 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 podman[64750]: 2024-09-11 22:26:45.922120669 +0000 UTC m=+0.399449782 container start 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 ceph-mds[64769]: -- 172.21.15.45:0/2464473015 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619836d3860 con 0x5619836b1000 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:45 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k[64765]: starting mds.k at 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:46 smithi045 bash[64750]: 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 2024-09-11T22:26:46.316 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:26:46 smithi045 systemd[1]: Started Ceph mds.k for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:46 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3662248161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:46 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3662248161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:46.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:46 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3662248161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:47.581 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:47 smithi022 ceph-mon[30966]: Deploying daemon mds.j on smithi022 2024-09-11T22:26:47.581 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:47 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6832/2686078352,v1:172.21.15.45:6833/2686078352] up:boot 2024-09-11T22:26:47.581 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:47 smithi022 ceph-mon[30966]: fsmap 2 up:standby 2024-09-11T22:26:47.581 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:47 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:26:47.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:47 smithi169 ceph-mon[35628]: Deploying daemon mds.j on smithi022 2024-09-11T22:26:47.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:47 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6832/2686078352,v1:172.21.15.45:6833/2686078352] up:boot 2024-09-11T22:26:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:47 smithi169 ceph-mon[35628]: fsmap 2 up:standby 2024-09-11T22:26:47.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:47 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:26:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:47 smithi045 ceph-mon[35556]: Deploying daemon mds.j on smithi022 2024-09-11T22:26:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:47 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6832/2686078352,v1:172.21.15.45:6833/2686078352] up:boot 2024-09-11T22:26:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:47 smithi045 ceph-mon[35556]: fsmap 2 up:standby 2024-09-11T22:26:47.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:47 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:26:48.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:48 smithi022 ceph-mon[30966]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:48 smithi169 ceph-mon[35628]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:48 smithi045 ceph-mon[35556]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:48.902 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:48 smithi022 systemd[1]: Starting Ceph mds.j for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:49.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:26:49.173 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:48 smithi022 podman[67668]: 2024-09-11 22:26:48.824078019 +0000 UTC m=+0.016477573 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:49.173 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:48 smithi022 podman[67668]: 2024-09-11 22:26:48.922371707 +0000 UTC m=+0.114771251 container create f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T22:26:49.173 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 podman[67668]: 2024-09-11 22:26:49.173131974 +0000 UTC m=+0.365531520 container init f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:26:49.344 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:49.467 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 podman[67668]: 2024-09-11 22:26:49.176362073 +0000 UTC m=+0.368761626 container start f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:26:49.467 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 ceph-mds[67705]: -- 172.21.15.22:0/272256277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562eeb4f3860 con 0x562eeb4d1000 2024-09-11T22:26:49.467 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j[67701]: starting mds.j at 2024-09-11T22:26:49.468 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 bash[67668]: f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d 2024-09-11T22:26:49.468 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:26:49 smithi022 systemd[1]: Started Ceph mds.j for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 -- 172.21.15.22:0/4268161511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 msgr2=0x7f949810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 --2- 172.21.15.22:0/4268161511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f949810ec30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9490009cd0 tx=0x7f949002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 -- 172.21.15.22:0/4268161511 shutdown_connections 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 --2- 172.21.15.22:0/4268161511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f949810ec30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 --2- 172.21.15.22:0/4268161511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498103740 0x7f9498107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 --2- 172.21.15.22:0/4268161511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498102d90 0x7f9498103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 -- 172.21.15.22:0/4268161511 >> 172.21.15.22:0/4268161511 conn(0x7f94980fc7d0 msgr2=0x7f94980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 -- 172.21.15.22:0/4268161511 shutdown_connections 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 -- 172.21.15.22:0/4268161511 wait complete. 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.834+0000 7f949e1bf640 1 Processor -- start 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 -- start start 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498102d90 0x7f949819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 0x7f949819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9498112290 con 0x7f9498108290 2024-09-11T22:26:49.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9498112110 con 0x7f9498103740 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f949e1bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9498112410 con 0x7f9498102d90 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42182/0 (socket says 172.21.15.22:42182) 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 -- 172.21.15.22:0/1454219168 learned_addr learned my addr 172.21.15.22:0/1454219168 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f94977fe640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498102d90 0x7f949819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9496ffd640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 0x7f949819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 -- 172.21.15.22:0/1454219168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498102d90 msgr2=0x7f949819e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498102d90 0x7f949819e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 -- 172.21.15.22:0/1454219168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 msgr2=0x7f949819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 0x7f949819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9497fff640 1 -- 172.21.15.22:0/1454219168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9498198cf0 con 0x7f9498108290 2024-09-11T22:26:49.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.835+0000 7f9496ffd640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 0x7f949819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f9497fff640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9490009df0 tx=0x7f9490032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490004240 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9498198f80 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9490003e20 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94900466e0 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.836+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94981a52d0 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.837+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f949806a7f0 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.838+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f94900307c0 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.839+0000 7f9494ff9640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 0x7f94800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.839+0000 7f94977fe640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 0x7f94800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.839+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f949002e030 con 0x7f9498108290 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.839+0000 7f94977fe640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 0x7f94800a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9488009990 tx=0x7f9488009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:49.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:49.842+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f949004b060 con 0x7f9498108290 2024-09-11T22:26:50.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.061+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f949810a2a0 con 0x7f9498108290 2024-09-11T22:26:50.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.062+0000 7f9494ff9640 1 -- 172.21.15.22:0/1454219168 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f94900098b0 con 0x7f9498108290 2024-09-11T22:26:50.063 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:50.063 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"btime":"2024-09-11T22:26:49:325333+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T22:26:50.063 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 4 2024-09-11T22:26:50.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 msgr2=0x7f94800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:50.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 0x7f94800a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9488009990 tx=0x7f9488009110 comp rx=0 tx=0).stop 2024-09-11T22:26:50.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 msgr2=0x7f94981985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:50.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9490009df0 tx=0x7f9490032c00 comp rx=0 tx=0).stop 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 shutdown_connections 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9498108290 0x7f94981985c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9498103740 0x7f949819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f94800a2b80 0x7f94800a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 --2- 172.21.15.22:0/1454219168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9498102d90 0x7f949819e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:50.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 >> 172.21.15.22:0/1454219168 conn(0x7f94980fc7d0 msgr2=0x7f9498105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:50.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 shutdown_connections 2024-09-11T22:26:50.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:50.064+0000 7f949e1bf640 1 -- 172.21.15.22:0/1454219168 wait complete. 2024-09-11T22:26:50.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:50.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.637 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.22:6834/3220963127,v1:172.21.15.22:6835/3220963127] up:boot 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: fsmap 3 up:standby 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: Deploying daemon mds.d on smithi022 2024-09-11T22:26:50.638 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:50 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1454219168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.22:6834/3220963127,v1:172.21.15.22:6835/3220963127] up:boot 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: fsmap 3 up:standby 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:50.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:50.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: Deploying daemon mds.d on smithi022 2024-09-11T22:26:50.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:50 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1454219168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.22:6834/3220963127,v1:172.21.15.22:6835/3220963127] up:boot 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: fsmap 3 up:standby 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: Deploying daemon mds.d on smithi022 2024-09-11T22:26:50.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:50 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1454219168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:52 smithi022 ceph-mon[30966]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:52.652 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 systemd[1]: Starting Ceph mds.d for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:52.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:52 smithi169 ceph-mon[35628]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:52 smithi045 ceph-mon[35556]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:52.943 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 podman[68082]: 2024-09-11 22:26:52.58971196 +0000 UTC m=+0.016525470 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:52.943 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 podman[68082]: 2024-09-11 22:26:52.716243488 +0000 UTC m=+0.143057040 container create 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T22:26:52.943 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 podman[68082]: 2024-09-11 22:26:52.943429115 +0000 UTC m=+0.370242627 container init 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T22:26:52.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:53.388 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 podman[68082]: 2024-09-11 22:26:52.946422675 +0000 UTC m=+0.373236191 container start 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T22:26:53.388 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 ceph-mds[68101]: -- 172.21.15.22:0/2861354730 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a805a5b860 con 0x55a805a38800 2024-09-11T22:26:53.388 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d[68097]: starting mds.d at 2024-09-11T22:26:53.388 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:53 smithi022 bash[68082]: 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 2024-09-11T22:26:53.388 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:26:53 smithi022 systemd[1]: Started Ceph mds.d for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:53.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3645370391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c100a80 msgr2=0x7fbc8c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3645370391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c100a80 0x7fbc8c100ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009930 tx=0x7fbc8002a420 comp rx=0 tx=0).stop 2024-09-11T22:26:53.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3645370391 shutdown_connections 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3645370391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c101420 0x7fbc8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3645370391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c100a80 0x7fbc8c100ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3645370391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c106a80 0x7fbc8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3645370391 >> 172.21.15.22:0/3645370391 conn(0x7fbc8c0fc7a0 msgr2=0x7fbc8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3645370391 shutdown_connections 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.755+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3645370391 wait complete. 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 Processor -- start 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 -- start start 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 0x7fbc8c0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 0x7fbc8c0fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:53.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c110fa0 con 0x7fbc8c101420 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c110e20 con 0x7fbc8c100a80 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc90dd6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c111120 con 0x7fbc8c106a80 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc89d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc89d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42222/0 (socket says 172.21.15.22:42222) 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.756+0000 7fbc89d9b640 1 -- 172.21.15.22:0/3221506178 learned_addr learned my addr 172.21.15.22:0/3221506178 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc8ad9d640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 0x7fbc8c0fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc8a59c640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 0x7fbc8c0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 -- 172.21.15.22:0/3221506178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 msgr2=0x7fbc8c0fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 0x7fbc8c0fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 -- 172.21.15.22:0/3221506178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 msgr2=0x7fbc8c0fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 0x7fbc8c0fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 -- 172.21.15.22:0/3221506178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c1a6a50 con 0x7fbc8c101420 2024-09-11T22:26:53.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc8ad9d640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 0x7fbc8c0fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc8a59c640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 0x7fbc8c0fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc89d9b640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009230 tx=0x7fbc80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8003f030 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c1a6ce0 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc80003af0 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80035070 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.757+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c1a71c0 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.758+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8c100ee0 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.759+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbc80042030 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.760+0000 7fbc7b7fe640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 0x7fbc740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.761+0000 7fbc8a59c640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 0x7fbc740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.761+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbc800ef850 con 0x7fbc8c101420 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.761+0000 7fbc8a59c640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 0x7fbc740a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005e00 tx=0x7fbc7c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:53.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.764+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc800bccf0 con 0x7fbc8c101420 2024-09-11T22:26:53.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.974+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc8c10a020 con 0x7fbc8c101420 2024-09-11T22:26:53.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.974+0000 7fbc7b7fe640 1 -- 172.21.15.22:0/3221506178 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fbc800bc5f0 con 0x7fbc8c101420 2024-09-11T22:26:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:53.975 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"btime":"2024-09-11T22:26:53:326486+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T22:26:53.975 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-09-11T22:26:53.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.977+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 msgr2=0x7fbc740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.977+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 0x7fbc740a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c005e00 tx=0x7fbc7c005c70 comp rx=0 tx=0).stop 2024-09-11T22:26:53.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.977+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 msgr2=0x7fbc8c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.977+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009230 tx=0x7fbc80004270 comp rx=0 tx=0).stop 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 shutdown_connections 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbc740a2b80 0x7fbc740a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc8c106a80 0x7fbc8c0fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc8c101420 0x7fbc8c0fd250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 --2- 172.21.15.22:0/3221506178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c100a80 0x7fbc8c0fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 >> 172.21.15.22:0/3221506178 conn(0x7fbc8c0fc7a0 msgr2=0x7fbc8c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 shutdown_connections 2024-09-11T22:26:53.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:53.978+0000 7fbc90dd6640 1 -- 172.21.15.22:0/3221506178 wait complete. 2024-09-11T22:26:54.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:54.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: Deploying daemon mds.e on smithi045 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.22:6836/3026054305,v1:172.21.15.22:6837/3026054305] up:boot 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: fsmap 4 up:standby 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:26:54.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:54 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3221506178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:54.279 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: Deploying daemon mds.e on smithi045 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.22:6836/3026054305,v1:172.21.15.22:6837/3026054305] up:boot 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: fsmap 4 up:standby 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:26:54.280 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:54 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3221506178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: Deploying daemon mds.e on smithi045 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.22:6836/3026054305,v1:172.21.15.22:6837/3026054305] up:boot 2024-09-11T22:26:54.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: fsmap 4 up:standby 2024-09-11T22:26:54.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:26:54.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:54 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3221506178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:55.161 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 systemd[1]: Starting Ceph mds.e for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:55.574 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 podman[65065]: 2024-09-11 22:26:55.303079263 +0000 UTC m=+0.106594729 container create 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T22:26:55.575 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 podman[65065]: 2024-09-11 22:26:55.212501951 +0000 UTC m=+0.016017428 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:55.575 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 podman[65065]: 2024-09-11 22:26:55.547444406 +0000 UTC m=+0.350959873 container init 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T22:26:55.575 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 podman[65065]: 2024-09-11 22:26:55.550200795 +0000 UTC m=+0.353716262 container start 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:26:55.575 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 ceph-mds[65085]: -- 172.21.15.45:0/837559044 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3bf9ff860 con 0x55b3bf9dd400 2024-09-11T22:26:55.912 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e[65081]: starting mds.e at 2024-09-11T22:26:55.912 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 bash[65065]: 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 2024-09-11T22:26:55.912 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:26:55 smithi045 systemd[1]: Started Ceph mds.e for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:56.385 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:56 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:56.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:56 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:56.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:56.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:56.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:56 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:26:57.056 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:57.264 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-mon[35628]: Deploying daemon mds.f on smithi169 2024-09-11T22:26:57.264 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6834/3694766032,v1:172.21.15.45:6835/3694766032] up:boot 2024-09-11T22:26:57.265 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-mon[35628]: fsmap 5 up:standby 2024-09-11T22:26:57.265 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:26:57.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:57 smithi022 ceph-mon[30966]: Deploying daemon mds.f on smithi169 2024-09-11T22:26:57.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:57 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6834/3694766032,v1:172.21.15.45:6835/3694766032] up:boot 2024-09-11T22:26:57.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:57 smithi022 ceph-mon[30966]: fsmap 5 up:standby 2024-09-11T22:26:57.367 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:57 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:26:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:57 smithi045 ceph-mon[35556]: Deploying daemon mds.f on smithi169 2024-09-11T22:26:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:57 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6834/3694766032,v1:172.21.15.45:6835/3694766032] up:boot 2024-09-11T22:26:57.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:57 smithi045 ceph-mon[35556]: fsmap 5 up:standby 2024-09-11T22:26:57.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:57 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:26:57.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 -- 172.21.15.22:0/4006391658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102ef0 msgr2=0x7f2acc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/4006391658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102ef0 0x7f2acc10da40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ca0 tx=0x7f2ac402a950 comp rx=0 tx=0).stop 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 -- 172.21.15.22:0/4006391658 shutdown_connections 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/4006391658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc102ef0 0x7f2acc10da40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/4006391658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102570 0x7f2acc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/4006391658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc100e20 0x7f2acc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 -- 172.21.15.22:0/4006391658 >> 172.21.15.22:0/4006391658 conn(0x7f2acc0fc7d0 msgr2=0x7f2acc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 -- 172.21.15.22:0/4006391658 shutdown_connections 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.537+0000 7f2ad44a2640 1 -- 172.21.15.22:0/4006391658 wait complete. 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 Processor -- start 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 -- start start 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 0x7f2acc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102ef0 0x7f2acc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc111160 con 0x7f2acc100e20 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc110fe0 con 0x7f2acc102570 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad44a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc1112e0 con 0x7f2acc102ef0 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38624/0 (socket says 172.21.15.22:38624) 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 -- 172.21.15.22:0/581806649 learned_addr learned my addr 172.21.15.22:0/581806649 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad2a3f640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102ef0 0x7f2acc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad1a3d640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 0x7f2acc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 -- 172.21.15.22:0/581806649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102ef0 msgr2=0x7f2acc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102ef0 0x7f2acc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 -- 172.21.15.22:0/581806649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 msgr2=0x7f2acc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:57.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.538+0000 7f2ad223e640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 0x7f2acc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ad223e640 1 -- 172.21.15.22:0/581806649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc19d600 con 0x7f2acc100e20 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ad1a3d640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 0x7f2acc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ad223e640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800b4a0 tx=0x7f2ac800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8014070 con 0x7f2acc100e20 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc19d8f0 con 0x7f2acc100e20 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2ac8010b10 con 0x7f2acc100e20 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8017d60 con 0x7f2acc100e20 2024-09-11T22:26:57.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.539+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc1a51d0 con 0x7f2acc100e20 2024-09-11T22:26:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.540+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc101200 con 0x7f2acc100e20 2024-09-11T22:26:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.541+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2ac8017070 con 0x7f2acc100e20 2024-09-11T22:26:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.542+0000 7f2ac37fe640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 0x7f2ab80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:57.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.542+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2ac80cdf40 con 0x7f2acc100e20 2024-09-11T22:26:57.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.542+0000 7f2ad1a3d640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 0x7f2ab80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:57.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.542+0000 7f2ad1a3d640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 0x7f2ab80a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006fd0 tx=0x7f2abc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.546+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ac809b340 con 0x7f2acc100e20 2024-09-11T22:26:57.652 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 systemd[1]: Starting Ceph mds.f for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:26:57.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.755+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2acc10a0a0 con 0x7f2acc100e20 2024-09-11T22:26:57.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.756+0000 7f2ac37fe640 1 -- 172.21.15.22:0/581806649 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f2ac809ac40 con 0x7f2acc100e20 2024-09-11T22:26:57.757 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:26:57.757 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"btime":"2024-09-11T22:26:56:106544+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T22:26:57.757 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 6 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 msgr2=0x7f2ab80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 0x7f2ab80a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006fd0 tx=0x7f2abc008040 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 msgr2=0x7f2acc198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800b4a0 tx=0x7f2ac800b960 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 shutdown_connections 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2ab80a2b80 0x7f2ab80a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc102ef0 0x7f2acc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2acc102570 0x7f2acc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 --2- 172.21.15.22:0/581806649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2acc100e20 0x7f2acc198650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 >> 172.21.15.22:0/581806649 conn(0x7f2acc0fc7d0 msgr2=0x7f2acc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 shutdown_connections 2024-09-11T22:26:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:26:57.758+0000 7f2ad44a2640 1 -- 172.21.15.22:0/581806649 wait complete. 2024-09-11T22:26:57.934 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 podman[65533]: 2024-09-11 22:26:57.56514915 +0000 UTC m=+0.016085202 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 podman[65533]: 2024-09-11 22:26:57.664992584 +0000 UTC m=+0.115928626 container create 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 podman[65533]: 2024-09-11 22:26:57.833905551 +0000 UTC m=+0.284841594 container init 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 podman[65533]: 2024-09-11 22:26:57.836512395 +0000 UTC m=+0.287448447 container start 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-mds[65552]: -- 172.21.15.169:0/1278340841 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad807fb860 con 0x55ad807d8800 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f[65548]: starting mds.f at 2024-09-11T22:26:57.935 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 bash[65533]: 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 2024-09-11T22:26:58.388 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/581806649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:58.389 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:58 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:58.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/581806649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:58 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:26:57 smithi169 systemd[1]: Started Ceph mds.f for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/581806649' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:26:58.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:26:58.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:58 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:59 smithi022 ceph-mon[30966]: Deploying daemon mds.c on smithi169 2024-09-11T22:26:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:59 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.169:6834/1085000680,v1:172.21.15.169:6835/1085000680] up:boot 2024-09-11T22:26:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:59 smithi022 ceph-mon[30966]: fsmap 6 up:standby 2024-09-11T22:26:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:26:59 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:26:59.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:59 smithi169 ceph-mon[35628]: Deploying daemon mds.c on smithi169 2024-09-11T22:26:59.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:59 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.169:6834/1085000680,v1:172.21.15.169:6835/1085000680] up:boot 2024-09-11T22:26:59.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:59 smithi169 ceph-mon[35628]: fsmap 6 up:standby 2024-09-11T22:26:59.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:26:59 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:26:59.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:59 smithi045 ceph-mon[35556]: Deploying daemon mds.c on smithi169 2024-09-11T22:26:59.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:59 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.169:6834/1085000680,v1:172.21.15.169:6835/1085000680] up:boot 2024-09-11T22:26:59.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:59 smithi045 ceph-mon[35556]: fsmap 6 up:standby 2024-09-11T22:26:59.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:26:59 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:26:59.799 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:26:59 smithi169 systemd[1]: Starting Ceph mds.c for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:00.130 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 podman[65836]: 2024-09-11 22:26:59.91680642 +0000 UTC m=+0.016401761 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:00.131 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 podman[65836]: 2024-09-11 22:27:00.043046448 +0000 UTC m=+0.142641774 container create 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T22:27:00.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:00 smithi022 ceph-mon[30966]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:00.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:00 smithi169 ceph-mon[35628]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:00.404 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 podman[65836]: 2024-09-11 22:27:00.270721167 +0000 UTC m=+0.370316494 container init 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:27:00.404 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 podman[65836]: 2024-09-11 22:27:00.273681773 +0000 UTC m=+0.373277118 container start 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T22:27:00.404 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 ceph-mds[65856]: -- 172.21.15.169:0/45390952 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56083dedb860 con 0x56083deb9400 2024-09-11T22:27:00.404 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c[65852]: starting mds.c at 2024-09-11T22:27:00.405 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 bash[65836]: 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb 2024-09-11T22:27:00.405 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:27:00 smithi169 systemd[1]: Started Ceph mds.c for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:00 smithi045 ceph-mon[35556]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:00.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:00.748 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 -- 172.21.15.22:0/898678915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 msgr2=0x7ff6b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 --2- 172.21.15.22:0/898678915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41067e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009900 tx=0x7ff6a802a410 comp rx=0 tx=0).stop 2024-09-11T22:27:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 -- 172.21.15.22:0/898678915 shutdown_connections 2024-09-11T22:27:01.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 --2- 172.21.15.22:0/898678915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4106f10 0x7ff6b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 --2- 172.21.15.22:0/898678915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41067e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 --2- 172.21.15.22:0/898678915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4101de0 0x7ff6b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 -- 172.21.15.22:0/898678915 >> 172.21.15.22:0/898678915 conn(0x7ff6b40fd8c0 msgr2=0x7ff6b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 -- 172.21.15.22:0/898678915 shutdown_connections 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.204+0000 7ff6ba808640 1 -- 172.21.15.22:0/898678915 wait complete. 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 Processor -- start 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 -- start start 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4101de0 0x7ff6b4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4106f10 0x7ff6b419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:01.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b4112050 con 0x7ff6b4102790 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b4111ed0 con 0x7ff6b4101de0 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.205+0000 7ff6ba808640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b41121d0 con 0x7ff6b4106f10 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38634/0 (socket says 172.21.15.22:38634) 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 -- 172.21.15.22:0/3864571138 learned_addr learned my addr 172.21.15.22:0/3864571138 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b8da5640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4106f10 0x7ff6b419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b3fff640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4101de0 0x7ff6b4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 -- 172.21.15.22:0/3864571138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4106f10 msgr2=0x7ff6b419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:01.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4106f10 0x7ff6b419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 -- 172.21.15.22:0/3864571138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4101de0 msgr2=0x7ff6b4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4101de0 0x7ff6b4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 -- 172.21.15.22:0/3864571138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b419d440 con 0x7ff6b4102790 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b37fe640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006010 tx=0x7ff6a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a803f030 con 0x7ff6b4102790 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6a8003d00 con 0x7ff6b4102790 2024-09-11T22:27:01.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8035070 con 0x7ff6b4102790 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b419d6d0 con 0x7ff6b4102790 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.206+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b41a5010 con 0x7ff6b4102790 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.207+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b41032c0 con 0x7ff6b4102790 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.208+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff6a8042030 con 0x7ff6b4102790 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.209+0000 7ff6b17fa640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 0x7ff69c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:01.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.209+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff6a80ef5f0 con 0x7ff6b4102790 2024-09-11T22:27:01.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.209+0000 7ff6b3fff640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 0x7ff69c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:01.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.210+0000 7ff6b3fff640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 0x7ff69c0a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005e10 tx=0x7ff6a4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:01.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.213+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6a80bc9f0 con 0x7ff6b4102790 2024-09-11T22:27:01.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.427+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6b410a150 con 0x7ff6b4102790 2024-09-11T22:27:01.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.428+0000 7ff6b17fa640 1 -- 172.21.15.22:0/3864571138 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7ff6a80bc2f0 con 0x7ff6b4102790 2024-09-11T22:27:01.429 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:01.429 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"btime":"2024-09-11T22:27:01:129790+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T22:27:01.429 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-09-11T22:27:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 msgr2=0x7ff69c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 0x7ff69c0a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005e10 tx=0x7ff6a4005da0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 msgr2=0x7ff6b41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006010 tx=0x7ff6a80042f0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 shutdown_connections 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff69c0a2b80 0x7ff69c0a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6b4106f10 0x7ff6b419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6b4102790 0x7ff6b41989d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 --2- 172.21.15.22:0/3864571138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6b4101de0 0x7ff6b4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 >> 172.21.15.22:0/3864571138 conn(0x7ff6b40fd8c0 msgr2=0x7ff6b40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 shutdown_connections 2024-09-11T22:27:01.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:01.430+0000 7ff6ba808640 1 -- 172.21.15.22:0/3864571138 wait complete. 2024-09-11T22:27:01.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:01.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:01.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:01.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: Deploying daemon mds.h on smithi045 2024-09-11T22:27:01.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.169:6836/857895339,v1:172.21.15.169:6837/857895339] up:boot 2024-09-11T22:27:01.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: fsmap 7 up:standby 2024-09-11T22:27:01.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:01 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:01.687 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.687 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.687 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: Deploying daemon mds.h on smithi045 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.169:6836/857895339,v1:172.21.15.169:6837/857895339] up:boot 2024-09-11T22:27:01.688 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: fsmap 7 up:standby 2024-09-11T22:27:01.689 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:01 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:01.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:01.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:01.891 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:01.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:01.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: Deploying daemon mds.h on smithi045 2024-09-11T22:27:01.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.169:6836/857895339,v1:172.21.15.169:6837/857895339] up:boot 2024-09-11T22:27:01.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: fsmap 7 up:standby 2024-09-11T22:27:01.892 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:01 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:02.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:02 smithi022 ceph-mon[30966]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:02.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:02 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3864571138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:02.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:02 smithi045 ceph-mon[35556]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:02.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:02 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3864571138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:02.662 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 systemd[1]: Starting Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:02.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:02 smithi169 ceph-mon[35628]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:02.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:02 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3864571138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:02.945 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 podman[65369]: 2024-09-11 22:27:02.596620404 +0000 UTC m=+0.016040867 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:02.945 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 podman[65369]: 2024-09-11 22:27:02.723342465 +0000 UTC m=+0.142762963 container create bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T22:27:02.945 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 podman[65369]: 2024-09-11 22:27:02.942325358 +0000 UTC m=+0.361745816 container init bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T22:27:02.945 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 podman[65369]: 2024-09-11 22:27:02.945076233 +0000 UTC m=+0.364496687 container start bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:27:03.411 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 ceph-mds[65389]: -- 172.21.15.45:0/2267390685 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625fcc1fc20 con 0x5625fcbfc800 2024-09-11T22:27:03.412 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[65385]: starting mds.h at 2024-09-11T22:27:03.412 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:03 smithi045 bash[65369]: bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 2024-09-11T22:27:03.412 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:27:03 smithi045 systemd[1]: Started Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:04.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: Deploying daemon mds.i on smithi169 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6836/1224562712,v1:172.21.15.45:6837/1224562712] up:boot 2024-09-11T22:27:04.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: fsmap 8 up:standby 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:04 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:04.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:04.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:04.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: Deploying daemon mds.i on smithi169 2024-09-11T22:27:04.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6836/1224562712,v1:172.21.15.45:6837/1224562712] up:boot 2024-09-11T22:27:04.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: fsmap 8 up:standby 2024-09-11T22:27:04.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:04 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: Deploying daemon mds.i on smithi169 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6836/1224562712,v1:172.21.15.45:6837/1224562712] up:boot 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: fsmap 8 up:standby 2024-09-11T22:27:04.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:04 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:04.512 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:05.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.009+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/1649442809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0102d90 msgr2=0x7fc9d0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.009+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/1649442809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0102d90 0x7fc9d0103170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009930 tx=0x7fc9c002a420 comp rx=0 tx=0).stop 2024-09-11T22:27:05.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/1649442809 shutdown_connections 2024-09-11T22:27:05.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/1649442809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0108290 0x7fc9d010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/1649442809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0103740 0x7fc9d0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/1649442809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0102d90 0x7fc9d0103170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/1649442809 >> 172.21.15.22:0/1649442809 conn(0x7fc9d00fc7d0 msgr2=0x7fc9d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/1649442809 shutdown_connections 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/1649442809 wait complete. 2024-09-11T22:27:05.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.010+0000 7fc9d4cc4640 1 Processor -- start 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 -- start start 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0102d90 0x7fc9d01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 0x7fc9d01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01121b0 con 0x7fc9d0108290 2024-09-11T22:27:05.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0112030 con 0x7fc9d0103740 2024-09-11T22:27:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9d4cc4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0112330 con 0x7fc9d0102d90 2024-09-11T22:27:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50790/0 (socket says 172.21.15.22:50790) 2024-09-11T22:27:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ce59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0102d90 0x7fc9d01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 -- 172.21.15.22:0/3919301785 learned_addr learned my addr 172.21.15.22:0/3919301785 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9c7fff640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 0x7fc9d01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 -- 172.21.15.22:0/3919301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0102d90 msgr2=0x7fc9d01a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0102d90 0x7fc9d01a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 -- 172.21.15.22:0/3919301785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 msgr2=0x7fc9d01a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 0x7fc9d01a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9ced9d640 1 -- 172.21.15.22:0/3919301785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d019aec0 con 0x7fc9d0108290 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.011+0000 7fc9c7fff640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 0x7fc9d01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9ced9d640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800eaa0 tx=0x7fc9c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800cdb0 con 0x7fc9d0108290 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d019b1b0 con 0x7fc9d0108290 2024-09-11T22:27:05.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9c8004b20 con 0x7fc9d0108290 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8011760 con 0x7fc9d0108290 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.012+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d01a7500 con 0x7fc9d0108290 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.013+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d006a7f0 con 0x7fc9d0108290 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.014+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc9c8004cd0 con 0x7fc9d0108290 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.015+0000 7fc9c77fe640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 0x7fc9bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.015+0000 7fc9ce59c640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 0x7fc9bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.015+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc9c80cedb0 con 0x7fc9d0108290 2024-09-11T22:27:05.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.015+0000 7fc9ce59c640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 0x7fc9bc0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009900 tx=0x7fc9c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:05.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.019+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9c8016030 con 0x7fc9d0108290 2024-09-11T22:27:05.152 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:04 smithi169 systemd[1]: Starting Ceph mds.i for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.230+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9d010c2b0 con 0x7fc9d0108290 2024-09-11T22:27:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.231+0000 7fc9c77fe640 1 -- 172.21.15.22:0/3919301785 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7fc9c809c1b0 con 0x7fc9d0108290 2024-09-11T22:27:05.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:05.232 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"btime":"2024-09-11T22:27:03:422605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T22:27:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 msgr2=0x7fc9bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 0x7fc9bc0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009900 tx=0x7fc9c00058d0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 msgr2=0x7fc9d019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800eaa0 tx=0x7fc9c800ef60 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 shutdown_connections 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d0108290 0x7fc9d019a650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9d0103740 0x7fc9d01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9bc0a2b80 0x7fc9bc0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 --2- 172.21.15.22:0/3919301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9d0102d90 0x7fc9d01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 >> 172.21.15.22:0/3919301785 conn(0x7fc9d00fc7d0 msgr2=0x7fc9d01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 shutdown_connections 2024-09-11T22:27:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:05.233+0000 7fc9d4cc4640 1 -- 172.21.15.22:0/3919301785 wait complete. 2024-09-11T22:27:05.516 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 podman[66154]: 2024-09-11 22:27:05.196033817 +0000 UTC m=+0.113355825 container create e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T22:27:05.516 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 podman[66154]: 2024-09-11 22:27:05.098699483 +0000 UTC m=+0.016021501 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:05.517 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 podman[66154]: 2024-09-11 22:27:05.415087034 +0000 UTC m=+0.332409042 container init e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:27:05.517 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 podman[66154]: 2024-09-11 22:27:05.417897519 +0000 UTC m=+0.335219530 container start e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T22:27:05.517 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 ceph-mds[66172]: -- 172.21.15.169:0/839253922 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599efa69860 con 0x5599efa47400 2024-09-11T22:27:05.518 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i[66168]: starting mds.i at 2024-09-11T22:27:05.518 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 bash[66154]: e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 2024-09-11T22:27:05.902 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:27:05 smithi169 systemd[1]: Started Ceph mds.i for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3919301785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:06 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3919301785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:06.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:06.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:06 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3919301785' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:06 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:07 smithi022 ceph-mon[30966]: Deploying daemon mds.g on smithi022 2024-09-11T22:27:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:07 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.169:6838/1397643648,v1:172.21.15.169:6839/1397643648] up:boot 2024-09-11T22:27:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:07 smithi022 ceph-mon[30966]: fsmap 9 up:standby 2024-09-11T22:27:07.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:07 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:27:07.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:07 smithi169 ceph-mon[35628]: Deploying daemon mds.g on smithi022 2024-09-11T22:27:07.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:07 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.169:6838/1397643648,v1:172.21.15.169:6839/1397643648] up:boot 2024-09-11T22:27:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:07 smithi169 ceph-mon[35628]: fsmap 9 up:standby 2024-09-11T22:27:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:07 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:27:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:07 smithi045 ceph-mon[35556]: Deploying daemon mds.g on smithi022 2024-09-11T22:27:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:07 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.169:6838/1397643648,v1:172.21.15.169:6839/1397643648] up:boot 2024-09-11T22:27:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:07 smithi045 ceph-mon[35556]: fsmap 9 up:standby 2024-09-11T22:27:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:07 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:27:07.652 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:07 smithi022 systemd[1]: Starting Ceph mds.g for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:07.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:08.024 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:07 smithi022 podman[68853]: 2024-09-11 22:27:07.665725536 +0000 UTC m=+0.016720536 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:08.024 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:07 smithi022 podman[68853]: 2024-09-11 22:27:07.784694781 +0000 UTC m=+0.135689766 container create cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T22:27:08.024 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:07 smithi022 podman[68853]: 2024-09-11 22:27:07.995670964 +0000 UTC m=+0.346665950 container init cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-11T22:27:08.024 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:07 smithi022 podman[68853]: 2024-09-11 22:27:07.999071024 +0000 UTC m=+0.350066012 container start cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:27:08.195 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:08.314 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:08 smithi022 ceph-mon[30966]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:08.314 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:08 smithi022 ceph-mds[68890]: -- 172.21.15.22:0/3496574422 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574a19db860 con 0x5574a19b9000 2024-09-11T22:27:08.314 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:08 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g[68868]: starting mds.g at 2024-09-11T22:27:08.314 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:08 smithi022 bash[68853]: cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 2024-09-11T22:27:08.314 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:27:08 smithi022 systemd[1]: Started Ceph mds.g for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:08 smithi169 ceph-mon[35628]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:08 smithi045 ceph-mon[35556]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:08.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 -- 172.21.15.22:0/3695737424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828101de0 msgr2=0x7fa8281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 --2- 172.21.15.22:0/3695737424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828101de0 0x7fa8281021c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa818009900 tx=0x7fa81802a410 comp rx=0 tx=0).stop 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 -- 172.21.15.22:0/3695737424 shutdown_connections 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 --2- 172.21.15.22:0/3695737424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828106f10 0x7fa82810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 --2- 172.21.15.22:0/3695737424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 0x7fa8281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 --2- 172.21.15.22:0/3695737424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828101de0 0x7fa8281021c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 -- 172.21.15.22:0/3695737424 >> 172.21.15.22:0/3695737424 conn(0x7fa8280fd8c0 msgr2=0x7fa8280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 -- 172.21.15.22:0/3695737424 shutdown_connections 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 -- 172.21.15.22:0/3695737424 wait complete. 2024-09-11T22:27:08.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.675+0000 7fa82d659640 1 Processor -- start 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 -- start start 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828101de0 0x7fa8280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 0x7fa828074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8281120d0 con 0x7fa828106f10 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa828111f50 con 0x7fa828102790 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa82d659640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa828112250 con 0x7fa828101de0 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:08.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50824/0 (socket says 172.21.15.22:50824) 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 -- 172.21.15.22:0/4123333904 learned_addr learned my addr 172.21.15.22:0/4123333904 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa826ffd640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828101de0 0x7fa8280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8267fc640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 0x7fa828074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 -- 172.21.15.22:0/4123333904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828101de0 msgr2=0x7fa8280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828101de0 0x7fa8280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 -- 172.21.15.22:0/4123333904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 msgr2=0x7fa828074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 0x7fa828074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.676+0000 7fa8277fe640 1 -- 172.21.15.22:0/4123333904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8281a69b0 con 0x7fa828106f10 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa8277fe640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa82000cce0 tx=0x7fa82000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82000f450 con 0x7fa828106f10 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa82000faf0 con 0x7fa828106f10 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8281a6ca0 con 0x7fa828106f10 2024-09-11T22:27:08.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820018cc0 con 0x7fa828106f10 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.677+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8281a71e0 con 0x7fa828106f10 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.678+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8281021c0 con 0x7fa828106f10 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.679+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa82000f5f0 con 0x7fa828106f10 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.679+0000 7fa80ffff640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 0x7fa8100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.680+0000 7fa826ffd640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 0x7fa8100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.680+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa8200cf170 con 0x7fa828106f10 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.680+0000 7fa826ffd640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 0x7fa8100a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa818000c00 tx=0x7fa8180095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:08.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.684+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa820014030 con 0x7fa828106f10 2024-09-11T22:27:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.903+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa82810a0f0 con 0x7fa828106f10 2024-09-11T22:27:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.903+0000 7fa80ffff640 1 -- 172.21.15.22:0/4123333904 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7fa82009c4d0 con 0x7fa828106f10 2024-09-11T22:27:08.904 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:08.905 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"btime":"2024-09-11T22:27:08:088513+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T22:27:08.905 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 11 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 msgr2=0x7fa8100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 0x7fa8100a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa818000c00 tx=0x7fa8180095f0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 msgr2=0x7fa828074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa82000cce0 tx=0x7fa82000a620 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 shutdown_connections 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa828106f10 0x7fa828074f70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa828102790 0x7fa828074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa8100a2c00 0x7fa8100a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 --2- 172.21.15.22:0/4123333904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa828101de0 0x7fa8280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:08.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.905+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 >> 172.21.15.22:0/4123333904 conn(0x7fa8280fd8c0 msgr2=0x7fa8280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:08.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.906+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 shutdown_connections 2024-09-11T22:27:08.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:08.906+0000 7fa82d659640 1 -- 172.21.15.22:0/4123333904 wait complete. 2024-09-11T22:27:09.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.22:6838/816349269,v1:172.21.15.22:6839/816349269] up:boot 2024-09-11T22:27:09.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: fsmap 10 up:standby 2024-09-11T22:27:09.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:27:09.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: Deploying daemon mds.a on smithi022 2024-09-11T22:27:09.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:09 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4123333904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.22:6838/816349269,v1:172.21.15.22:6839/816349269] up:boot 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: fsmap 10 up:standby 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:09.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:09.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:09.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: Deploying daemon mds.a on smithi022 2024-09-11T22:27:09.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:09 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4123333904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:09.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.22:6838/816349269,v1:172.21.15.22:6839/816349269] up:boot 2024-09-11T22:27:09.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: fsmap 10 up:standby 2024-09-11T22:27:09.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: Deploying daemon mds.a on smithi022 2024-09-11T22:27:09.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:09 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4123333904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:10.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:10 smithi022 ceph-mon[30966]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:10.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:10 smithi169 ceph-mon[35628]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:10.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:10 smithi045 ceph-mon[35556]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:11.130 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:10 smithi022 systemd[1]: Starting Ceph mds.a for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:11.391 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 podman[69269]: 2024-09-11 22:27:11.129894205 +0000 UTC m=+0.106562540 container create 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T22:27:11.391 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 podman[69269]: 2024-09-11 22:27:11.04011353 +0000 UTC m=+0.016781868 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:11.391 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 podman[69269]: 2024-09-11 22:27:11.390932844 +0000 UTC m=+0.367601192 container init 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:27:11.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:11.652 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 podman[69269]: 2024-09-11 22:27:11.393998492 +0000 UTC m=+0.370666828 container start 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:27:11.652 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 ceph-mds[69289]: -- 172.21.15.22:0/2990929149 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7c9345860 con 0x55f7c9322800 2024-09-11T22:27:11.652 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a[69285]: starting mds.a at 2024-09-11T22:27:11.652 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 bash[69269]: 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 2024-09-11T22:27:11.652 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:27:11 smithi022 systemd[1]: Started Ceph mds.a for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:12.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 -- 172.21.15.22:0/4254996378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 msgr2=0x7f049c103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:12.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 --2- 172.21.15.22:0/4254996378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c103100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f048c009900 tx=0x7f048c02a480 comp rx=0 tx=0).stop 2024-09-11T22:27:12.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 -- 172.21.15.22:0/4254996378 shutdown_connections 2024-09-11T22:27:12.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 --2- 172.21.15.22:0/4254996378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c10c150 0x7f049c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 --2- 172.21.15.22:0/4254996378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c103640 0x7f049c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 --2- 172.21.15.22:0/4254996378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c103100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 -- 172.21.15.22:0/4254996378 >> 172.21.15.22:0/4254996378 conn(0x7f049c0fc780 msgr2=0x7f049c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 -- 172.21.15.22:0/4254996378 shutdown_connections 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.478+0000 7f04a1be3640 1 -- 172.21.15.22:0/4254996378 wait complete. 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 Processor -- start 2024-09-11T22:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 -- start start 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c103640 0x7f049c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c10c150 0x7f049c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1120d0 con 0x7f049c102d20 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f049c111f50 con 0x7f049c103640 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f04a1be3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f049c112250 con 0x7f049c10c150 2024-09-11T22:27:12.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:12.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50874/0 (socket says 172.21.15.22:50874) 2024-09-11T22:27:12.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f049b7fe640 1 -- 172.21.15.22:0/3492192268 learned_addr learned my addr 172.21.15.22:0/3492192268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:12.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.479+0000 7f0492ffd640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c103640 0x7f049c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:12.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049bfff640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c10c150 0x7f049c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:12.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 -- 172.21.15.22:0/3492192268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c10c150 msgr2=0x7f049c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c10c150 0x7f049c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 -- 172.21.15.22:0/3492192268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c103640 msgr2=0x7f049c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c103640 0x7f049c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 -- 172.21.15.22:0/3492192268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c19d560 con 0x7f049c102d20 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f049b7fe640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f048c006010 tx=0x7f048c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c03f030 con 0x7f049c102d20 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f048c003d00 con 0x7f049c102d20 2024-09-11T22:27:12.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c035070 con 0x7f049c102d20 2024-09-11T22:27:12.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c19d7f0 con 0x7f049c102d20 2024-09-11T22:27:12.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.480+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c1a5130 con 0x7f049c102d20 2024-09-11T22:27:12.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.481+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c06b070 con 0x7f049c102d20 2024-09-11T22:27:12.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.482+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f048c042030 con 0x7f049c102d20 2024-09-11T22:27:12.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.484+0000 7f04997fa640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 0x7f04880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:12.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.484+0000 7f0492ffd640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 0x7f04880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:12.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.484+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f048c0ef5e0 con 0x7f049c102d20 2024-09-11T22:27:12.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.484+0000 7f0492ffd640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 0x7f04880a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f049c0fed80 tx=0x7f0484009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:12.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.488+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f048c0bc940 con 0x7f049c102d20 2024-09-11T22:27:12.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:12.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:12.663 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: Deploying daemon mds.b on smithi045 2024-09-11T22:27:12.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.22:6840/7353610,v1:172.21.15.22:6841/7353610] up:boot 2024-09-11T22:27:12.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: fsmap 11 up:standby 2024-09-11T22:27:12.664 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:12 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:27:12.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.706+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f049c1071c0 con 0x7f049c102d20 2024-09-11T22:27:12.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.707+0000 7f04997fa640 1 -- 172.21.15.22:0/3492192268 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f048c0bc240 con 0x7f049c102d20 2024-09-11T22:27:12.709 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:12.709 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"btime":"2024-09-11T22:27:12:172941+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T22:27:12.710 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 msgr2=0x7f04880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 0x7f04880a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f049c0fed80 tx=0x7f0484009060 comp rx=0 tx=0).stop 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 msgr2=0x7f049c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f048c006010 tx=0x7f048c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 shutdown_connections 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f04880a2b80 0x7f04880a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f049c10c150 0x7f049c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c103640 0x7f049c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 --2- 172.21.15.22:0/3492192268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f049c102d20 0x7f049c198650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 >> 172.21.15.22:0/3492192268 conn(0x7f049c0fc780 msgr2=0x7f049c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 shutdown_connections 2024-09-11T22:27:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:12.709+0000 7f04a1be3640 1 -- 172.21.15.22:0/3492192268 wait complete. 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: Deploying daemon mds.b on smithi045 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.22:6840/7353610,v1:172.21.15.22:6841/7353610] up:boot 2024-09-11T22:27:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: fsmap 11 up:standby 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:12 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: Deploying daemon mds.b on smithi045 2024-09-11T22:27:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.22:6840/7353610,v1:172.21.15.22:6841/7353610] up:boot 2024-09-11T22:27:12.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: fsmap 11 up:standby 2024-09-11T22:27:12.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:12 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:27:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:13 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3492192268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:13.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:13 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3492192268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:13.662 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:13 smithi045 systemd[1]: Starting Ceph mds.b for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:13 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3492192268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:14.044 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:13 smithi045 podman[65673]: 2024-09-11 22:27:13.676641517 +0000 UTC m=+0.016159508 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:14.044 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:13 smithi045 podman[65673]: 2024-09-11 22:27:13.775713277 +0000 UTC m=+0.115231268 container create d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T22:27:14.044 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 podman[65673]: 2024-09-11 22:27:14.04461621 +0000 UTC m=+0.384134204 container init d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T22:27:14.411 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 podman[65673]: 2024-09-11 22:27:14.047627823 +0000 UTC m=+0.387145824 container start d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T22:27:14.411 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mds[65693]: -- 172.21.15.45:0/3372745348 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d89e263860 con 0x55d89e241400 2024-09-11T22:27:14.411 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: starting mds.b at 2024-09-11T22:27:14.412 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 bash[65673]: d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f 2024-09-11T22:27:14.412 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:14 smithi045 systemd[1]: Started Ceph mds.b for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:14.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:14.899 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.900 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:14 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:14 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:14.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:14 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:15.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:15.705 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:15.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:15 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:boot 2024-09-11T22:27:15.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:15 smithi022 ceph-mon[30966]: fsmap 12 up:standby 2024-09-11T22:27:15.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:15 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:27:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:15 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:boot 2024-09-11T22:27:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:15 smithi169 ceph-mon[35628]: fsmap 12 up:standby 2024-09-11T22:27:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:15 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:27:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:15 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:boot 2024-09-11T22:27:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:15 smithi045 ceph-mon[35556]: fsmap 12 up:standby 2024-09-11T22:27:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:15 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:27:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 -- 172.21.15.22:0/4111834346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 msgr2=0x7f3e30103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 --2- 172.21.15.22:0/4111834346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e30103130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009900 tx=0x7f3e2002a480 comp rx=0 tx=0).stop 2024-09-11T22:27:16.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 -- 172.21.15.22:0/4111834346 shutdown_connections 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 --2- 172.21.15.22:0/4111834346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3010c180 0x7f3e3010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 --2- 172.21.15.22:0/4111834346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e30103670 0x7f3e3010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 --2- 172.21.15.22:0/4111834346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e30103130 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 -- 172.21.15.22:0/4111834346 >> 172.21.15.22:0/4111834346 conn(0x7f3e300fc7d0 msgr2=0x7f3e300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 -- 172.21.15.22:0/4111834346 shutdown_connections 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 -- 172.21.15.22:0/4111834346 wait complete. 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.172+0000 7f3e367b0640 1 Processor -- start 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 -- start start 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:16.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e30103670 0x7f3e30100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e3010c180 0x7f3e30101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30112150 con 0x7f3e30102d50 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30111fd0 con 0x7f3e30103670 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e367b0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e301122d0 con 0x7f3e3010c180 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59932/0 (socket says 172.21.15.22:59932) 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2ffff640 1 -- 172.21.15.22:0/3816274206 learned_addr learned my addr 172.21.15.22:0/3816274206 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2f7fe640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e30103670 0x7f3e30100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e34d4d640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e3010c180 0x7f3e30101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2ffff640 1 -- 172.21.15.22:0/3816274206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e3010c180 msgr2=0x7f3e30101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.173+0000 7f3e2ffff640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e3010c180 0x7f3e30101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2ffff640 1 -- 172.21.15.22:0/3816274206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e30103670 msgr2=0x7f3e30100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2ffff640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e30103670 0x7f3e30100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2ffff640 1 -- 172.21.15.22:0/3816274206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e301a6a70 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2ffff640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e2002aa70 tx=0x7f3e20032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2003f030 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e20032e40 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e301a6d00 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20035070 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.174+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e301a7190 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.175+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e30103130 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.177+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e20042030 con 0x7f3e30102d50 2024-09-11T22:27:16.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.177+0000 7f3e2d7fa640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 0x7f3e180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:16.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.177+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f3e200ef2d0 con 0x7f3e30102d50 2024-09-11T22:27:16.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.177+0000 7f3e2f7fe640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 0x7f3e180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:16.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.178+0000 7f3e2f7fe640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 0x7f3e180a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3e30102440 tx=0x7f3e24009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:16.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.181+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e200bc080 con 0x7f3e30102d50 2024-09-11T22:27:16.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.403+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e3002d7c0 con 0x7f3e30102d50 2024-09-11T22:27:16.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.404+0000 7f3e2d7fa640 1 -- 172.21.15.22:0/3816274206 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f3e200c0380 con 0x7f3e30102d50 2024-09-11T22:27:16.405 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:16.405 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"btime":"2024-09-11T22:27:14:555309+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T22:27:16.406 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-09-11T22:27:16.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 msgr2=0x7f3e180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 0x7f3e180a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3e30102440 tx=0x7f3e24009060 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 msgr2=0x7f3e301009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e2002aa70 tx=0x7f3e20032a40 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 shutdown_connections 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3e180a2b80 0x7f3e180a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e3010c180 0x7f3e30101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e30103670 0x7f3e30100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 --2- 172.21.15.22:0/3816274206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e30102d50 0x7f3e301009b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 >> 172.21.15.22:0/3816274206 conn(0x7f3e300fc7d0 msgr2=0x7f3e300fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:16.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 shutdown_connections 2024-09-11T22:27:16.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:16.407+0000 7f3e367b0640 1 -- 172.21.15.22:0/3816274206 wait complete. 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3816274206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:16 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3816274206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:16 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3816274206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:16 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:17.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T22:27:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:17 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:17 smithi022 ceph-mon[30966]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:17.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:17 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:17.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:17 smithi169 ceph-mon[35628]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:17.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:17 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:17.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:17 smithi045 ceph-mon[35556]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:17.955 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:18.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- 172.21.15.22:0/1383369570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0106f00 msgr2=0x7fd6a010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/1383369570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0106f00 0x7fd6a010ea80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd69802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- 172.21.15.22:0/1383369570 shutdown_connections 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/1383369570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0106f00 0x7fd6a010ea80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/1383369570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0102780 0x7fd6a01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/1383369570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 0x7fd6a01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- 172.21.15.22:0/1383369570 >> 172.21.15.22:0/1383369570 conn(0x7fd6a00fd890 msgr2=0x7fd6a00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- 172.21.15.22:0/1383369570 shutdown_connections 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- 172.21.15.22:0/1383369570 wait complete. 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 Processor -- start 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.475+0000 7fd6a79f0640 1 -- start start 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 0x7fd6a0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0106f00 0x7fd6a019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:18.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0112080 con 0x7fd6a0102780 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0111f00 con 0x7fd6a0101dd0 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a79f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0112200 con 0x7fd6a0106f00 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59946/0 (socket says 172.21.15.22:59946) 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 -- 172.21.15.22:0/70872424 learned_addr learned my addr 172.21.15.22:0/70872424 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a578c640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 0x7fd6a0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a5f8d640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0106f00 0x7fd6a019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 -- 172.21.15.22:0/70872424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0106f00 msgr2=0x7fd6a019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0106f00 0x7fd6a019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 -- 172.21.15.22:0/70872424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 msgr2=0x7fd6a0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 0x7fd6a0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 -- 172.21.15.22:0/70872424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a019d4f0 con 0x7fd6a0102780 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6a4f8b640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d770 tx=0x7fd69000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.476+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6a0102780 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.477+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd690005520 con 0x7fd6a0102780 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.477+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a019d7e0 con 0x7fd6a0102780 2024-09-11T22:27:18.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.477+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690010460 con 0x7fd6a0102780 2024-09-11T22:27:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.477+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a01a50c0 con 0x7fd6a0102780 2024-09-11T22:27:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.478+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a01021b0 con 0x7fd6a0102780 2024-09-11T22:27:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.479+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd690004ea0 con 0x7fd6a0102780 2024-09-11T22:27:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.479+0000 7fd6967fc640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 0x7fd68c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:18.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.480+0000 7fd6a578c640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 0x7fd68c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:18.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.480+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd6900ce690 con 0x7fd6a0102780 2024-09-11T22:27:18.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.480+0000 7fd6a578c640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 0x7fd68c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005d00 tx=0x7fd69c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:18.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.484+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd69009b9f0 con 0x7fd6a0102780 2024-09-11T22:27:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.682+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd6a010a110 con 0x7fd6a0102780 2024-09-11T22:27:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.683+0000 7fd6967fc640 1 -- 172.21.15.22:0/70872424 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7fd69009b2f0 con 0x7fd6a0102780 2024-09-11T22:27:18.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:27:18.684 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 msgr2=0x7fd68c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 0x7fd68c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005d00 tx=0x7fd69c00b410 comp rx=0 tx=0).stop 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 msgr2=0x7fd6a0198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d770 tx=0x7fd69000dc30 comp rx=0 tx=0).stop 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 shutdown_connections 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd68c0a2b80 0x7fd68c0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a0106f00 0x7fd6a019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a0102780 0x7fd6a0198a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 --2- 172.21.15.22:0/70872424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6a0101dd0 0x7fd6a0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 >> 172.21.15.22:0/70872424 conn(0x7fd6a00fd890 msgr2=0x7fd6a00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 shutdown_connections 2024-09-11T22:27:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:18.685+0000 7fd6a79f0640 1 -- 172.21.15.22:0/70872424 wait complete. 2024-09-11T22:27:19.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:18 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:18 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/70872424' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:27:19.351 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:27:19.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:27:19.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:18 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:18 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/70872424' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:27:19.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:18 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:19.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:18 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/70872424' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:27:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 -- 172.21.15.22:0/2373865439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8100a80 msgr2=0x7fbff8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 --2- 172.21.15.22:0/2373865439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8100a80 0x7fbff8100ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009930 tx=0x7fbfec02a420 comp rx=0 tx=0).stop 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 -- 172.21.15.22:0/2373865439 shutdown_connections 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 --2- 172.21.15.22:0/2373865439 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 0x7fbff810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 --2- 172.21.15.22:0/2373865439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8100a80 0x7fbff8100ee0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 --2- 172.21.15.22:0/2373865439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8106a80 0x7fbff8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.111+0000 7fbffe583640 1 -- 172.21.15.22:0/2373865439 >> 172.21.15.22:0/2373865439 conn(0x7fbff80fc7a0 msgr2=0x7fbff80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.112+0000 7fbffe583640 1 -- 172.21.15.22:0/2373865439 shutdown_connections 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.112+0000 7fbffe583640 1 -- 172.21.15.22:0/2373865439 wait complete. 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.112+0000 7fbffe583640 1 Processor -- start 2024-09-11T22:27:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.112+0000 7fbffe583640 1 -- start start 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.112+0000 7fbffe583640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 0x7fbff81986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 0x7fbff8198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8112160 con 0x7fbff8106a80 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8111fe0 con 0x7fbff8100a80 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbff81122e0 con 0x7fbff8101420 2024-09-11T22:27:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59968/0 (socket says 172.21.15.22:59968) 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 -- 172.21.15.22:0/3471263507 learned_addr learned my addr 172.21.15.22:0/3471263507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff77fe640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 0x7fbff8198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff7fff640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 0x7fbff81986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 -- 172.21.15.22:0/3471263507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 msgr2=0x7fbff8198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 0x7fbff8198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 -- 172.21.15.22:0/3471263507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 msgr2=0x7fbff81986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 0x7fbff81986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 -- 172.21.15.22:0/3471263507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff819d650 con 0x7fbff8106a80 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff7fff640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 0x7fbff81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffcb20640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b970 tx=0x7fbff000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:20.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0019070 con 0x7fbff8106a80 2024-09-11T22:27:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbff000cb40 con 0x7fbff8106a80 2024-09-11T22:27:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff819d940 con 0x7fbff8106a80 2024-09-11T22:27:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.113+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0007700 con 0x7fbff8106a80 2024-09-11T22:27:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.114+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81a5220 con 0x7fbff8106a80 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.115+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff8100f60 con 0x7fbff8106a80 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.116+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbff001c070 con 0x7fbff8106a80 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.116+0000 7fbff57fa640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 0x7fbfe00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.117+0000 7fbff7fff640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 0x7fbfe00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.117+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbff00ce170 con 0x7fbff8106a80 2024-09-11T22:27:20.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.117+0000 7fbff7fff640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 0x7fbfe00a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009930 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:20.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.121+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbff009ae80 con 0x7fbff8106a80 2024-09-11T22:27:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.298+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbff8108a80 con 0x7fbff8106a80 2024-09-11T22:27:20.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.781+0000 7fbff57fa640 1 -- 172.21.15.22:0/3471263507 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7fbff009f180 con 0x7fbff8106a80 2024-09-11T22:27:20.782 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-09-11T22:27:20.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.784+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 msgr2=0x7fbfe00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.784+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 0x7fbfe00a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009930 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.784+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 msgr2=0x7fbff819cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.784+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b970 tx=0x7fbff000be30 comp rx=0 tx=0).stop 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 shutdown_connections 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbff8106a80 0x7fbff819cf70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fbfe00a2c00 0x7fbfe00a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbff8101420 0x7fbff8198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 --2- 172.21.15.22:0/3471263507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbff8100a80 0x7fbff81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:20.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 >> 172.21.15.22:0/3471263507 conn(0x7fbff80fc7a0 msgr2=0x7fbff80fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:20.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.785+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 shutdown_connections 2024-09-11T22:27:20.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:20.786+0000 7fbffe583640 1 -- 172.21.15.22:0/3471263507 wait complete. 2024-09-11T22:27:21.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:21.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:21.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:21.096 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:21.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:21.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:21.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:21.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:21.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:21.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:27:21.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:27:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:21.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:21 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:27:22.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:21 smithi022 ceph-mon[30966]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:22.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:21 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:27:22.049 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:21 smithi022 ceph-mon[30966]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:27:22.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:21 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:27:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:21 smithi169 ceph-mon[35628]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:21 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:27:22.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:21 smithi169 ceph-mon[35628]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:27:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 -- 172.21.15.22:0/1304668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214103780 msgr2=0x7f9214107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 --2- 172.21.15.22:0/1304668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214103780 0x7f9214107bc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9208009930 tx=0x7f920802a420 comp rx=0 tx=0).stop 2024-09-11T22:27:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 -- 172.21.15.22:0/1304668228 shutdown_connections 2024-09-11T22:27:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 --2- 172.21.15.22:0/1304668228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 --2- 172.21.15.22:0/1304668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214103780 0x7f9214107bc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 --2- 172.21.15.22:0/1304668228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214102dd0 0x7f92141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 -- 172.21.15.22:0/1304668228 >> 172.21.15.22:0/1304668228 conn(0x7f92140fc7d0 msgr2=0x7f92140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 -- 172.21.15.22:0/1304668228 shutdown_connections 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 -- 172.21.15.22:0/1304668228 wait complete. 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.138+0000 7f9218b00640 1 Processor -- start 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 -- start start 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214103780 0x7f9214198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92141121b0 con 0x7f9214102dd0 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9214112030 con 0x7f9214103780 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9218b00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9214112330 con 0x7f9214108300 2024-09-11T22:27:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59988/0 (socket says 172.21.15.22:59988) 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 -- 172.21.15.22:0/2388536122 learned_addr learned my addr 172.21.15.22:0/2388536122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9211d9b640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214103780 0x7f9214198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9212d9d640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 -- 172.21.15.22:0/2388536122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 msgr2=0x7f921419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 -- 172.21.15.22:0/2388536122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214103780 msgr2=0x7f9214198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214103780 0x7f9214198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f921259c640 1 -- 172.21.15.22:0/2388536122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921419d5d0 con 0x7f9214102dd0 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.139+0000 7f9212d9d640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f921259c640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f920400cce0 tx=0x7f920400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920400f650 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921419d8c0 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f920400fcf0 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204018d20 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.140+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141a51a0 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.141+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92141031b0 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.142+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f920400f7f0 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.143+0000 7f92037fe640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 0x7f91fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.143+0000 7f9211d9b640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 0x7f91fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.143+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f92040cf550 con 0x7f9214102dd0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.143+0000 7f9211d9b640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 0x7f91fc0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9208005940 tx=0x7f92080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:22.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.146+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9204014030 con 0x7f9214102dd0 2024-09-11T22:27:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:21 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:27:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:21 smithi045 ceph-mon[35556]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:21 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3471263507' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:27:22.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:21 smithi045 ceph-mon[35556]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T22:27:22.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.323+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f921410a2e0 con 0x7f9214102dd0 2024-09-11T22:27:22.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.788+0000 7f92037fe640 1 -- 172.21.15.22:0/2388536122 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f920409c870 con 0x7f9214102dd0 2024-09-11T22:27:22.789 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-09-11T22:27:22.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 msgr2=0x7f91fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:22.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 0x7f91fc0a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9208005940 tx=0x7f92080058d0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 msgr2=0x7f9214198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f920400cce0 tx=0x7f920400a620 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 shutdown_connections 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f91fc0a2b80 0x7f91fc0a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9214108300 0x7f921419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9214103780 0x7f9214198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.790+0000 7f9218b00640 1 --2- 172.21.15.22:0/2388536122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9214102dd0 0x7f9214198620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.791+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 >> 172.21.15.22:0/2388536122 conn(0x7f92140fc7d0 msgr2=0x7f92140fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.791+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 shutdown_connections 2024-09-11T22:27:22.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:22.791+0000 7f9218b00640 1 -- 172.21.15.22:0/2388536122 wait complete. 2024-09-11T22:27:23.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:22 smithi022 ceph-mon[30966]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:23.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:27:23.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:22 smithi169 ceph-mon[35628]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:23.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:27:23.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:22 smithi045 ceph-mon[35556]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:23.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:27:23.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:27:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:24.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:23 smithi022 ceph-mon[30966]: pgmap v275: 33 pgs: 1 creating+activating, 4 creating+peering, 25 unknown, 3 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:23 smithi022 ceph-mon[30966]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:27:24.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:23 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:27:24.141 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:23 smithi022 ceph-mon[30966]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:24.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:23 smithi169 ceph-mon[35628]: pgmap v275: 33 pgs: 1 creating+activating, 4 creating+peering, 25 unknown, 3 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:23 smithi169 ceph-mon[35628]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:27:24.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:23 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:27:24.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:23 smithi169 ceph-mon[35628]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:24.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:23 smithi045 ceph-mon[35556]: pgmap v275: 33 pgs: 1 creating+activating, 4 creating+peering, 25 unknown, 3 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:23 smithi045 ceph-mon[35556]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:27:24.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:23 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2388536122' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:27:24.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:23 smithi045 ceph-mon[35556]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:24.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.234+0000 7f711c15d640 1 -- 172.21.15.22:0/1828096141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114102790 msgr2=0x7f71141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.234+0000 7f711c15d640 1 --2- 172.21.15.22:0/1828096141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114102790 0x7f71141067e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7108009900 tx=0x7f710802a410 comp rx=0 tx=0).stop 2024-09-11T22:27:24.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- 172.21.15.22:0/1828096141 shutdown_connections 2024-09-11T22:27:24.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- 172.21.15.22:0/1828096141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114106f10 0x7f711410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- 172.21.15.22:0/1828096141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114102790 0x7f71141067e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- 172.21.15.22:0/1828096141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 0x7f71141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- 172.21.15.22:0/1828096141 >> 172.21.15.22:0/1828096141 conn(0x7f71140fd8c0 msgr2=0x7f71140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- 172.21.15.22:0/1828096141 shutdown_connections 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- 172.21.15.22:0/1828096141 wait complete. 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 Processor -- start 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- start start 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 0x7f7114198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 0x7f71141989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7114112090 con 0x7f7114106f10 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7114111f10 con 0x7f7114101de0 2024-09-11T22:27:24.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.235+0000 7f711c15d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7114112210 con 0x7f7114102790 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50202/0 (socket says 172.21.15.22:50202) 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 -- 172.21.15.22:0/241787873 learned_addr learned my addr 172.21.15.22:0/241787873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f7119ef9640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 0x7f7114198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f71196f8640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 0x7f71141989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 -- 172.21.15.22:0/241787873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 msgr2=0x7f71141989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 0x7f71141989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 -- 172.21.15.22:0/241787873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 msgr2=0x7f7114198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 0x7f7114198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 -- 172.21.15.22:0/241787873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711419d420 con 0x7f7114106f10 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f71196f8640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 0x7f71141989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:24.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711a6fa640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c970 tx=0x7f710c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c007bb0 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f710c007d50 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711419d710 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0188a0 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.236+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71141a4ff0 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.238+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71141021c0 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.239+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f710c018a60 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.240+0000 7f7112ffd640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 0x7f70fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.240+0000 7f7119ef9640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 0x7f70fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.240+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f710c0cf080 con 0x7f7114106f10 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.240+0000 7f7119ef9640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 0x7f70fc0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7104005c40 tx=0x7f710400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:24.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.244+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f710c014030 con 0x7f7114106f10 2024-09-11T22:27:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.457+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f71141997d0 con 0x7f7114106f10 2024-09-11T22:27:24.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.802+0000 7f7112ffd640 1 -- 172.21.15.22:0/241787873 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f710c09c180 con 0x7f7114106f10 2024-09-11T22:27:24.803 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 msgr2=0x7f70fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 0x7f70fc0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7104005c40 tx=0x7f710400a590 comp rx=0 tx=0).stop 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 msgr2=0x7f711419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f710c00c970 tx=0x7f710c00ce30 comp rx=0 tx=0).stop 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 shutdown_connections 2024-09-11T22:27:24.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7114106f10 0x7f711419cd40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f70fc0a2b80 0x7f70fc0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7114102790 0x7f71141989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 --2- 172.21.15.22:0/241787873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7114101de0 0x7f7114198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 >> 172.21.15.22:0/241787873 conn(0x7f71140fd8c0 msgr2=0x7f71140fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 shutdown_connections 2024-09-11T22:27:24.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:24.805+0000 7f711c15d640 1 -- 172.21.15.22:0/241787873 wait complete. 2024-09-11T22:27:25.110 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:24 smithi022 ceph-mon[30966]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:27:25.110 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:24 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:27:25.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:24 smithi022 ceph-mon[30966]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:27:25.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:24 smithi169 ceph-mon[35628]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:27:25.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:24 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:27:25.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:24 smithi169 ceph-mon[35628]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:27:25.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:24 smithi045 ceph-mon[35556]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:27:25.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:24 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:27:25.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:24 smithi045 ceph-mon[35556]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:27:25.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:26.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:25 smithi022 ceph-mon[30966]: pgmap v278: 97 pgs: 1 creating+activating, 19 creating+peering, 57 unknown, 20 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:26.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:25 smithi022 ceph-mon[30966]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:27:26.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:25 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:27:26.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:25 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:27:26.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:25 smithi022 ceph-mon[30966]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:27:26.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:25 smithi169 ceph-mon[35628]: pgmap v278: 97 pgs: 1 creating+activating, 19 creating+peering, 57 unknown, 20 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:26.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:25 smithi169 ceph-mon[35628]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:27:26.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:25 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:27:26.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:25 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:27:26.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:25 smithi169 ceph-mon[35628]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:27:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:25 smithi045 ceph-mon[35556]: pgmap v278: 97 pgs: 1 creating+activating, 19 creating+peering, 57 unknown, 20 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:25 smithi045 ceph-mon[35556]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:27:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:25 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/241787873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:27:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:25 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:27:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:25 smithi045 ceph-mon[35556]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 -- 172.21.15.22:0/2530639241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988106f10 msgr2=0x7fc98810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 --2- 172.21.15.22:0/2530639241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988106f10 0x7fc98810ea90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc980009ca0 tx=0x7fc98002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 -- 172.21.15.22:0/2530639241 shutdown_connections 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 --2- 172.21.15.22:0/2530639241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988106f10 0x7fc98810ea90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 --2- 172.21.15.22:0/2530639241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988102790 0x7fc9881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 --2- 172.21.15.22:0/2530639241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988101de0 0x7fc9881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 -- 172.21.15.22:0/2530639241 >> 172.21.15.22:0/2530639241 conn(0x7fc9880fd8c0 msgr2=0x7fc9880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:26.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 -- 172.21.15.22:0/2530639241 shutdown_connections 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.230+0000 7fc9907d4640 1 -- 172.21.15.22:0/2530639241 wait complete. 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 Processor -- start 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 -- start start 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 0x7fc988074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 0x7fc988074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881120e0 con 0x7fc988101de0 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc988111f60 con 0x7fc988102790 2024-09-11T22:27:26.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc9907d4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc988112260 con 0x7fc988106f10 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50218/0 (socket says 172.21.15.22:50218) 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 -- 172.21.15.22:0/1548592351 learned_addr learned my addr 172.21.15.22:0/1548592351 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98ed71640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 0x7fc988074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 -- 172.21.15.22:0/1548592351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 msgr2=0x7fc988074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 0x7fc988074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98dd6f640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 0x7fc988074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 -- 172.21.15.22:0/1548592351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 msgr2=0x7fc988074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.231+0000 7fc98e570640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 0x7fc988074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc98e570640 1 -- 172.21.15.22:0/1548592351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9881aae30 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc98ed71640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 0x7fc988074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc98dd6f640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 0x7fc988074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc98e570640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d950 tx=0x7fc98400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984017070 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc984009c30 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9881ab060 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98400f740 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.232+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9881ab5a0 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.233+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9881032c0 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.234+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc984010a80 con 0x7fc988101de0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.235+0000 7fc97f7fe640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 0x7fc9740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.235+0000 7fc98dd6f640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 0x7fc9740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.235+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc9840cebf0 con 0x7fc988101de0 2024-09-11T22:27:26.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.235+0000 7fc98dd6f640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 0x7fc9740a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc988075cb0 tx=0x7fc978005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:26.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.239+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc984009de0 con 0x7fc988101de0 2024-09-11T22:27:26.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.415+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9881ab860 con 0x7fc988101de0 2024-09-11T22:27:26.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.417+0000 7fc97f7fe640 1 -- 172.21.15.22:0/1548592351 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22255 (secure 0 0 0) 0x7fc98409bca0 con 0x7fc988101de0 2024-09-11T22:27:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:26.419 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":80,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:27:24.459003+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 msgr2=0x7fc9740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 0x7fc9740a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc988075cb0 tx=0x7fc978005e50 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 msgr2=0x7fc9880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d950 tx=0x7fc98400de10 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 shutdown_connections 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc9740a2b80 0x7fc9740a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc988106f10 0x7fc988074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc988102790 0x7fc988074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 --2- 172.21.15.22:0/1548592351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc988101de0 0x7fc9880744f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 >> 172.21.15.22:0/1548592351 conn(0x7fc9880fd8c0 msgr2=0x7fc9880ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 shutdown_connections 2024-09-11T22:27:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:26.419+0000 7fc9907d4640 1 -- 172.21.15.22:0/1548592351 wait complete. 2024-09-11T22:27:27.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:26 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:active 2024-09-11T22:27:27.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:26 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:26 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:26 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1548592351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:27.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:27.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:26 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:active 2024-09-11T22:27:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:26 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:26 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:26 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1548592351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:26 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] up:active 2024-09-11T22:27:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:26 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:26 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:26 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1548592351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:27.385 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 -- 172.21.15.22:0/1924396496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 msgr2=0x7f204c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 --2- 172.21.15.22:0/1924396496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c107b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2034009930 tx=0x7f203402a420 comp rx=0 tx=0).stop 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 -- 172.21.15.22:0/1924396496 shutdown_connections 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 --2- 172.21.15.22:0/1924396496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c108290 0x7f204c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 --2- 172.21.15.22:0/1924396496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c107b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 --2- 172.21.15.22:0/1924396496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c102d90 0x7f204c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 -- 172.21.15.22:0/1924396496 >> 172.21.15.22:0/1924396496 conn(0x7f204c0fc7d0 msgr2=0x7f204c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 -- 172.21.15.22:0/1924396496 shutdown_connections 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.828+0000 7f205236d640 1 -- 172.21.15.22:0/1924396496 wait complete. 2024-09-11T22:27:27.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 Processor -- start 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 -- start start 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c102d90 0x7f204c1a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c108290 0x7f204c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f204c1121b0 con 0x7f204c103740 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f204c112030 con 0x7f204c108290 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205236d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f204c112330 con 0x7f204c102d90 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:27.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50234/0 (socket says 172.21.15.22:50234) 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 -- 172.21.15.22:0/2427102973 learned_addr learned my addr 172.21.15.22:0/2427102973 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f204bfff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c102d90 0x7f204c1a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 -- 172.21.15.22:0/2427102973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c102d90 msgr2=0x7f204c1a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f205090a640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c108290 0x7f204c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c102d90 0x7f204c1a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 -- 172.21.15.22:0/2427102973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c108290 msgr2=0x7f204c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c108290 0x7f204c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 -- 172.21.15.22:0/2427102973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c19aee0 con 0x7f204c103740 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.829+0000 7f2043fff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2034005940 tx=0x7f20340040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.830+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203403f030 con 0x7f204c103740 2024-09-11T22:27:27.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.830+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20340044c0 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.830+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034035070 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.830+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c19b170 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.830+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c1a7350 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.831+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c06a7f0 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.832+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2034042030 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.833+0000 7f2049ffb640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 0x7f20380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.833+0000 7f204bfff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 0x7f20380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.833+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f20340ef3c0 con 0x7f204c103740 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.833+0000 7f204bfff640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 0x7f20380a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f203c009bd0 tx=0x7f203c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:27.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:27.837+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20340bc3d0 con 0x7f204c103740 2024-09-11T22:27:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.014+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f204c19bba0 con 0x7f204c103740 2024-09-11T22:27:28.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.015+0000 7f2049ffb640 1 -- 172.21.15.22:0/2427102973 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22255 (secure 0 0 0) 0x7f20340bbcd0 con 0x7f204c103740 2024-09-11T22:27:28.017 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:28.017 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":80,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:27:24.459003+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 msgr2=0x7f20380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 0x7f20380a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f203c009bd0 tx=0x7f203c005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 msgr2=0x7f204c1a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2034005940 tx=0x7f20340040c0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 shutdown_connections 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204c108290 0x7f204c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f204c103740 0x7f204c1a0ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f20380a2b80 0x7f20380a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 --2- 172.21.15.22:0/2427102973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f204c102d90 0x7f204c1a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 >> 172.21.15.22:0/2427102973 conn(0x7f204c0fc7d0 msgr2=0x7f204c101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 shutdown_connections 2024-09-11T22:27:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:28.017+0000 7f205236d640 1 -- 172.21.15.22:0/2427102973 wait complete. 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:27 smithi022 ceph-mon[30966]: pgmap v280: 97 pgs: 1 creating+activating, 15 creating+peering, 4 unknown, 77 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 424 B/s wr, 5 op/s 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:27 smithi022 ceph-mon[30966]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:27 smithi022 ceph-mon[30966]: Cluster is now healthy 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:27 smithi169 ceph-mon[35628]: pgmap v280: 97 pgs: 1 creating+activating, 15 creating+peering, 4 unknown, 77 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 424 B/s wr, 5 op/s 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:27 smithi169 ceph-mon[35628]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:27:28.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:27 smithi169 ceph-mon[35628]: Cluster is now healthy 2024-09-11T22:27:28.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:27 smithi045 ceph-mon[35556]: pgmap v280: 97 pgs: 1 creating+activating, 15 creating+peering, 4 unknown, 77 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 424 B/s wr, 5 op/s 2024-09-11T22:27:28.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:27 smithi045 ceph-mon[35556]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:27:28.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:27 smithi045 ceph-mon[35556]: Cluster is now healthy 2024-09-11T22:27:28.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:27:28.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:28 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2427102973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:29.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:28 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2427102973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:29.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:28 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2427102973' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:29.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 -- 172.21.15.22:0/1240724948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a810c170 msgr2=0x7f72a810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 --2- 172.21.15.22:0/1240724948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a810c170 0x7f72a810e610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009ca0 tx=0x7f72a002a950 comp rx=0 tx=0).stop 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 -- 172.21.15.22:0/1240724948 shutdown_connections 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 --2- 172.21.15.22:0/1240724948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a810c170 0x7f72a810e610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 --2- 172.21.15.22:0/1240724948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a8103660 0x7f72a810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 --2- 172.21.15.22:0/1240724948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8102d40 0x7f72a8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 -- 172.21.15.22:0/1240724948 >> 172.21.15.22:0/1240724948 conn(0x7f72a80fc7a0 msgr2=0x7f72a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 -- 172.21.15.22:0/1240724948 shutdown_connections 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.437+0000 7f72ae727640 1 -- 172.21.15.22:0/1240724948 wait complete. 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 Processor -- start 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 -- start start 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 0x7f72a8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:29.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 0x7f72a8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81120f0 con 0x7f72a8102d40 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8111f70 con 0x7f72a810c170 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72ae727640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8112270 con 0x7f72a8103660 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50256/0 (socket says 172.21.15.22:50256) 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 -- 172.21.15.22:0/1096250324 learned_addr learned my addr 172.21.15.22:0/1096250324 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72accc4640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 0x7f72a8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 -- 172.21.15.22:0/1096250324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 msgr2=0x7f72a8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f729ffff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 0x7f72a8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 0x7f72a8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 -- 172.21.15.22:0/1096250324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 msgr2=0x7f72a8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 0x7f72a8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72a7fff640 1 -- 172.21.15.22:0/1096250324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81a6a50 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f72accc4640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 0x7f72a8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.438+0000 7f729ffff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 0x7f72a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72a7fff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f729800b4a0 tx=0x7f729800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298014070 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a81a6d40 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7298010b10 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298017d60 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.439+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a81a7220 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.440+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a8103120 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.441+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7298017070 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.442+0000 7f72a5ffb640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 0x7f72940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.442+0000 7f729ffff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 0x7f72940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.442+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f72980ce320 con 0x7f72a8102d40 2024-09-11T22:27:29.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.442+0000 7f729ffff640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 0x7f72940a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72a8102430 tx=0x7f7290009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:29.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.446+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f729809b3d0 con 0x7f72a8102d40 2024-09-11T22:27:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.659+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f72a8107210 con 0x7f72a8102d40 2024-09-11T22:27:29.820 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:27:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: 2024-09-11T22:27:29.566+0000 7fa45040e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:27:29.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.822+0000 7f72a5ffb640 1 -- 172.21.15.22:0/1096250324 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f729809acd0 con 0x7f72a8102d40 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 msgr2=0x7f72940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 0x7f72940a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72a8102430 tx=0x7f7290009670 comp rx=0 tx=0).stop 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 msgr2=0x7f72a81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f729800b4a0 tx=0x7f729800b960 comp rx=0 tx=0).stop 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 shutdown_connections 2024-09-11T22:27:29.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72a810c170 0x7f72a8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f72940a2b80 0x7f72940a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72a8103660 0x7f72a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 --2- 172.21.15.22:0/1096250324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72a8102d40 0x7f72a81009a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.824+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 >> 172.21.15.22:0/1096250324 conn(0x7f72a80fc7a0 msgr2=0x7f72a80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.825+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 shutdown_connections 2024-09-11T22:27:29.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:29.825+0000 7f72ae727640 1 -- 172.21.15.22:0/1096250324 wait complete. 2024-09-11T22:27:30.070 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:29 smithi169 ceph-mon[35628]: pgmap v281: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:30.070 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:29 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:27:30.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:29 smithi022 ceph-mon[30966]: pgmap v281: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:30.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:29 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:27:30.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:29 smithi045 ceph-mon[35556]: pgmap v281: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:30.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:29 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:27:30.568 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T22:27:30.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T22:27:30.830 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:31.093 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:30 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:27:31.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:30 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:31.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:30 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:27:31.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:30 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:31.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:30 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1096250324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:27:31.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:30 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 -- 172.21.15.22:0/1130756864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604101de0 msgr2=0x7f46041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 --2- 172.21.15.22:0/1130756864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604101de0 0x7f46041021c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009900 tx=0x7f45ec02a410 comp rx=0 tx=0).stop 2024-09-11T22:27:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 -- 172.21.15.22:0/1130756864 shutdown_connections 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 --2- 172.21.15.22:0/1130756864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604106f10 0x7f460410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 --2- 172.21.15.22:0/1130756864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604102790 0x7f46041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 --2- 172.21.15.22:0/1130756864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604101de0 0x7f46041021c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 -- 172.21.15.22:0/1130756864 >> 172.21.15.22:0/1130756864 conn(0x7f46040fd8c0 msgr2=0x7f46040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 -- 172.21.15.22:0/1130756864 shutdown_connections 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.289+0000 7f460b04e640 1 -- 172.21.15.22:0/1130756864 wait complete. 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 Processor -- start 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 -- start start 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604101de0 0x7f4604198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102790 0x7f4604198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4604112090 con 0x7f4604106f10 2024-09-11T22:27:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4604111f10 con 0x7f4604101de0 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f460b04e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4604112210 con 0x7f4604102790 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50272/0 (socket says 172.21.15.22:50272) 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 -- 172.21.15.22:0/2652801215 learned_addr learned my addr 172.21.15.22:0/2652801215 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f4603fff640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102790 0x7f4604198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f4608dea640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604101de0 0x7f4604198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 -- 172.21.15.22:0/2652801215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102790 msgr2=0x7f4604198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102790 0x7f4604198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 -- 172.21.15.22:0/2652801215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604101de0 msgr2=0x7f4604198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604101de0 0x7f4604198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.290+0000 7f46095eb640 1 -- 172.21.15.22:0/2652801215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460419d3f0 con 0x7f4604106f10 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f46095eb640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00eb10 tx=0x7f45fc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00ce20 con 0x7f4604106f10 2024-09-11T22:27:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45fc004b20 con 0x7f4604106f10 2024-09-11T22:27:31.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460419d6e0 con 0x7f4604106f10 2024-09-11T22:27:31.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc010760 con 0x7f4604106f10 2024-09-11T22:27:31.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.291+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46041a4fc0 con 0x7f4604106f10 2024-09-11T22:27:31.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.292+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46041021c0 con 0x7f4604106f10 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.293+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f45fc005020 con 0x7f4604106f10 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.294+0000 7f4601ffb640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 0x7f45f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.294+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f45fc0cf580 con 0x7f4604106f10 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.294+0000 7f4608dea640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 0x7f45f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.295+0000 7f4608dea640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 0x7f45f00a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45ec005ab0 tx=0x7f45ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:31.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.298+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45fc09c630 con 0x7f4604106f10 2024-09-11T22:27:31.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.512+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f460410a150 con 0x7f4604106f10 2024-09-11T22:27:31.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.832+0000 7f4601ffb640 1 -- 172.21.15.22:0/2652801215 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f45fc09bf30 con 0x7f4604106f10 2024-09-11T22:27:31.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.834+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 msgr2=0x7f45f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:31.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 0x7f45f00a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45ec005ab0 tx=0x7f45ec005a20 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 msgr2=0x7f460419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00eb10 tx=0x7f45fc00ef10 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 shutdown_connections 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4604106f10 0x7f460419cd10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45f00a2c00 0x7f45f00a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102790 0x7f4604198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 --2- 172.21.15.22:0/2652801215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4604101de0 0x7f4604198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 >> 172.21.15.22:0/2652801215 conn(0x7f46040fd8c0 msgr2=0x7f46040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 shutdown_connections 2024-09-11T22:27:31.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:31.835+0000 7f460b04e640 1 -- 172.21.15.22:0/2652801215 wait complete. 2024-09-11T22:27:32.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:31 smithi022 ceph-mon[30966]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:32.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:31 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:27:32.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:31 smithi169 ceph-mon[35628]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:32.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:31 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:27:32.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:31 smithi045 ceph-mon[35556]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T22:27:32.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:31 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:27:32.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T22:27:32.796 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:33.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:32 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:27:33.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:32 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:33.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:32 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:33.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:32 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:27:33.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:32 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:33.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:32 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:33.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:32 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2652801215' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:27:33.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:32 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:27:33.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:32 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 -- 172.21.15.22:0/3232951469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 msgr2=0x7fa1f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/3232951469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f010ea90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009ca0 tx=0x7fa1e802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 -- 172.21.15.22:0/3232951469 shutdown_connections 2024-09-11T22:27:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/3232951469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f010ea90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/3232951469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0102790 0x7fa1f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/3232951469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0101de0 0x7fa1f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.279+0000 7fa1f65bd640 1 -- 172.21.15.22:0/3232951469 >> 172.21.15.22:0/3232951469 conn(0x7fa1f00fd8c0 msgr2=0x7fa1f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.280+0000 7fa1f65bd640 1 -- 172.21.15.22:0/3232951469 shutdown_connections 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.280+0000 7fa1f65bd640 1 -- 172.21.15.22:0/3232951469 wait complete. 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.280+0000 7fa1f65bd640 1 Processor -- start 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.280+0000 7fa1f65bd640 1 -- start start 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.280+0000 7fa1f65bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0101de0 0x7fa1f0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0102790 0x7fa1f0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01120d0 con 0x7fa1f0106f10 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0111f50 con 0x7fa1f0101de0 2024-09-11T22:27:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112250 con 0x7fa1f0102790 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50294/0 (socket says 172.21.15.22:50294) 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 -- 172.21.15.22:0/790280255 learned_addr learned my addr 172.21.15.22:0/790280255 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1ef7fe640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0102790 0x7fa1f0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1effff640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0101de0 0x7fa1f0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 -- 172.21.15.22:0/790280255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0102790 msgr2=0x7fa1f0198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0102790 0x7fa1f0198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 -- 172.21.15.22:0/790280255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0101de0 msgr2=0x7fa1f0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0101de0 0x7fa1f0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 -- 172.21.15.22:0/790280255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f019d4b0 con 0x7fa1f0106f10 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f4b5a640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006010 tx=0x7fa1e80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e802fa20 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1e802fbc0 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f019d740 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8046860 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.281+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f0074420 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.282+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f01032c0 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.284+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa1e802fd70 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.285+0000 7fa1ed7fa640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 0x7fa1d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.285+0000 7fa1effff640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 0x7fa1d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.285+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa1e80f0730 con 0x7fa1f0106f10 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.285+0000 7fa1effff640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 0x7fa1d80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009890 tx=0x7fa1e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.288+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1e80bd7d0 con 0x7fa1f0106f10 2024-09-11T22:27:33.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:33.500+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa1f01021c0 con 0x7fa1f0106f10 2024-09-11T22:27:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.219+0000 7fa1ed7fa640 1 -- 172.21.15.22:0/790280255 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7fa1f01021c0 con 0x7fa1f0106f10 2024-09-11T22:27:34.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 msgr2=0x7fa1d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 0x7fa1d80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009890 tx=0x7fa1e0008040 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 msgr2=0x7fa1f019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8006010 tx=0x7fa1e80319f0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 shutdown_connections 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1f0106f10 0x7fa1f019cdd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa1d80a2b80 0x7fa1d80a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1f0102790 0x7fa1f0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 --2- 172.21.15.22:0/790280255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1f0101de0 0x7fa1f0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 >> 172.21.15.22:0/790280255 conn(0x7fa1f00fd8c0 msgr2=0x7fa1f00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 shutdown_connections 2024-09-11T22:27:34.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:34.222+0000 7fa1f65bd640 1 -- 172.21.15.22:0/790280255 wait complete. 2024-09-11T22:27:34.541 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:34 smithi022 ceph-mon[30966]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:27:34.541 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:34 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:27:34.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:34 smithi169 ceph-mon[35628]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:27:34.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:34 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:27:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:34 smithi045 ceph-mon[35556]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 116 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:27:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:34 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:27:34.919 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-11T22:27:34.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T22:27:35.185 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:35.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:27:35.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:35.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:35 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:27:35.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:35 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:35.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:35 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/790280255' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:27:35.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:35 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:27:35.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.695+0000 7f51e886c640 1 -- 172.21.15.22:0/3288048683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4108290 msgr2=0x7f51e410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.695+0000 7f51e886c640 1 --2- 172.21.15.22:0/3288048683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4108290 0x7f51e410ec30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009930 tx=0x7f51d402a420 comp rx=0 tx=0).stop 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 -- 172.21.15.22:0/3288048683 shutdown_connections 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 --2- 172.21.15.22:0/3288048683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4108290 0x7f51e410ec30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 --2- 172.21.15.22:0/3288048683 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4103740 0x7f51e4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 --2- 172.21.15.22:0/3288048683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4102d90 0x7f51e4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 -- 172.21.15.22:0/3288048683 >> 172.21.15.22:0/3288048683 conn(0x7f51e40fc7d0 msgr2=0x7f51e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 -- 172.21.15.22:0/3288048683 shutdown_connections 2024-09-11T22:27:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 -- 172.21.15.22:0/3288048683 wait complete. 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 Processor -- start 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.696+0000 7f51e886c640 1 -- start start 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4102d90 0x7f51e419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4108290 0x7f51e4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51e41122e0 con 0x7f51e4103740 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4112160 con 0x7f51e4108290 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e886c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4112460 con 0x7f51e4102d90 2024-09-11T22:27:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42912/0 (socket says 172.21.15.22:42912) 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 -- 172.21.15.22:0/1766587346 learned_addr learned my addr 172.21.15.22:0/1766587346 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e259c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4102d90 0x7f51e419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e2d9d640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4108290 0x7f51e4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 -- 172.21.15.22:0/1766587346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4102d90 msgr2=0x7f51e419e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4102d90 0x7f51e419e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 -- 172.21.15.22:0/1766587346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4108290 msgr2=0x7f51e4198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4108290 0x7f51e4198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 -- 172.21.15.22:0/1766587346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e4198d30 con 0x7f51e4103740 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.697+0000 7f51e1d9b640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00b450 tx=0x7f51cc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.698+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc015020 con 0x7f51e4103740 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.698+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51cc011d90 con 0x7f51e4103740 2024-09-11T22:27:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.698+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e4199020 con 0x7f51e4103740 2024-09-11T22:27:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.698+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00f340 con 0x7f51e4103740 2024-09-11T22:27:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.698+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e41a5310 con 0x7f51e4103740 2024-09-11T22:27:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.699+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e406a7f0 con 0x7f51e4103740 2024-09-11T22:27:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.700+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f51cc018020 con 0x7f51e4103740 2024-09-11T22:27:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.701+0000 7f51db7fe640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 0x7f51d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.701+0000 7f51e259c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 0x7f51d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.701+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f51cc0ce9f0 con 0x7f51e4103740 2024-09-11T22:27:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.701+0000 7f51e259c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 0x7f51d00a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00a400 tx=0x7f51dc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.705+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51cc01f020 con 0x7f51e4103740 2024-09-11T22:27:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.904+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f51e4062630 con 0x7f51d00a2b80 2024-09-11T22:27:35.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.923+0000 7f51db7fe640 1 -- 172.21.15.22:0/1766587346 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f51e4062630 con 0x7f51d00a2b80 2024-09-11T22:27:35.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.925+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 msgr2=0x7f51d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.925+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 0x7f51d00a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00a400 tx=0x7f51dc00d040 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 msgr2=0x7f51e419e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00b450 tx=0x7f51cc00b910 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 shutdown_connections 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e4108290 0x7f51e4198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51e4103740 0x7f51e419e980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f51d00a2b80 0x7f51d00a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 --2- 172.21.15.22:0/1766587346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51e4102d90 0x7f51e419e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 >> 172.21.15.22:0/1766587346 conn(0x7f51e40fc7d0 msgr2=0x7f51e40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 shutdown_connections 2024-09-11T22:27:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:35.926+0000 7f51e886c640 1 -- 172.21.15.22:0/1766587346 wait complete. 2024-09-11T22:27:36.227 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:36 smithi022 ceph-mon[30966]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T22:27:36.228 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:27:35.909+0000 7fd663bec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:27:36.228 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:27:35.909+0000 7fd663bec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:27:36.228 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:27:35.909+0000 7fd663bec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:27:36.228 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:27:35.909+0000 7fd663bec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:27:36.228 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:27:35 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:27:35.909+0000 7fd663bec640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:27:36.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T22:27:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:36 smithi169 ceph-mon[35628]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T22:27:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:36 smithi045 ceph-mon[35556]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 716 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T22:27:36.914 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:37.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:37 smithi022 ceph-mon[30966]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/3506681711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0102790 msgr2=0x7fd2b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/3506681711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0102790 0x7fd2b01067e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009900 tx=0x7fd2a402a410 comp rx=0 tx=0).stop 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/3506681711 shutdown_connections 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/3506681711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0106f10 0x7fd2b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/3506681711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0102790 0x7fd2b01067e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/3506681711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0101de0 0x7fd2b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/3506681711 >> 172.21.15.22:0/3506681711 conn(0x7fd2b00fd8c0 msgr2=0x7fd2b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/3506681711 shutdown_connections 2024-09-11T22:27:37.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.382+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/3506681711 wait complete. 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 Processor -- start 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 -- start start 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0102790 0x7fd2b01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0106f10 0x7fd2b019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0112090 con 0x7fd2b0101de0 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0111f10 con 0x7fd2b0102790 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2b4d6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0112210 con 0x7fd2b0106f10 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2ae59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2ae59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42950/0 (socket says 172.21.15.22:42950) 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2ae59c640 1 -- 172.21.15.22:0/399997437 learned_addr learned my addr 172.21.15.22:0/399997437 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2add9b640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0102790 0x7fd2b01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:37.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.383+0000 7fd2aed9d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0106f10 0x7fd2b019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 -- 172.21.15.22:0/399997437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0106f10 msgr2=0x7fd2b019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0106f10 0x7fd2b019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 -- 172.21.15.22:0/399997437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0102790 msgr2=0x7fd2b01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0102790 0x7fd2b01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 -- 172.21.15.22:0/399997437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b019d440 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2ae59c640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000d770 tx=0x7fd2a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0017070 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2a0005520 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b019d730 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0010460 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.384+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b01a5010 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.385+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b01021c0 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.386+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd2a0004ea0 con 0x7fd2b0101de0 2024-09-11T22:27:37.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.387+0000 7fd29f7fe640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 0x7fd2980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.387+0000 7fd2add9b640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 0x7fd2980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.387+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd2a00ceb90 con 0x7fd2b0101de0 2024-09-11T22:27:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.387+0000 7fd2add9b640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 0x7fd2980a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009230 tx=0x7fd2a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:37.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.391+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2a009ba40 con 0x7fd2b0101de0 2024-09-11T22:27:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.592+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd2b0062630 con 0x7fd2980a2c90 2024-09-11T22:27:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.617+0000 7fd29f7fe640 1 -- 172.21.15.22:0/399997437 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd2b0062630 con 0x7fd2980a2c90 2024-09-11T22:27:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 msgr2=0x7fd2980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 0x7fd2980a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009230 tx=0x7fd2a40058d0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 msgr2=0x7fd2b0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000d770 tx=0x7fd2a000dc30 comp rx=0 tx=0).stop 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 shutdown_connections 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2980a2c90 0x7fd2980a5150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2b0106f10 0x7fd2b019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2b0102790 0x7fd2b01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 --2- 172.21.15.22:0/399997437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2b0101de0 0x7fd2b0198490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 >> 172.21.15.22:0/399997437 conn(0x7fd2b00fd8c0 msgr2=0x7fd2b00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 shutdown_connections 2024-09-11T22:27:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:37.619+0000 7fd2b4d6d640 1 -- 172.21.15.22:0/399997437 wait complete. 2024-09-11T22:27:37.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:37 smithi169 ceph-mon[35628]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:37.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:37 smithi045 ceph-mon[35556]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:38.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T22:27:38.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:38 smithi022 ceph-mon[30966]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:27:38.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:38 smithi022 ceph-mon[30966]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T22:27:38.556 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:38 smithi169 ceph-mon[35628]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:27:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:38 smithi169 ceph-mon[35628]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T22:27:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:38 smithi045 ceph-mon[35556]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:27:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:38 smithi045 ceph-mon[35556]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T22:27:39.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.064+0000 7f6d34c0b640 1 -- 172.21.15.22:0/258291642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 msgr2=0x7f6d3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.064+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/258291642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3010da40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009ca0 tx=0x7f6d2802a950 comp rx=0 tx=0).stop 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 -- 172.21.15.22:0/258291642 shutdown_connections 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/258291642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3010da40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/258291642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 0x7f6d301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/258291642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 -- 172.21.15.22:0/258291642 >> 172.21.15.22:0/258291642 conn(0x7f6d300fc7d0 msgr2=0x7f6d300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 -- 172.21.15.22:0/258291642 shutdown_connections 2024-09-11T22:27:39.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 -- 172.21.15.22:0/258291642 wait complete. 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 Processor -- start 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.065+0000 7f6d34c0b640 1 -- start start 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 0x7f6d30198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6d301110a0 con 0x7f6d30102ef0 2024-09-11T22:27:39.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d30110f20 con 0x7f6d30100e20 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d34c0b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d30111220 con 0x7f6d30102570 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42964/0 (socket says 172.21.15.22:42964) 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 -- 172.21.15.22:0/3498291534 learned_addr learned my addr 172.21.15.22:0/3498291534 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2e59c640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d27fff640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 0x7f6d30198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 -- 172.21.15.22:0/3498291534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 msgr2=0x7f6d30198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 0x7f6d30198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 -- 172.21.15.22:0/3498291534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 msgr2=0x7f6d30198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 -- 172.21.15.22:0/3498291534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3019d4c0 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2e59c640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.066+0000 7f6d2ed9d640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005cc0 tx=0x7f6d2802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.067+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28034040 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.067+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3019d750 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.067+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d28030940 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.067+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d280456e0 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.067+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d301a5090 con 0x7f6d30102ef0 2024-09-11T22:27:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.068+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d301021b0 con 0x7f6d30102ef0 2024-09-11T22:27:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.069+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d28037020 con 0x7f6d30102ef0 2024-09-11T22:27:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.069+0000 7f6d277fe640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 0x7f6d1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.070+0000 7f6d2e59c640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 0x7f6d1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.070+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6d280efef0 con 0x7f6d30102ef0 2024-09-11T22:27:39.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.070+0000 7f6d2e59c640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 0x7f6d1c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000bfd0 tx=0x7f6d2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:39.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.073+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d280bcfb0 con 0x7f6d30102ef0 2024-09-11T22:27:39.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.275+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f6d3006a7c0 con 0x7f6d1c0a2c10 2024-09-11T22:27:39.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.280+0000 7f6d277fe640 1 -- 172.21.15.22:0/3498291534 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6d3006a7c0 con 0x7f6d1c0a2c10 2024-09-11T22:27:39.281 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_0/c47857f5-2609-453c-a537-4db1e202a2d3 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 msgr2=0x7f6d1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 0x7f6d1c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000bfd0 tx=0x7f6d2000b390 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 msgr2=0x7f6d3019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005cc0 tx=0x7f6d2802f790 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 shutdown_connections 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30102ef0 0x7f6d3019cde0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d1c0a2c10 0x7f6d1c0a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d30102570 0x7f6d30198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 --2- 172.21.15.22:0/3498291534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30100e20 0x7f6d30198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:39.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 >> 172.21.15.22:0/3498291534 conn(0x7f6d300fc7d0 msgr2=0x7f6d3006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:39.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 shutdown_connections 2024-09-11T22:27:39.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:39.282+0000 7f6d34c0b640 1 -- 172.21.15.22:0/3498291534 wait complete. 2024-09-11T22:27:39.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:39 smithi022 ceph-mon[30966]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:39.659 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:39 smithi169 ceph-mon[35628]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:39.666 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:39 smithi045 ceph-mon[35556]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:39.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T22:27:40.211 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:40.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:40 smithi022 ceph-mon[30966]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-11T22:27:40.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:40 smithi022 ceph-mon[30966]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:40.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:40 smithi169 ceph-mon[35628]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-11T22:27:40.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:40 smithi169 ceph-mon[35628]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:40 smithi045 ceph-mon[35556]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1023 B/s wr, 2 op/s 2024-09-11T22:27:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:40 smithi045 ceph-mon[35556]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 -- 172.21.15.22:0/320436367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 msgr2=0x7f0cbc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 --2- 172.21.15.22:0/320436367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc106e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009930 tx=0x7f0cb002a420 comp rx=0 tx=0).stop 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 -- 172.21.15.22:0/320436367 shutdown_connections 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 --2- 172.21.15.22:0/320436367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 --2- 172.21.15.22:0/320436367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 --2- 172.21.15.22:0/320436367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc106e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 -- 172.21.15.22:0/320436367 >> 172.21.15.22:0/320436367 conn(0x7f0cbc0fc7a0 msgr2=0x7f0cbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 -- 172.21.15.22:0/320436367 shutdown_connections 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.687+0000 7f0cc3173640 1 -- 172.21.15.22:0/320436367 wait complete. 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 Processor -- start 2024-09-11T22:27:40.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 -- start start 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc110fe0 con 0x7f0cbc106a80 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc110e60 con 0x7f0cbc100a80 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc3173640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc111160 con 0x7f0cbc101420 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc1710640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc1710640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42982/0 (socket says 172.21.15.22:42982) 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc1710640 1 -- 172.21.15.22:0/1753159626 learned_addr learned my addr 172.21.15.22:0/1753159626 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc0f0f640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cbbfff640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc1710640 1 -- 172.21.15.22:0/1753159626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 msgr2=0x7f0cbc197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:40.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.688+0000 7f0cc1710640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc1710640 1 -- 172.21.15.22:0/1753159626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 msgr2=0x7f0cbc1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc1710640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc1710640 1 -- 172.21.15.22:0/1753159626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc1a6a50 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc0f0f640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cbbfff640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc1710640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400b970 tx=0x7f0cb400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4019070 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0cb400cb40 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc1a6d40 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4007700 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.689+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc1a7280 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.690+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cbc100ee0 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.691+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0cb401c070 con 0x7f0cbc106a80 2024-09-11T22:27:40.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.692+0000 7f0cb9ffb640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 0x7f0cac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.692+0000 7f0cc0f0f640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 0x7f0cac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.692+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0cb40ce630 con 0x7f0cbc106a80 2024-09-11T22:27:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.692+0000 7f0cc0f0f640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 0x7f0cac0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:40.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.696+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cb409b5f0 con 0x7f0cbc106a80 2024-09-11T22:27:40.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.900+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0cbc0fe5b0 con 0x7f0cac0a2c10 2024-09-11T22:27:40.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.924+0000 7f0cb9ffb640 1 -- 172.21.15.22:0/1753159626 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0cbc0fe5b0 con 0x7f0cac0a2c10 2024-09-11T22:27:40.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.926+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 msgr2=0x7f0cac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:40.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.926+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 0x7f0cac0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb0005a20 comp rx=0 tx=0).stop 2024-09-11T22:27:40.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.926+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 msgr2=0x7f0cbc197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.926+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400b970 tx=0x7f0cb400be30 comp rx=0 tx=0).stop 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 shutdown_connections 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cbc106a80 0x7f0cbc197c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f0cac0a2c10 0x7f0cac0a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0cbc101420 0x7f0cbc197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 --2- 172.21.15.22:0/1753159626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cbc100a80 0x7f0cbc1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 >> 172.21.15.22:0/1753159626 conn(0x7f0cbc0fc7a0 msgr2=0x7f0cbc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 shutdown_connections 2024-09-11T22:27:40.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:40.927+0000 7f0cc3173640 1 -- 172.21.15.22:0/1753159626 wait complete. 2024-09-11T22:27:41.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T22:27:41.782 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- 172.21.15.22:0/2782151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 msgr2=0x7f2b7c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2782151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c10da40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009ca0 tx=0x7f2b7402a950 comp rx=0 tx=0).stop 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- 172.21.15.22:0/2782151786 shutdown_connections 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2782151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c10da40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2782151786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c102570 0x7f2b7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2782151786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c100e20 0x7f2b7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- 172.21.15.22:0/2782151786 >> 172.21.15.22:0/2782151786 conn(0x7f2b7c0fc7d0 msgr2=0x7f2b7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- 172.21.15.22:0/2782151786 shutdown_connections 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- 172.21.15.22:0/2782151786 wait complete. 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 Processor -- start 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.263+0000 7f2b82d04640 1 -- start start 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c100e20 0x7f2b7c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c102570 0x7f2b7c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c111130 con 0x7f2b7c102ef0 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c110fb0 con 0x7f2b7c102570 2024-09-11T22:27:42.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7c1112b0 con 0x7f2b7c100e20 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42992/0 (socket says 172.21.15.22:42992) 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 -- 172.21.15.22:0/2983286802 learned_addr learned my addr 172.21.15.22:0/2983286802 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b7bfff640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c102570 0x7f2b7c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b80aa0640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c100e20 0x7f2b7c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 -- 172.21.15.22:0/2983286802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c100e20 msgr2=0x7f2b7c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c100e20 0x7f2b7c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 -- 172.21.15.22:0/2983286802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c102570 msgr2=0x7f2b7c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c102570 0x7f2b7c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 -- 172.21.15.22:0/2983286802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7c19d5f0 con 0x7f2b7c102ef0 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b812a1640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098d0 tx=0x7f2b7402ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:42.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74034040 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7c19d880 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b74030940 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.264+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74045480 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.265+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7c1a51c0 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.265+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7c1021b0 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.267+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2b74037020 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.267+0000 7f2b79ffb640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 0x7f2b640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.267+0000 7f2b80aa0640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 0x7f2b640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.267+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2b740f0040 con 0x7f2b7c102ef0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.268+0000 7f2b80aa0640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 0x7f2b640a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0058c0 tx=0x7f2b6c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.271+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b740bd080 con 0x7f2b7c102ef0 2024-09-11T22:27:42.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.474+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2b7c062630 con 0x7f2b640a2c10 2024-09-11T22:27:42.476 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:42 smithi022 ceph-mon[30966]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:42.476 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:42 smithi022 ceph-mon[30966]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:42.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.479+0000 7f2b79ffb640 1 -- 172.21.15.22:0/2983286802 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2b7c062630 con 0x7f2b640a2c10 2024-09-11T22:27:42.480 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_1/a72c9781-b3e7-4bab-8e68-9383a1ea180f 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 msgr2=0x7f2b640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 0x7f2b640a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0058c0 tx=0x7f2b6c00a4c0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 msgr2=0x7f2b7c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b740098d0 tx=0x7f2b7402ff90 comp rx=0 tx=0).stop 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 shutdown_connections 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b7c102ef0 0x7f2b7c19cf10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b7c102570 0x7f2b7c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f2b640a2c10 0x7f2b640a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 --2- 172.21.15.22:0/2983286802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b7c100e20 0x7f2b7c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 >> 172.21.15.22:0/2983286802 conn(0x7f2b7c0fc7d0 msgr2=0x7f2b7c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 shutdown_connections 2024-09-11T22:27:42.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:42.481+0000 7f2b82d04640 1 -- 172.21.15.22:0/2983286802 wait complete. 2024-09-11T22:27:42.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:42 smithi169 ceph-mon[35628]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:42.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:42 smithi169 ceph-mon[35628]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:42 smithi045 ceph-mon[35556]: pgmap v287: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:42 smithi045 ceph-mon[35556]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:43.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:43.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:43 smithi022 ceph-mon[30966]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:43.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:43 smithi169 ceph-mon[35628]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:43.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:43 smithi045 ceph-mon[35556]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 -- 172.21.15.22:0/1133482008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c106f10 msgr2=0x7f6c3c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 --2- 172.21.15.22:0/1133482008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c106f10 0x7f6c3c10ea90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009ca0 tx=0x7f6c3402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 -- 172.21.15.22:0/1133482008 shutdown_connections 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 --2- 172.21.15.22:0/1133482008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c106f10 0x7f6c3c10ea90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 --2- 172.21.15.22:0/1133482008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c102790 0x7f6c3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 --2- 172.21.15.22:0/1133482008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 0x7f6c3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 -- 172.21.15.22:0/1133482008 >> 172.21.15.22:0/1133482008 conn(0x7f6c3c0fd8c0 msgr2=0x7f6c3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 -- 172.21.15.22:0/1133482008 shutdown_connections 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.099+0000 7f6c426bb640 1 -- 172.21.15.22:0/1133482008 wait complete. 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 Processor -- start 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 -- start start 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 0x7f6c3c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c106f10 0x7f6c3c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c112150 con 0x7f6c3c102790 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c111fd0 con 0x7f6c3c106f10 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c426bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1122d0 con 0x7f6c3c101de0 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c3b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c3b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51900/0 (socket says 172.21.15.22:51900) 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c3b7fe640 1 -- 172.21.15.22:0/3366988027 learned_addr learned my addr 172.21.15.22:0/3366988027 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c3bfff640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 0x7f6c3c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.100+0000 7f6c40c58640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c106f10 0x7f6c3c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 -- 172.21.15.22:0/3366988027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 msgr2=0x7f6c3c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 0x7f6c3c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 -- 172.21.15.22:0/3366988027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c106f10 msgr2=0x7f6c3c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c106f10 0x7f6c3c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 -- 172.21.15.22:0/3366988027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c1a6af0 con 0x7f6c3c102790 2024-09-11T22:27:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c3b7fe640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000b4a0 tx=0x7f6c3000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30015020 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c30011d30 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c1a6de0 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000f2e0 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.101+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c1a7290 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.102+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3c102240 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.103+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6c30018020 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.104+0000 7f6c397fa640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 0x7f6c240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.104+0000 7f6c3bfff640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 0x7f6c240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.104+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6c300ceb50 con 0x7f6c3c102790 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.104+0000 7f6c3bfff640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 0x7f6c240a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009990 tx=0x7f6c2c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:44.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.107+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c3001f020 con 0x7f6c3c102790 2024-09-11T22:27:44.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.320+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c3c075a20 con 0x7f6c3c102790 2024-09-11T22:27:44.321 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:44 smithi022 ceph-mon[30966]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:44.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.321+0000 7f6c397fa640 1 -- 172.21.15.22:0/3366988027 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f6c3c075a20 con 0x7f6c3c102790 2024-09-11T22:27:44.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:44.322 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:27:44.322 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 msgr2=0x7f6c240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 0x7f6c240a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009990 tx=0x7f6c2c009110 comp rx=0 tx=0).stop 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 msgr2=0x7f6c3c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000b4a0 tx=0x7f6c3000b8a0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 shutdown_connections 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c3c106f10 0x7f6c3c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c3c102790 0x7f6c3c074a30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6c240a2c10 0x7f6c240a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 --2- 172.21.15.22:0/3366988027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c3c101de0 0x7f6c3c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 >> 172.21.15.22:0/3366988027 conn(0x7f6c3c0fd8c0 msgr2=0x7f6c3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 shutdown_connections 2024-09-11T22:27:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:44.323+0000 7f6c426bb640 1 -- 172.21.15.22:0/3366988027 wait complete. 2024-09-11T22:27:44.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:44 smithi169 ceph-mon[35628]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:44.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:44 smithi045 ceph-mon[35556]: pgmap v288: 97 pgs: 97 active+clean; 604 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-11T22:27:44.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:45.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:45 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3366988027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:45.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:45 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3366988027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:45.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:45 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3366988027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- 172.21.15.22:0/1347577772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c0102d30 msgr2=0x7f58c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 --2- 172.21.15.22:0/1347577772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c0102d30 0x7f58c0103110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009930 tx=0x7f58b802a420 comp rx=0 tx=0).stop 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- 172.21.15.22:0/1347577772 shutdown_connections 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 --2- 172.21.15.22:0/1347577772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 --2- 172.21.15.22:0/1347577772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c01036e0 0x7f58c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 --2- 172.21.15.22:0/1347577772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c0102d30 0x7f58c0103110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- 172.21.15.22:0/1347577772 >> 172.21.15.22:0/1347577772 conn(0x7f58c00fc7d0 msgr2=0x7f58c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- 172.21.15.22:0/1347577772 shutdown_connections 2024-09-11T22:27:45.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- 172.21.15.22:0/1347577772 wait complete. 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 Processor -- start 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.698+0000 7f58c77f5640 1 -- start start 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 0x7f58c0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0112230 con 0x7f58c01036e0 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f58c01120b0 con 0x7f58c0102d30 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c77f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58c01123b0 con 0x7f58c01082a0 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51918/0 (socket says 172.21.15.22:51918) 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 -- 172.21.15.22:0/2270137998 learned_addr learned my addr 172.21.15.22:0/2270137998 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c5591640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 0x7f58c0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c5d92640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 -- 172.21.15.22:0/2270137998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 msgr2=0x7f58c0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 -- 172.21.15.22:0/2270137998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 msgr2=0x7f58c0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 0x7f58c0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 -- 172.21.15.22:0/2270137998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c01a6b90 con 0x7f58c01036e0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c5d92640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c5591640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 0x7f58c0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.699+0000 7f58c4d90640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c970 tx=0x7f58b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.700+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4007bb0 con 0x7f58c01036e0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.700+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58b4007d50 con 0x7f58c01036e0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.700+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c01a6e80 con 0x7f58c01036e0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.700+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400f450 con 0x7f58c01036e0 2024-09-11T22:27:45.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.700+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01a7330 con 0x7f58c01036e0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.701+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c006a850 con 0x7f58c01036e0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.702+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f58b4005000 con 0x7f58c01036e0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.702+0000 7f58be7fc640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 0x7f58a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.703+0000 7f58c5591640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 0x7f58a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.703+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f58b40ceeb0 con 0x7f58c01036e0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.703+0000 7f58c5591640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 0x7f58a80a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006010 tx=0x7f58b8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.707+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58b4014030 con 0x7f58c01036e0 2024-09-11T22:27:45.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.889+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c002d7c0 con 0x7f58c01036e0 2024-09-11T22:27:45.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.890+0000 7f58be7fc640 1 -- 172.21.15.22:0/2270137998 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22255 (secure 0 0 0) 0x7f58b409be60 con 0x7f58c01036e0 2024-09-11T22:27:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:45.891 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":80,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:27:24.459003+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:45.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 msgr2=0x7f58a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 0x7f58a80a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58b8006010 tx=0x7f58b8005a20 comp rx=0 tx=0).stop 2024-09-11T22:27:45.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 msgr2=0x7f58c0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c970 tx=0x7f58b400ce30 comp rx=0 tx=0).stop 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 shutdown_connections 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f58a80a2c10 0x7f58a80a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.892+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58c01082a0 0x7f58c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.893+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58c01036e0 0x7f58c0100ed0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.893+0000 7f58c77f5640 1 --2- 172.21.15.22:0/2270137998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58c0102d30 0x7f58c0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.893+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 >> 172.21.15.22:0/2270137998 conn(0x7f58c00fc7d0 msgr2=0x7f58c0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.893+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 shutdown_connections 2024-09-11T22:27:45.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:45.893+0000 7f58c77f5640 1 -- 172.21.15.22:0/2270137998 wait complete. 2024-09-11T22:27:46.563 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:46 smithi045 ceph-mon[35556]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-11T22:27:46.563 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:46 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2270137998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:46 smithi022 ceph-mon[30966]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-11T22:27:46.612 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:46 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2270137998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.643 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:27:46.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:27:46.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:46 smithi169 ceph-mon[35628]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-09-11T22:27:46.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:46 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2270137998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:47.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 -- 172.21.15.22:0/1343233280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 msgr2=0x7f7e981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:47.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 --2- 172.21.15.22:0/1343233280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e981029b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009900 tx=0x7f7e8c02a480 comp rx=0 tx=0).stop 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 -- 172.21.15.22:0/1343233280 shutdown_connections 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 --2- 172.21.15.22:0/1343233280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98102ef0 0x7f7e9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 --2- 172.21.15.22:0/1343233280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e981029b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 --2- 172.21.15.22:0/1343233280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98100e20 0x7f7e98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 -- 172.21.15.22:0/1343233280 >> 172.21.15.22:0/1343233280 conn(0x7f7e980fc7d0 msgr2=0x7f7e980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 -- 172.21.15.22:0/1343233280 shutdown_connections 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 -- 172.21.15.22:0/1343233280 wait complete. 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.372+0000 7f7e9f163640 1 Processor -- start 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 -- start start 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98100e20 0x7f7e980fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 0x7f7e980fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981110e0 con 0x7f7e98102570 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98110f60 con 0x7f7e98102ef0 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9f163640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98111260 con 0x7f7e98100e20 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51934/0 (socket says 172.21.15.22:51934) 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 -- 172.21.15.22:0/12525717 learned_addr learned my addr 172.21.15.22:0/12525717 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9ceff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98100e20 0x7f7e980fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9d700640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 0x7f7e980fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 -- 172.21.15.22:0/12525717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98100e20 msgr2=0x7f7e980fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98100e20 0x7f7e980fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 -- 172.21.15.22:0/12525717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 msgr2=0x7f7e980fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 0x7f7e980fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 -- 172.21.15.22:0/12525717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e981a6ad0 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e9d700640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 0x7f7e980fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.373+0000 7f7e97fff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c006010 tx=0x7f7e8c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.374+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c03f030 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.374+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7e8c005500 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.374+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e981a6d60 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.374+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c035070 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.374+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981a71e0 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.375+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e98101200 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.376+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7e8c042030 con 0x7f7e98102570 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.377+0000 7f7e95ffb640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 0x7f7e800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.377+0000 7f7e9ceff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 0x7f7e800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:47.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.377+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7e8c0ef650 con 0x7f7e98102570 2024-09-11T22:27:47.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.377+0000 7f7e9ceff640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 0x7f7e800a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800abe0 tx=0x7f7e8800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:47.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.381+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e8c0bc600 con 0x7f7e98102570 2024-09-11T22:27:47.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.552+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e9810a110 con 0x7f7e800a2c10 2024-09-11T22:27:47.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.559+0000 7f7e95ffb640 1 -- 172.21.15.22:0/12525717 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258631 (secure 0 0 0) 0x7f7e8800fc20 con 0x7f7e800a2c10 2024-09-11T22:27:47.563 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:47.565 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 msgr2=0x7f7e800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 0x7f7e800a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800abe0 tx=0x7f7e8800a2d0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 msgr2=0x7f7e980fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c006010 tx=0x7f7e8c004c00 comp rx=0 tx=0).stop 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 shutdown_connections 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e98102ef0 0x7f7e980fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98102570 0x7f7e980fd1c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f7e800a2c10 0x7f7e800a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 --2- 172.21.15.22:0/12525717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e98100e20 0x7f7e980fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:47.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 >> 172.21.15.22:0/12525717 conn(0x7f7e980fc7d0 msgr2=0x7f7e9806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:47.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 shutdown_connections 2024-09-11T22:27:47.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:47.562+0000 7f7e9f163640 1 -- 172.21.15.22:0/12525717 wait complete. 2024-09-11T22:27:48.251 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-11T22:27:46.615052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":174,"num_read_kb":180,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386296,"kb_used_data":12072,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555528,"statfs":{"total":1151940427776,"available":1151544860672,"internally_reserved":0,"allocated":12361728,"data_stored":6920475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":54,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801883+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:27:24.801883+0000","last_peered":"2024-09-11T22:27:24.801883+0000","last_clean":"2024-09-11T22:27:24.801883+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:27:24.801883+0000","last_undegraded":"2024-09-11T22:27:24.801883+0000","last_fullsized":"2024-09-11T22:27:24.801883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815697+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:27:24.815697+0000","last_peered":"2024-09-11T22:27:24.815697+0000","last_clean":"2024-09-11T22:27:24.815697+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:27:24.815697+0000","last_undegraded":"2024-09-11T22:27:24.815697+0000","last_fullsized":"2024-09-11T22:27:24.815697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815042+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:27:24.815042+0000","last_peered":"2024-09-11T22:27:24.815042+0000","last_clean":"2024-09-11T22:27:24.815042+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:27:24.815042+0000","last_undegraded":"2024-09-11T22:27:24.815042+0000","last_fullsized":"2024-09-11T22:27:24.815042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813145+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:27:24.813145+0000","last_peered":"2024-09-11T22:27:24.813145+0000","last_clean":"2024-09-11T22:27:24.813145+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:27:24.813145+0000","last_undegraded":"2024-09-11T22:27:24.813145+0000","last_fullsized":"2024-09-11T22:27:24.813145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812652+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:27:24.812652+0000","last_peered":"2024-09-11T22:27:24.812652+0000","last_clean":"2024-09-11T22:27:24.812652+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:27:24.812652+0000","last_undegraded":"2024-09-11T22:27:24.812652+0000","last_fullsized":"2024-09-11T22:27:24.812652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798604+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:27:24.798604+0000","last_peered":"2024-09-11T22:27:24.798604+0000","last_clean":"2024-09-11T22:27:24.798604+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:27:24.798604+0000","last_undegraded":"2024-09-11T22:27:24.798604+0000","last_fullsized":"2024-09-11T22:27:24.798604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814490+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:27:24.814490+0000","last_peered":"2024-09-11T22:27:24.814490+0000","last_clean":"2024-09-11T22:27:24.814490+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:27:24.814490+0000","last_undegraded":"2024-09-11T22:27:24.814490+0000","last_fullsized":"2024-09-11T22:27:24.814490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797808+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:27:24.797808+0000","last_peered":"2024-09-11T22:27:24.797808+0000","last_clean":"2024-09-11T22:27:24.797808+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:27:24.797808+0000","last_undegraded":"2024-09-11T22:27:24.797808+0000","last_fullsized":"2024-09-11T22:27:24.797808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813062+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:27:24.813062+0000","last_peered":"2024-09-11T22:27:24.813062+0000","last_clean":"2024-09-11T22:27:24.813062+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:27:24.813062+0000","last_undegraded":"2024-09-11T22:27:24.813062+0000","last_fullsized":"2024-09-11T22:27:24.813062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799180+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:27:24.799180+0000","last_peered":"2024-09-11T22:27:24.799180+0000","last_clean":"2024-09-11T22:27:24.799180+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:27:24.799180+0000","last_undegraded":"2024-09-11T22:27:24.799180+0000","last_fullsized":"2024-09-11T22:27:24.799180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814952+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:27:24.814952+0000","last_peered":"2024-09-11T22:27:24.814952+0000","last_clean":"2024-09-11T22:27:24.814952+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:27:24.814952+0000","last_undegraded":"2024-09-11T22:27:24.814952+0000","last_fullsized":"2024-09-11T22:27:24.814952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813304+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:27:24.813304+0000","last_peered":"2024-09-11T22:27:24.813304+0000","last_clean":"2024-09-11T22:27:24.813304+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:27:24.813304+0000","last_undegraded":"2024-09-11T22:27:24.813304+0000","last_fullsized":"2024-09-11T22:27:24.813304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813242+0000","last_change":"2024-09-11T22:27:23.809690+0000","last_active":"2024-09-11T22:27:24.813242+0000","last_peered":"2024-09-11T22:27:24.813242+0000","last_clean":"2024-09-11T22:27:24.813242+0000","last_became_active":"2024-09-11T22:27:23.808196+0000","last_became_peered":"2024-09-11T22:27:23.808196+0000","last_unstale":"2024-09-11T22:27:24.813242+0000","last_undegraded":"2024-09-11T22:27:24.813242+0000","last_fullsized":"2024-09-11T22:27:24.813242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:14.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815583+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:27:24.815583+0000","last_peered":"2024-09-11T22:27:24.815583+0000","last_clean":"2024-09-11T22:27:24.815583+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:27:24.815583+0000","last_undegraded":"2024-09-11T22:27:24.815583+0000","last_fullsized":"2024-09-11T22:27:24.815583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815206+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:27:24.815206+0000","last_peered":"2024-09-11T22:27:24.815206+0000","last_clean":"2024-09-11T22:27:24.815206+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:27:24.815206+0000","last_undegraded":"2024-09-11T22:27:24.815206+0000","last_fullsized":"2024-09-11T22:27:24.815206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812429+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:27:24.812429+0000","last_peered":"2024-09-11T22:27:24.812429+0000","last_clean":"2024-09-11T22:27:24.812429+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:27:24.812429+0000","last_undegraded":"2024-09-11T22:27:24.812429+0000","last_fullsized":"2024-09-11T22:27:24.812429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801938+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:27:24.801938+0000","last_peered":"2024-09-11T22:27:24.801938+0000","last_clean":"2024-09-11T22:27:24.801938+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:27:24.801938+0000","last_undegraded":"2024-09-11T22:27:24.801938+0000","last_fullsized":"2024-09-11T22:27:24.801938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.811962+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:27:24.811962+0000","last_peered":"2024-09-11T22:27:24.811962+0000","last_clean":"2024-09-11T22:27:24.811962+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:27:24.811962+0000","last_undegraded":"2024-09-11T22:27:24.811962+0000","last_fullsized":"2024-09-11T22:27:24.811962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814680+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:27:24.814680+0000","last_peered":"2024-09-11T22:27:24.814680+0000","last_clean":"2024-09-11T22:27:24.814680+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:27:24.814680+0000","last_undegraded":"2024-09-11T22:27:24.814680+0000","last_fullsized":"2024-09-11T22:27:24.814680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801631+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:27:24.801631+0000","last_peered":"2024-09-11T22:27:24.801631+0000","last_clean":"2024-09-11T22:27:24.801631+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:27:24.801631+0000","last_undegraded":"2024-09-11T22:27:24.801631+0000","last_fullsized":"2024-09-11T22:27:24.801631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813380+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:27:24.813380+0000","last_peered":"2024-09-11T22:27:24.813380+0000","last_clean":"2024-09-11T22:27:24.813380+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:27:24.813380+0000","last_undegraded":"2024-09-11T22:27:24.813380+0000","last_fullsized":"2024-09-11T22:27:24.813380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812658+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:27:24.812658+0000","last_peered":"2024-09-11T22:27:24.812658+0000","last_clean":"2024-09-11T22:27:24.812658+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:27:24.812658+0000","last_undegraded":"2024-09-11T22:27:24.812658+0000","last_fullsized":"2024-09-11T22:27:24.812658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797795+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:27:24.797795+0000","last_peered":"2024-09-11T22:27:24.797795+0000","last_clean":"2024-09-11T22:27:24.797795+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:27:24.797795+0000","last_undegraded":"2024-09-11T22:27:24.797795+0000","last_fullsized":"2024-09-11T22:27:24.797795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814583+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:27:24.814583+0000","last_peered":"2024-09-11T22:27:24.814583+0000","last_clean":"2024-09-11T22:27:24.814583+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:27:24.814583+0000","last_undegraded":"2024-09-11T22:27:24.814583+0000","last_fullsized":"2024-09-11T22:27:24.814583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798380+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:27:24.798380+0000","last_peered":"2024-09-11T22:27:24.798380+0000","last_clean":"2024-09-11T22:27:24.798380+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:27:24.798380+0000","last_undegraded":"2024-09-11T22:27:24.798380+0000","last_fullsized":"2024-09-11T22:27:24.798380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814791+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:27:24.814791+0000","last_peered":"2024-09-11T22:27:24.814791+0000","last_clean":"2024-09-11T22:27:24.814791+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:27:24.814791+0000","last_undegraded":"2024-09-11T22:27:24.814791+0000","last_fullsized":"2024-09-11T22:27:24.814791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801740+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:27:24.801740+0000","last_peered":"2024-09-11T22:27:24.801740+0000","last_clean":"2024-09-11T22:27:24.801740+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:27:24.801740+0000","last_undegraded":"2024-09-11T22:27:24.801740+0000","last_fullsized":"2024-09-11T22:27:24.801740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813892+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.813892+0000","last_peered":"2024-09-11T22:27:24.813892+0000","last_clean":"2024-09-11T22:27:24.813892+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:27:24.813892+0000","last_undegraded":"2024-09-11T22:27:24.813892+0000","last_fullsized":"2024-09-11T22:27:24.813892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815715+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:27:24.815715+0000","last_peered":"2024-09-11T22:27:24.815715+0000","last_clean":"2024-09-11T22:27:24.815715+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:27:24.815715+0000","last_undegraded":"2024-09-11T22:27:24.815715+0000","last_fullsized":"2024-09-11T22:27:24.815715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812989+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:27:24.812989+0000","last_peered":"2024-09-11T22:27:24.812989+0000","last_clean":"2024-09-11T22:27:24.812989+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:27:24.812989+0000","last_undegraded":"2024-09-11T22:27:24.812989+0000","last_fullsized":"2024-09-11T22:27:24.812989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812794+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:27:24.812794+0000","last_peered":"2024-09-11T22:27:24.812794+0000","last_clean":"2024-09-11T22:27:24.812794+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:27:24.812794+0000","last_undegraded":"2024-09-11T22:27:24.812794+0000","last_fullsized":"2024-09-11T22:27:24.812794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801704+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:27:24.801704+0000","last_peered":"2024-09-11T22:27:24.801704+0000","last_clean":"2024-09-11T22:27:24.801704+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:27:24.801704+0000","last_undegraded":"2024-09-11T22:27:24.801704+0000","last_fullsized":"2024-09-11T22:27:24.801704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812498+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:27:24.812498+0000","last_peered":"2024-09-11T22:27:24.812498+0000","last_clean":"2024-09-11T22:27:24.812498+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:27:24.812498+0000","last_undegraded":"2024-09-11T22:27:24.812498+0000","last_fullsized":"2024-09-11T22:27:24.812498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814805+0000","last_change":"2024-09-11T22:27:21.801880+0000","last_active":"2024-09-11T22:27:24.814805+0000","last_peered":"2024-09-11T22:27:24.814805+0000","last_clean":"2024-09-11T22:27:24.814805+0000","last_became_active":"2024-09-11T22:27:21.801516+0000","last_became_peered":"2024-09-11T22:27:21.801516+0000","last_unstale":"2024-09-11T22:27:24.814805+0000","last_undegraded":"2024-09-11T22:27:24.814805+0000","last_fullsized":"2024-09-11T22:27:24.814805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.512123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814588+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:27:24.814588+0000","last_peered":"2024-09-11T22:27:24.814588+0000","last_clean":"2024-09-11T22:27:24.814588+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:27:24.814588+0000","last_undegraded":"2024-09-11T22:27:24.814588+0000","last_fullsized":"2024-09-11T22:27:24.814588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799022+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:27:24.799022+0000","last_peered":"2024-09-11T22:27:24.799022+0000","last_clean":"2024-09-11T22:27:24.799022+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:27:24.799022+0000","last_undegraded":"2024-09-11T22:27:24.799022+0000","last_fullsized":"2024-09-11T22:27:24.799022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813970+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:27:24.813970+0000","last_peered":"2024-09-11T22:27:24.813970+0000","last_clean":"2024-09-11T22:27:24.813970+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:27:24.813970+0000","last_undegraded":"2024-09-11T22:27:24.813970+0000","last_fullsized":"2024-09-11T22:27:24.813970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797968+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:27:24.797968+0000","last_peered":"2024-09-11T22:27:24.797968+0000","last_clean":"2024-09-11T22:27:24.797968+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:27:24.797968+0000","last_undegraded":"2024-09-11T22:27:24.797968+0000","last_fullsized":"2024-09-11T22:27:24.797968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815026+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:27:24.815026+0000","last_peered":"2024-09-11T22:27:24.815026+0000","last_clean":"2024-09-11T22:27:24.815026+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:27:24.815026+0000","last_undegraded":"2024-09-11T22:27:24.815026+0000","last_fullsized":"2024-09-11T22:27:24.815026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812047+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.812047+0000","last_peered":"2024-09-11T22:27:24.812047+0000","last_clean":"2024-09-11T22:27:24.812047+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:27:24.812047+0000","last_undegraded":"2024-09-11T22:27:24.812047+0000","last_fullsized":"2024-09-11T22:27:24.812047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798965+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:27:24.798965+0000","last_peered":"2024-09-11T22:27:24.798965+0000","last_clean":"2024-09-11T22:27:24.798965+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:27:24.798965+0000","last_undegraded":"2024-09-11T22:27:24.798965+0000","last_fullsized":"2024-09-11T22:27:24.798965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813648+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:27:24.813648+0000","last_peered":"2024-09-11T22:27:24.813648+0000","last_clean":"2024-09-11T22:27:24.813648+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:27:24.813648+0000","last_undegraded":"2024-09-11T22:27:24.813648+0000","last_fullsized":"2024-09-11T22:27:24.813648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814756+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:27:24.814756+0000","last_peered":"2024-09-11T22:27:24.814756+0000","last_clean":"2024-09-11T22:27:24.814756+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:27:24.814756+0000","last_undegraded":"2024-09-11T22:27:24.814756+0000","last_fullsized":"2024-09-11T22:27:24.814756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815477+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:27:24.815477+0000","last_peered":"2024-09-11T22:27:24.815477+0000","last_clean":"2024-09-11T22:27:24.815477+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:27:24.815477+0000","last_undegraded":"2024-09-11T22:27:24.815477+0000","last_fullsized":"2024-09-11T22:27:24.815477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819448+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:27:24.819448+0000","last_peered":"2024-09-11T22:27:24.819448+0000","last_clean":"2024-09-11T22:27:24.819448+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:27:24.819448+0000","last_undegraded":"2024-09-11T22:27:24.819448+0000","last_fullsized":"2024-09-11T22:27:24.819448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812684+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:27:24.812684+0000","last_peered":"2024-09-11T22:27:24.812684+0000","last_clean":"2024-09-11T22:27:24.812684+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:27:24.812684+0000","last_undegraded":"2024-09-11T22:27:24.812684+0000","last_fullsized":"2024-09-11T22:27:24.812684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:44.082883+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:27:44.082883+0000","last_peered":"2024-09-11T22:27:44.082883+0000","last_clean":"2024-09-11T22:27:44.082883+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:27:44.082883+0000","last_undegraded":"2024-09-11T22:27:44.082883+0000","last_fullsized":"2024-09-11T22:27:44.082883+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":55,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813564+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:27:24.813564+0000","last_peered":"2024-09-11T22:27:24.813564+0000","last_clean":"2024-09-11T22:27:24.813564+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:27:24.813564+0000","last_undegraded":"2024-09-11T22:27:24.813564+0000","last_fullsized":"2024-09-11T22:27:24.813564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819927+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:27:24.819927+0000","last_peered":"2024-09-11T22:27:24.819927+0000","last_clean":"2024-09-11T22:27:24.819927+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:27:24.819927+0000","last_undegraded":"2024-09-11T22:27:24.819927+0000","last_fullsized":"2024-09-11T22:27:24.819927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813166+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:27:24.813166+0000","last_peered":"2024-09-11T22:27:24.813166+0000","last_clean":"2024-09-11T22:27:24.813166+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:27:24.813166+0000","last_undegraded":"2024-09-11T22:27:24.813166+0000","last_fullsized":"2024-09-11T22:27:24.813166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814871+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:27:24.814871+0000","last_peered":"2024-09-11T22:27:24.814871+0000","last_clean":"2024-09-11T22:27:24.814871+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:27:24.814871+0000","last_undegraded":"2024-09-11T22:27:24.814871+0000","last_fullsized":"2024-09-11T22:27:24.814871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814873+0000","last_change":"2024-09-11T22:27:23.821877+0000","last_active":"2024-09-11T22:27:24.814873+0000","last_peered":"2024-09-11T22:27:24.814873+0000","last_clean":"2024-09-11T22:27:24.814873+0000","last_became_active":"2024-09-11T22:27:23.821282+0000","last_became_peered":"2024-09-11T22:27:23.821282+0000","last_unstale":"2024-09-11T22:27:24.814873+0000","last_undegraded":"2024-09-11T22:27:24.814873+0000","last_fullsized":"2024-09-11T22:27:24.814873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.453027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812791+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:27:24.812791+0000","last_peered":"2024-09-11T22:27:24.812791+0000","last_clean":"2024-09-11T22:27:24.812791+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:27:24.812791+0000","last_undegraded":"2024-09-11T22:27:24.812791+0000","last_fullsized":"2024-09-11T22:27:24.812791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814443+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:27:24.814443+0000","last_peered":"2024-09-11T22:27:24.814443+0000","last_clean":"2024-09-11T22:27:24.814443+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:27:24.814443+0000","last_undegraded":"2024-09-11T22:27:24.814443+0000","last_fullsized":"2024-09-11T22:27:24.814443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820705+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:27:24.820705+0000","last_peered":"2024-09-11T22:27:24.820705+0000","last_clean":"2024-09-11T22:27:24.820705+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:27:24.820705+0000","last_undegraded":"2024-09-11T22:27:24.820705+0000","last_fullsized":"2024-09-11T22:27:24.820705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815253+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:27:24.815253+0000","last_peered":"2024-09-11T22:27:24.815253+0000","last_clean":"2024-09-11T22:27:24.815253+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:27:24.815253+0000","last_undegraded":"2024-09-11T22:27:24.815253+0000","last_fullsized":"2024-09-11T22:27:24.815253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868332+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:27:24.868332+0000","last_peered":"2024-09-11T22:27:24.868332+0000","last_clean":"2024-09-11T22:27:24.868332+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:27:24.868332+0000","last_undegraded":"2024-09-11T22:27:24.868332+0000","last_fullsized":"2024-09-11T22:27:24.868332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801823+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:27:24.801823+0000","last_peered":"2024-09-11T22:27:24.801823+0000","last_clean":"2024-09-11T22:27:24.801823+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:27:24.801823+0000","last_undegraded":"2024-09-11T22:27:24.801823+0000","last_fullsized":"2024-09-11T22:27:24.801823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819267+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:27:24.819267+0000","last_peered":"2024-09-11T22:27:24.819267+0000","last_clean":"2024-09-11T22:27:24.819267+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:27:24.819267+0000","last_undegraded":"2024-09-11T22:27:24.819267+0000","last_fullsized":"2024-09-11T22:27:24.819267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814958+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:27:24.814958+0000","last_peered":"2024-09-11T22:27:24.814958+0000","last_clean":"2024-09-11T22:27:24.814958+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:27:24.814958+0000","last_undegraded":"2024-09-11T22:27:24.814958+0000","last_fullsized":"2024-09-11T22:27:24.814958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819175+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:27:24.819175+0000","last_peered":"2024-09-11T22:27:24.819175+0000","last_clean":"2024-09-11T22:27:24.819175+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:27:24.819175+0000","last_undegraded":"2024-09-11T22:27:24.819175+0000","last_fullsized":"2024-09-11T22:27:24.819175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:25.683202+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:27:25.683202+0000","last_peered":"2024-09-11T22:27:25.683202+0000","last_clean":"2024-09-11T22:27:25.683202+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:27:25.683202+0000","last_undegraded":"2024-09-11T22:27:25.683202+0000","last_fullsized":"2024-09-11T22:27:25.683202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815132+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.815132+0000","last_peered":"2024-09-11T22:27:24.815132+0000","last_clean":"2024-09-11T22:27:24.815132+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:27:24.815132+0000","last_undegraded":"2024-09-11T22:27:24.815132+0000","last_fullsized":"2024-09-11T22:27:24.815132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815048+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:27:24.815048+0000","last_peered":"2024-09-11T22:27:24.815048+0000","last_clean":"2024-09-11T22:27:24.815048+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:27:24.815048+0000","last_undegraded":"2024-09-11T22:27:24.815048+0000","last_fullsized":"2024-09-11T22:27:24.815048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814543+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:27:24.814543+0000","last_peered":"2024-09-11T22:27:24.814543+0000","last_clean":"2024-09-11T22:27:24.814543+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:27:24.814543+0000","last_undegraded":"2024-09-11T22:27:24.814543+0000","last_fullsized":"2024-09-11T22:27:24.814543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813387+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:27:24.813387+0000","last_peered":"2024-09-11T22:27:24.813387+0000","last_clean":"2024-09-11T22:27:24.813387+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:27:24.813387+0000","last_undegraded":"2024-09-11T22:27:24.813387+0000","last_fullsized":"2024-09-11T22:27:24.813387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798081+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:27:24.798081+0000","last_peered":"2024-09-11T22:27:24.798081+0000","last_clean":"2024-09-11T22:27:24.798081+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:27:24.798081+0000","last_undegraded":"2024-09-11T22:27:24.798081+0000","last_fullsized":"2024-09-11T22:27:24.798081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814621+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:27:24.814621+0000","last_peered":"2024-09-11T22:27:24.814621+0000","last_clean":"2024-09-11T22:27:24.814621+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:27:24.814621+0000","last_undegraded":"2024-09-11T22:27:24.814621+0000","last_fullsized":"2024-09-11T22:27:24.814621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813647+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:27:24.813647+0000","last_peered":"2024-09-11T22:27:24.813647+0000","last_clean":"2024-09-11T22:27:24.813647+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:27:24.813647+0000","last_undegraded":"2024-09-11T22:27:24.813647+0000","last_fullsized":"2024-09-11T22:27:24.813647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814262+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:27:24.814262+0000","last_peered":"2024-09-11T22:27:24.814262+0000","last_clean":"2024-09-11T22:27:24.814262+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:27:24.814262+0000","last_undegraded":"2024-09-11T22:27:24.814262+0000","last_fullsized":"2024-09-11T22:27:24.814262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814753+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:27:24.814753+0000","last_peered":"2024-09-11T22:27:24.814753+0000","last_clean":"2024-09-11T22:27:24.814753+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:27:24.814753+0000","last_undegraded":"2024-09-11T22:27:24.814753+0000","last_fullsized":"2024-09-11T22:27:24.814753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815264+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:27:24.815264+0000","last_peered":"2024-09-11T22:27:24.815264+0000","last_clean":"2024-09-11T22:27:24.815264+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:27:24.815264+0000","last_undegraded":"2024-09-11T22:27:24.815264+0000","last_fullsized":"2024-09-11T22:27:24.815264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798812+0000","last_change":"2024-09-11T22:27:23.809950+0000","last_active":"2024-09-11T22:27:24.798812+0000","last_peered":"2024-09-11T22:27:24.798812+0000","last_clean":"2024-09-11T22:27:24.798812+0000","last_became_active":"2024-09-11T22:27:23.809603+0000","last_became_peered":"2024-09-11T22:27:23.809603+0000","last_unstale":"2024-09-11T22:27:24.798812+0000","last_undegraded":"2024-09-11T22:27:24.798812+0000","last_fullsized":"2024-09-11T22:27:24.798812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.114644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812041+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:27:24.812041+0000","last_peered":"2024-09-11T22:27:24.812041+0000","last_clean":"2024-09-11T22:27:24.812041+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:27:24.812041+0000","last_undegraded":"2024-09-11T22:27:24.812041+0000","last_fullsized":"2024-09-11T22:27:24.812041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799147+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:27:24.799147+0000","last_peered":"2024-09-11T22:27:24.799147+0000","last_clean":"2024-09-11T22:27:24.799147+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:27:24.799147+0000","last_undegraded":"2024-09-11T22:27:24.799147+0000","last_fullsized":"2024-09-11T22:27:24.799147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814326+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:27:24.814326+0000","last_peered":"2024-09-11T22:27:24.814326+0000","last_clean":"2024-09-11T22:27:24.814326+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:27:24.814326+0000","last_undegraded":"2024-09-11T22:27:24.814326+0000","last_fullsized":"2024-09-11T22:27:24.814326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814054+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:27:24.814054+0000","last_peered":"2024-09-11T22:27:24.814054+0000","last_clean":"2024-09-11T22:27:24.814054+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:27:24.814054+0000","last_undegraded":"2024-09-11T22:27:24.814054+0000","last_fullsized":"2024-09-11T22:27:24.814054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:44.814243+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:27:44.814243+0000","last_peered":"2024-09-11T22:27:44.814243+0000","last_clean":"2024-09-11T22:27:44.814243+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:27:44.814243+0000","last_undegraded":"2024-09-11T22:27:44.814243+0000","last_fullsized":"2024-09-11T22:27:44.814243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798405+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:27:24.798405+0000","last_peered":"2024-09-11T22:27:24.798405+0000","last_clean":"2024-09-11T22:27:24.798405+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:27:24.798405+0000","last_undegraded":"2024-09-11T22:27:24.798405+0000","last_fullsized":"2024-09-11T22:27:24.798405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818326+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.818326+0000","last_peered":"2024-09-11T22:27:24.818326+0000","last_clean":"2024-09-11T22:27:24.818326+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:27:24.818326+0000","last_undegraded":"2024-09-11T22:27:24.818326+0000","last_fullsized":"2024-09-11T22:27:24.818326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815857+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:27:24.815857+0000","last_peered":"2024-09-11T22:27:24.815857+0000","last_clean":"2024-09-11T22:27:24.815857+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:27:24.815857+0000","last_undegraded":"2024-09-11T22:27:24.815857+0000","last_fullsized":"2024-09-11T22:27:24.815857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812645+0000","last_change":"2024-09-11T22:27:21.998555+0000","last_active":"2024-09-11T22:27:24.812645+0000","last_peered":"2024-09-11T22:27:24.812645+0000","last_clean":"2024-09-11T22:27:24.812645+0000","last_became_active":"2024-09-11T22:27:21.998212+0000","last_became_peered":"2024-09-11T22:27:21.998212+0000","last_unstale":"2024-09-11T22:27:24.812645+0000","last_undegraded":"2024-09-11T22:27:24.812645+0000","last_fullsized":"2024-09-11T22:27:24.812645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812139+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:27:24.812139+0000","last_peered":"2024-09-11T22:27:24.812139+0000","last_clean":"2024-09-11T22:27:24.812139+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:27:24.812139+0000","last_undegraded":"2024-09-11T22:27:24.812139+0000","last_fullsized":"2024-09-11T22:27:24.812139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797996+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:27:24.797996+0000","last_peered":"2024-09-11T22:27:24.797996+0000","last_clean":"2024-09-11T22:27:24.797996+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:27:24.797996+0000","last_undegraded":"2024-09-11T22:27:24.797996+0000","last_fullsized":"2024-09-11T22:27:24.797996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801874+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:27:24.801874+0000","last_peered":"2024-09-11T22:27:24.801874+0000","last_clean":"2024-09-11T22:27:24.801874+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:27:24.801874+0000","last_undegraded":"2024-09-11T22:27:24.801874+0000","last_fullsized":"2024-09-11T22:27:24.801874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813107+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:27:24.813107+0000","last_peered":"2024-09-11T22:27:24.813107+0000","last_clean":"2024-09-11T22:27:24.813107+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:27:24.813107+0000","last_undegraded":"2024-09-11T22:27:24.813107+0000","last_fullsized":"2024-09-11T22:27:24.813107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797984+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:27:24.797984+0000","last_peered":"2024-09-11T22:27:24.797984+0000","last_clean":"2024-09-11T22:27:24.797984+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:27:24.797984+0000","last_undegraded":"2024-09-11T22:27:24.797984+0000","last_fullsized":"2024-09-11T22:27:24.797984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868295+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:27:24.868295+0000","last_peered":"2024-09-11T22:27:24.868295+0000","last_clean":"2024-09-11T22:27:24.868295+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:27:24.868295+0000","last_undegraded":"2024-09-11T22:27:24.868295+0000","last_fullsized":"2024-09-11T22:27:24.868295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815268+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:27:24.815268+0000","last_peered":"2024-09-11T22:27:24.815268+0000","last_clean":"2024-09-11T22:27:24.815268+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:27:24.815268+0000","last_undegraded":"2024-09-11T22:27:24.815268+0000","last_fullsized":"2024-09-11T22:27:24.815268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815698+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:27:24.815698+0000","last_peered":"2024-09-11T22:27:24.815698+0000","last_clean":"2024-09-11T22:27:24.815698+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:27:24.815698+0000","last_undegraded":"2024-09-11T22:27:24.815698+0000","last_fullsized":"2024-09-11T22:27:24.815698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818661+0000","last_change":"2024-09-11T22:27:21.801270+0000","last_active":"2024-09-11T22:27:24.818661+0000","last_peered":"2024-09-11T22:27:24.818661+0000","last_clean":"2024-09-11T22:27:24.818661+0000","last_became_active":"2024-09-11T22:27:21.800860+0000","last_became_peered":"2024-09-11T22:27:21.800860+0000","last_unstale":"2024-09-11T22:27:24.818661+0000","last_undegraded":"2024-09-11T22:27:24.818661+0000","last_fullsized":"2024-09-11T22:27:24.818661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:16.103906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812510+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:27:24.812510+0000","last_peered":"2024-09-11T22:27:24.812510+0000","last_clean":"2024-09-11T22:27:24.812510+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:27:24.812510+0000","last_undegraded":"2024-09-11T22:27:24.812510+0000","last_fullsized":"2024-09-11T22:27:24.812510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820276+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:27:24.820276+0000","last_peered":"2024-09-11T22:27:24.820276+0000","last_clean":"2024-09-11T22:27:24.820276+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:27:24.820276+0000","last_undegraded":"2024-09-11T22:27:24.820276+0000","last_fullsized":"2024-09-11T22:27:24.820276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815290+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:27:24.815290+0000","last_peered":"2024-09-11T22:27:24.815290+0000","last_clean":"2024-09-11T22:27:24.815290+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:27:24.815290+0000","last_undegraded":"2024-09-11T22:27:24.815290+0000","last_fullsized":"2024-09-11T22:27:24.815290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798473+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:27:24.798473+0000","last_peered":"2024-09-11T22:27:24.798473+0000","last_clean":"2024-09-11T22:27:24.798473+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:27:24.798473+0000","last_undegraded":"2024-09-11T22:27:24.798473+0000","last_fullsized":"2024-09-11T22:27:24.798473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798314+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:27:24.798314+0000","last_peered":"2024-09-11T22:27:24.798314+0000","last_clean":"2024-09-11T22:27:24.798314+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:27:24.798314+0000","last_undegraded":"2024-09-11T22:27:24.798314+0000","last_fullsized":"2024-09-11T22:27:24.798314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819062+0000","last_change":"2024-09-11T22:27:21.796897+0000","last_active":"2024-09-11T22:27:24.819062+0000","last_peered":"2024-09-11T22:27:24.819062+0000","last_clean":"2024-09-11T22:27:24.819062+0000","last_became_active":"2024-09-11T22:27:21.796540+0000","last_became_peered":"2024-09-11T22:27:21.796540+0000","last_unstale":"2024-09-11T22:27:24.819062+0000","last_undegraded":"2024-09-11T22:27:24.819062+0000","last_fullsized":"2024-09-11T22:27:24.819062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:43.650308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":61,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":860160,"data_stored":416573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36840,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708312,"statfs":{"total":95995035648,"available":95957311488,"internally_reserved":0,"allocated":1531904,"data_stored":1060419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":417155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":417177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1007640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1007240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":416595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":416911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":457672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":469740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":41099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:27:48.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:27:48.517 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:48.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:48 smithi022 ceph-mon[30966]: pgmap v290: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-11T22:27:48.639 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:48 smithi022 ceph-mon[30966]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:48 smithi169 ceph-mon[35628]: pgmap v290: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-11T22:27:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:48 smithi169 ceph-mon[35628]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:48 smithi045 ceph-mon[35556]: pgmap v290: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-11T22:27:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:48 smithi045 ceph-mon[35556]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 -- 172.21.15.22:0/3933858737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec103660 msgr2=0x7fc8ec10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/3933858737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec103660 0x7fc8ec10bb50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009900 tx=0x7fc8e002a480 comp rx=0 tx=0).stop 2024-09-11T22:27:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 -- 172.21.15.22:0/3933858737 shutdown_connections 2024-09-11T22:27:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/3933858737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec10c170 0x7fc8ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/3933858737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec103660 0x7fc8ec10bb50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/3933858737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec102d40 0x7fc8ec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 -- 172.21.15.22:0/3933858737 >> 172.21.15.22:0/3933858737 conn(0x7fc8ec0fc7a0 msgr2=0x7fc8ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 -- 172.21.15.22:0/3933858737 shutdown_connections 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.047+0000 7fc8f0bae640 1 -- 172.21.15.22:0/3933858737 wait complete. 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 Processor -- start 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 -- start start 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec103660 0x7fc8ec198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec10c170 0x7fc8ec19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec112170 con 0x7fc8ec102d40 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec111ff0 con 0x7fc8ec10c170 2024-09-11T22:27:49.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8f0bae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec1122f0 con 0x7fc8ec103660 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51958/0 (socket says 172.21.15.22:51958) 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8ea59c640 1 -- 172.21.15.22:0/2901135140 learned_addr learned my addr 172.21.15.22:0/2901135140 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8e9d9b640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec103660 0x7fc8ec198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8ea59c640 1 -- 172.21.15.22:0/2901135140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec103660 msgr2=0x7fc8ec198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.048+0000 7fc8ea59c640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec103660 0x7fc8ec198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8ea59c640 1 -- 172.21.15.22:0/2901135140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec10c170 msgr2=0x7fc8ec19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8ead9d640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec10c170 0x7fc8ec19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8ea59c640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec10c170 0x7fc8ec19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8ea59c640 1 -- 172.21.15.22:0/2901135140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec19d620 con 0x7fc8ec102d40 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8ea59c640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00b4a0 tx=0x7fc8dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc014070 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8dc010b10 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ec19d910 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc017d60 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.049+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ec1a51f0 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.050+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ec1031a0 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.051+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc8dc017070 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.052+0000 7fc8db7fe640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 0x7fc8d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.052+0000 7fc8e9d9b640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 0x7fc8d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.052+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc8dc0ce230 con 0x7fc8ec102d40 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.052+0000 7fc8e9d9b640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 0x7fc8d40a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009230 tx=0x7fc8e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.056+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8dc09b2f0 con 0x7fc8ec102d40 2024-09-11T22:27:49.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.228+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8ec062630 con 0x7fc8d40a2c90 2024-09-11T22:27:49.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.234+0000 7fc8db7fe640 1 -- 172.21.15.22:0/2901135140 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258631 (secure 0 0 0) 0x7fc8ec062630 con 0x7fc8d40a2c90 2024-09-11T22:27:49.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:49.238 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 msgr2=0x7fc8d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 0x7fc8d40a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009230 tx=0x7fc8e00058d0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 msgr2=0x7fc8ec198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00b4a0 tx=0x7fc8dc00b960 comp rx=0 tx=0).stop 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 shutdown_connections 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec10c170 0x7fc8ec19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc8d40a2c90 0x7fc8d40a5150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8ec103660 0x7fc8ec198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.237+0000 7fc8f0bae640 1 --2- 172.21.15.22:0/2901135140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8ec102d40 0x7fc8ec198670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.238+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 >> 172.21.15.22:0/2901135140 conn(0x7fc8ec0fc7a0 msgr2=0x7fc8ec0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:49.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.238+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 shutdown_connections 2024-09-11T22:27:49.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:49.238+0000 7fc8f0bae640 1 -- 172.21.15.22:0/2901135140 wait complete. 2024-09-11T22:27:49.918 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-11T22:27:48.615684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":174,"num_read_kb":180,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386308,"kb_used_data":12084,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555516,"statfs":{"total":1151940427776,"available":1151544848384,"internally_reserved":0,"allocated":12374016,"data_stored":6932577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":50,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801883+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:27:24.801883+0000","last_peered":"2024-09-11T22:27:24.801883+0000","last_clean":"2024-09-11T22:27:24.801883+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:27:24.801883+0000","last_undegraded":"2024-09-11T22:27:24.801883+0000","last_fullsized":"2024-09-11T22:27:24.801883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815697+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:27:24.815697+0000","last_peered":"2024-09-11T22:27:24.815697+0000","last_clean":"2024-09-11T22:27:24.815697+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:27:24.815697+0000","last_undegraded":"2024-09-11T22:27:24.815697+0000","last_fullsized":"2024-09-11T22:27:24.815697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815042+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:27:24.815042+0000","last_peered":"2024-09-11T22:27:24.815042+0000","last_clean":"2024-09-11T22:27:24.815042+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:27:24.815042+0000","last_undegraded":"2024-09-11T22:27:24.815042+0000","last_fullsized":"2024-09-11T22:27:24.815042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813145+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:27:24.813145+0000","last_peered":"2024-09-11T22:27:24.813145+0000","last_clean":"2024-09-11T22:27:24.813145+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:27:24.813145+0000","last_undegraded":"2024-09-11T22:27:24.813145+0000","last_fullsized":"2024-09-11T22:27:24.813145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812652+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:27:24.812652+0000","last_peered":"2024-09-11T22:27:24.812652+0000","last_clean":"2024-09-11T22:27:24.812652+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:27:24.812652+0000","last_undegraded":"2024-09-11T22:27:24.812652+0000","last_fullsized":"2024-09-11T22:27:24.812652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798604+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:27:24.798604+0000","last_peered":"2024-09-11T22:27:24.798604+0000","last_clean":"2024-09-11T22:27:24.798604+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:27:24.798604+0000","last_undegraded":"2024-09-11T22:27:24.798604+0000","last_fullsized":"2024-09-11T22:27:24.798604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814490+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:27:24.814490+0000","last_peered":"2024-09-11T22:27:24.814490+0000","last_clean":"2024-09-11T22:27:24.814490+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:27:24.814490+0000","last_undegraded":"2024-09-11T22:27:24.814490+0000","last_fullsized":"2024-09-11T22:27:24.814490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797808+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:27:24.797808+0000","last_peered":"2024-09-11T22:27:24.797808+0000","last_clean":"2024-09-11T22:27:24.797808+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:27:24.797808+0000","last_undegraded":"2024-09-11T22:27:24.797808+0000","last_fullsized":"2024-09-11T22:27:24.797808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813062+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:27:24.813062+0000","last_peered":"2024-09-11T22:27:24.813062+0000","last_clean":"2024-09-11T22:27:24.813062+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:27:24.813062+0000","last_undegraded":"2024-09-11T22:27:24.813062+0000","last_fullsized":"2024-09-11T22:27:24.813062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799180+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:27:24.799180+0000","last_peered":"2024-09-11T22:27:24.799180+0000","last_clean":"2024-09-11T22:27:24.799180+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:27:24.799180+0000","last_undegraded":"2024-09-11T22:27:24.799180+0000","last_fullsized":"2024-09-11T22:27:24.799180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814952+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:27:24.814952+0000","last_peered":"2024-09-11T22:27:24.814952+0000","last_clean":"2024-09-11T22:27:24.814952+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:27:24.814952+0000","last_undegraded":"2024-09-11T22:27:24.814952+0000","last_fullsized":"2024-09-11T22:27:24.814952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813304+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:27:24.813304+0000","last_peered":"2024-09-11T22:27:24.813304+0000","last_clean":"2024-09-11T22:27:24.813304+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:27:24.813304+0000","last_undegraded":"2024-09-11T22:27:24.813304+0000","last_fullsized":"2024-09-11T22:27:24.813304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813242+0000","last_change":"2024-09-11T22:27:23.809690+0000","last_active":"2024-09-11T22:27:24.813242+0000","last_peered":"2024-09-11T22:27:24.813242+0000","last_clean":"2024-09-11T22:27:24.813242+0000","last_became_active":"2024-09-11T22:27:23.808196+0000","last_became_peered":"2024-09-11T22:27:23.808196+0000","last_unstale":"2024-09-11T22:27:24.813242+0000","last_undegraded":"2024-09-11T22:27:24.813242+0000","last_fullsized":"2024-09-11T22:27:24.813242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:14.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815583+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:27:24.815583+0000","last_peered":"2024-09-11T22:27:24.815583+0000","last_clean":"2024-09-11T22:27:24.815583+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:27:24.815583+0000","last_undegraded":"2024-09-11T22:27:24.815583+0000","last_fullsized":"2024-09-11T22:27:24.815583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815206+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:27:24.815206+0000","last_peered":"2024-09-11T22:27:24.815206+0000","last_clean":"2024-09-11T22:27:24.815206+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:27:24.815206+0000","last_undegraded":"2024-09-11T22:27:24.815206+0000","last_fullsized":"2024-09-11T22:27:24.815206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812429+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:27:24.812429+0000","last_peered":"2024-09-11T22:27:24.812429+0000","last_clean":"2024-09-11T22:27:24.812429+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:27:24.812429+0000","last_undegraded":"2024-09-11T22:27:24.812429+0000","last_fullsized":"2024-09-11T22:27:24.812429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801938+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:27:24.801938+0000","last_peered":"2024-09-11T22:27:24.801938+0000","last_clean":"2024-09-11T22:27:24.801938+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:27:24.801938+0000","last_undegraded":"2024-09-11T22:27:24.801938+0000","last_fullsized":"2024-09-11T22:27:24.801938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.811962+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:27:24.811962+0000","last_peered":"2024-09-11T22:27:24.811962+0000","last_clean":"2024-09-11T22:27:24.811962+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:27:24.811962+0000","last_undegraded":"2024-09-11T22:27:24.811962+0000","last_fullsized":"2024-09-11T22:27:24.811962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814680+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:27:24.814680+0000","last_peered":"2024-09-11T22:27:24.814680+0000","last_clean":"2024-09-11T22:27:24.814680+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:27:24.814680+0000","last_undegraded":"2024-09-11T22:27:24.814680+0000","last_fullsized":"2024-09-11T22:27:24.814680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801631+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:27:24.801631+0000","last_peered":"2024-09-11T22:27:24.801631+0000","last_clean":"2024-09-11T22:27:24.801631+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:27:24.801631+0000","last_undegraded":"2024-09-11T22:27:24.801631+0000","last_fullsized":"2024-09-11T22:27:24.801631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813380+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:27:24.813380+0000","last_peered":"2024-09-11T22:27:24.813380+0000","last_clean":"2024-09-11T22:27:24.813380+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:27:24.813380+0000","last_undegraded":"2024-09-11T22:27:24.813380+0000","last_fullsized":"2024-09-11T22:27:24.813380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812658+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:27:24.812658+0000","last_peered":"2024-09-11T22:27:24.812658+0000","last_clean":"2024-09-11T22:27:24.812658+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:27:24.812658+0000","last_undegraded":"2024-09-11T22:27:24.812658+0000","last_fullsized":"2024-09-11T22:27:24.812658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797795+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:27:24.797795+0000","last_peered":"2024-09-11T22:27:24.797795+0000","last_clean":"2024-09-11T22:27:24.797795+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:27:24.797795+0000","last_undegraded":"2024-09-11T22:27:24.797795+0000","last_fullsized":"2024-09-11T22:27:24.797795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814583+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:27:24.814583+0000","last_peered":"2024-09-11T22:27:24.814583+0000","last_clean":"2024-09-11T22:27:24.814583+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:27:24.814583+0000","last_undegraded":"2024-09-11T22:27:24.814583+0000","last_fullsized":"2024-09-11T22:27:24.814583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798380+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:27:24.798380+0000","last_peered":"2024-09-11T22:27:24.798380+0000","last_clean":"2024-09-11T22:27:24.798380+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:27:24.798380+0000","last_undegraded":"2024-09-11T22:27:24.798380+0000","last_fullsized":"2024-09-11T22:27:24.798380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814791+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:27:24.814791+0000","last_peered":"2024-09-11T22:27:24.814791+0000","last_clean":"2024-09-11T22:27:24.814791+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:27:24.814791+0000","last_undegraded":"2024-09-11T22:27:24.814791+0000","last_fullsized":"2024-09-11T22:27:24.814791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801740+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:27:24.801740+0000","last_peered":"2024-09-11T22:27:24.801740+0000","last_clean":"2024-09-11T22:27:24.801740+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:27:24.801740+0000","last_undegraded":"2024-09-11T22:27:24.801740+0000","last_fullsized":"2024-09-11T22:27:24.801740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813892+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.813892+0000","last_peered":"2024-09-11T22:27:24.813892+0000","last_clean":"2024-09-11T22:27:24.813892+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:27:24.813892+0000","last_undegraded":"2024-09-11T22:27:24.813892+0000","last_fullsized":"2024-09-11T22:27:24.813892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815715+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:27:24.815715+0000","last_peered":"2024-09-11T22:27:24.815715+0000","last_clean":"2024-09-11T22:27:24.815715+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:27:24.815715+0000","last_undegraded":"2024-09-11T22:27:24.815715+0000","last_fullsized":"2024-09-11T22:27:24.815715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812989+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:27:24.812989+0000","last_peered":"2024-09-11T22:27:24.812989+0000","last_clean":"2024-09-11T22:27:24.812989+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:27:24.812989+0000","last_undegraded":"2024-09-11T22:27:24.812989+0000","last_fullsized":"2024-09-11T22:27:24.812989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812794+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:27:24.812794+0000","last_peered":"2024-09-11T22:27:24.812794+0000","last_clean":"2024-09-11T22:27:24.812794+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:27:24.812794+0000","last_undegraded":"2024-09-11T22:27:24.812794+0000","last_fullsized":"2024-09-11T22:27:24.812794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801704+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:27:24.801704+0000","last_peered":"2024-09-11T22:27:24.801704+0000","last_clean":"2024-09-11T22:27:24.801704+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:27:24.801704+0000","last_undegraded":"2024-09-11T22:27:24.801704+0000","last_fullsized":"2024-09-11T22:27:24.801704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812498+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:27:24.812498+0000","last_peered":"2024-09-11T22:27:24.812498+0000","last_clean":"2024-09-11T22:27:24.812498+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:27:24.812498+0000","last_undegraded":"2024-09-11T22:27:24.812498+0000","last_fullsized":"2024-09-11T22:27:24.812498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814805+0000","last_change":"2024-09-11T22:27:21.801880+0000","last_active":"2024-09-11T22:27:24.814805+0000","last_peered":"2024-09-11T22:27:24.814805+0000","last_clean":"2024-09-11T22:27:24.814805+0000","last_became_active":"2024-09-11T22:27:21.801516+0000","last_became_peered":"2024-09-11T22:27:21.801516+0000","last_unstale":"2024-09-11T22:27:24.814805+0000","last_undegraded":"2024-09-11T22:27:24.814805+0000","last_fullsized":"2024-09-11T22:27:24.814805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.512123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814588+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:27:24.814588+0000","last_peered":"2024-09-11T22:27:24.814588+0000","last_clean":"2024-09-11T22:27:24.814588+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:27:24.814588+0000","last_undegraded":"2024-09-11T22:27:24.814588+0000","last_fullsized":"2024-09-11T22:27:24.814588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799022+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:27:24.799022+0000","last_peered":"2024-09-11T22:27:24.799022+0000","last_clean":"2024-09-11T22:27:24.799022+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:27:24.799022+0000","last_undegraded":"2024-09-11T22:27:24.799022+0000","last_fullsized":"2024-09-11T22:27:24.799022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813970+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:27:24.813970+0000","last_peered":"2024-09-11T22:27:24.813970+0000","last_clean":"2024-09-11T22:27:24.813970+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:27:24.813970+0000","last_undegraded":"2024-09-11T22:27:24.813970+0000","last_fullsized":"2024-09-11T22:27:24.813970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797968+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:27:24.797968+0000","last_peered":"2024-09-11T22:27:24.797968+0000","last_clean":"2024-09-11T22:27:24.797968+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:27:24.797968+0000","last_undegraded":"2024-09-11T22:27:24.797968+0000","last_fullsized":"2024-09-11T22:27:24.797968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815026+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:27:24.815026+0000","last_peered":"2024-09-11T22:27:24.815026+0000","last_clean":"2024-09-11T22:27:24.815026+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:27:24.815026+0000","last_undegraded":"2024-09-11T22:27:24.815026+0000","last_fullsized":"2024-09-11T22:27:24.815026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812047+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.812047+0000","last_peered":"2024-09-11T22:27:24.812047+0000","last_clean":"2024-09-11T22:27:24.812047+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:27:24.812047+0000","last_undegraded":"2024-09-11T22:27:24.812047+0000","last_fullsized":"2024-09-11T22:27:24.812047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798965+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:27:24.798965+0000","last_peered":"2024-09-11T22:27:24.798965+0000","last_clean":"2024-09-11T22:27:24.798965+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:27:24.798965+0000","last_undegraded":"2024-09-11T22:27:24.798965+0000","last_fullsized":"2024-09-11T22:27:24.798965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813648+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:27:24.813648+0000","last_peered":"2024-09-11T22:27:24.813648+0000","last_clean":"2024-09-11T22:27:24.813648+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:27:24.813648+0000","last_undegraded":"2024-09-11T22:27:24.813648+0000","last_fullsized":"2024-09-11T22:27:24.813648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814756+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:27:24.814756+0000","last_peered":"2024-09-11T22:27:24.814756+0000","last_clean":"2024-09-11T22:27:24.814756+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:27:24.814756+0000","last_undegraded":"2024-09-11T22:27:24.814756+0000","last_fullsized":"2024-09-11T22:27:24.814756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815477+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:27:24.815477+0000","last_peered":"2024-09-11T22:27:24.815477+0000","last_clean":"2024-09-11T22:27:24.815477+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:27:24.815477+0000","last_undegraded":"2024-09-11T22:27:24.815477+0000","last_fullsized":"2024-09-11T22:27:24.815477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819448+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:27:24.819448+0000","last_peered":"2024-09-11T22:27:24.819448+0000","last_clean":"2024-09-11T22:27:24.819448+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:27:24.819448+0000","last_undegraded":"2024-09-11T22:27:24.819448+0000","last_fullsized":"2024-09-11T22:27:24.819448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812684+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:27:24.812684+0000","last_peered":"2024-09-11T22:27:24.812684+0000","last_clean":"2024-09-11T22:27:24.812684+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:27:24.812684+0000","last_undegraded":"2024-09-11T22:27:24.812684+0000","last_fullsized":"2024-09-11T22:27:24.812684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:44.082883+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:27:44.082883+0000","last_peered":"2024-09-11T22:27:44.082883+0000","last_clean":"2024-09-11T22:27:44.082883+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:27:44.082883+0000","last_undegraded":"2024-09-11T22:27:44.082883+0000","last_fullsized":"2024-09-11T22:27:44.082883+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":55,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813564+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:27:24.813564+0000","last_peered":"2024-09-11T22:27:24.813564+0000","last_clean":"2024-09-11T22:27:24.813564+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:27:24.813564+0000","last_undegraded":"2024-09-11T22:27:24.813564+0000","last_fullsized":"2024-09-11T22:27:24.813564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819927+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:27:24.819927+0000","last_peered":"2024-09-11T22:27:24.819927+0000","last_clean":"2024-09-11T22:27:24.819927+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:27:24.819927+0000","last_undegraded":"2024-09-11T22:27:24.819927+0000","last_fullsized":"2024-09-11T22:27:24.819927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813166+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:27:24.813166+0000","last_peered":"2024-09-11T22:27:24.813166+0000","last_clean":"2024-09-11T22:27:24.813166+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:27:24.813166+0000","last_undegraded":"2024-09-11T22:27:24.813166+0000","last_fullsized":"2024-09-11T22:27:24.813166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814871+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:27:24.814871+0000","last_peered":"2024-09-11T22:27:24.814871+0000","last_clean":"2024-09-11T22:27:24.814871+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:27:24.814871+0000","last_undegraded":"2024-09-11T22:27:24.814871+0000","last_fullsized":"2024-09-11T22:27:24.814871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814873+0000","last_change":"2024-09-11T22:27:23.821877+0000","last_active":"2024-09-11T22:27:24.814873+0000","last_peered":"2024-09-11T22:27:24.814873+0000","last_clean":"2024-09-11T22:27:24.814873+0000","last_became_active":"2024-09-11T22:27:23.821282+0000","last_became_peered":"2024-09-11T22:27:23.821282+0000","last_unstale":"2024-09-11T22:27:24.814873+0000","last_undegraded":"2024-09-11T22:27:24.814873+0000","last_fullsized":"2024-09-11T22:27:24.814873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.453027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812791+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:27:24.812791+0000","last_peered":"2024-09-11T22:27:24.812791+0000","last_clean":"2024-09-11T22:27:24.812791+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:27:24.812791+0000","last_undegraded":"2024-09-11T22:27:24.812791+0000","last_fullsized":"2024-09-11T22:27:24.812791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814443+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:27:24.814443+0000","last_peered":"2024-09-11T22:27:24.814443+0000","last_clean":"2024-09-11T22:27:24.814443+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:27:24.814443+0000","last_undegraded":"2024-09-11T22:27:24.814443+0000","last_fullsized":"2024-09-11T22:27:24.814443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820705+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:27:24.820705+0000","last_peered":"2024-09-11T22:27:24.820705+0000","last_clean":"2024-09-11T22:27:24.820705+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:27:24.820705+0000","last_undegraded":"2024-09-11T22:27:24.820705+0000","last_fullsized":"2024-09-11T22:27:24.820705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815253+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:27:24.815253+0000","last_peered":"2024-09-11T22:27:24.815253+0000","last_clean":"2024-09-11T22:27:24.815253+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:27:24.815253+0000","last_undegraded":"2024-09-11T22:27:24.815253+0000","last_fullsized":"2024-09-11T22:27:24.815253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868332+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:27:24.868332+0000","last_peered":"2024-09-11T22:27:24.868332+0000","last_clean":"2024-09-11T22:27:24.868332+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:27:24.868332+0000","last_undegraded":"2024-09-11T22:27:24.868332+0000","last_fullsized":"2024-09-11T22:27:24.868332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801823+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:27:24.801823+0000","last_peered":"2024-09-11T22:27:24.801823+0000","last_clean":"2024-09-11T22:27:24.801823+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:27:24.801823+0000","last_undegraded":"2024-09-11T22:27:24.801823+0000","last_fullsized":"2024-09-11T22:27:24.801823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819267+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:27:24.819267+0000","last_peered":"2024-09-11T22:27:24.819267+0000","last_clean":"2024-09-11T22:27:24.819267+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:27:24.819267+0000","last_undegraded":"2024-09-11T22:27:24.819267+0000","last_fullsized":"2024-09-11T22:27:24.819267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814958+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:27:24.814958+0000","last_peered":"2024-09-11T22:27:24.814958+0000","last_clean":"2024-09-11T22:27:24.814958+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:27:24.814958+0000","last_undegraded":"2024-09-11T22:27:24.814958+0000","last_fullsized":"2024-09-11T22:27:24.814958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819175+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:27:24.819175+0000","last_peered":"2024-09-11T22:27:24.819175+0000","last_clean":"2024-09-11T22:27:24.819175+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:27:24.819175+0000","last_undegraded":"2024-09-11T22:27:24.819175+0000","last_fullsized":"2024-09-11T22:27:24.819175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:25.683202+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:27:25.683202+0000","last_peered":"2024-09-11T22:27:25.683202+0000","last_clean":"2024-09-11T22:27:25.683202+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:27:25.683202+0000","last_undegraded":"2024-09-11T22:27:25.683202+0000","last_fullsized":"2024-09-11T22:27:25.683202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815132+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.815132+0000","last_peered":"2024-09-11T22:27:24.815132+0000","last_clean":"2024-09-11T22:27:24.815132+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:27:24.815132+0000","last_undegraded":"2024-09-11T22:27:24.815132+0000","last_fullsized":"2024-09-11T22:27:24.815132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815048+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:27:24.815048+0000","last_peered":"2024-09-11T22:27:24.815048+0000","last_clean":"2024-09-11T22:27:24.815048+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:27:24.815048+0000","last_undegraded":"2024-09-11T22:27:24.815048+0000","last_fullsized":"2024-09-11T22:27:24.815048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814543+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:27:24.814543+0000","last_peered":"2024-09-11T22:27:24.814543+0000","last_clean":"2024-09-11T22:27:24.814543+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:27:24.814543+0000","last_undegraded":"2024-09-11T22:27:24.814543+0000","last_fullsized":"2024-09-11T22:27:24.814543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813387+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:27:24.813387+0000","last_peered":"2024-09-11T22:27:24.813387+0000","last_clean":"2024-09-11T22:27:24.813387+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:27:24.813387+0000","last_undegraded":"2024-09-11T22:27:24.813387+0000","last_fullsized":"2024-09-11T22:27:24.813387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798081+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:27:24.798081+0000","last_peered":"2024-09-11T22:27:24.798081+0000","last_clean":"2024-09-11T22:27:24.798081+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:27:24.798081+0000","last_undegraded":"2024-09-11T22:27:24.798081+0000","last_fullsized":"2024-09-11T22:27:24.798081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814621+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:27:24.814621+0000","last_peered":"2024-09-11T22:27:24.814621+0000","last_clean":"2024-09-11T22:27:24.814621+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:27:24.814621+0000","last_undegraded":"2024-09-11T22:27:24.814621+0000","last_fullsized":"2024-09-11T22:27:24.814621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813647+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:27:24.813647+0000","last_peered":"2024-09-11T22:27:24.813647+0000","last_clean":"2024-09-11T22:27:24.813647+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:27:24.813647+0000","last_undegraded":"2024-09-11T22:27:24.813647+0000","last_fullsized":"2024-09-11T22:27:24.813647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814262+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:27:24.814262+0000","last_peered":"2024-09-11T22:27:24.814262+0000","last_clean":"2024-09-11T22:27:24.814262+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:27:24.814262+0000","last_undegraded":"2024-09-11T22:27:24.814262+0000","last_fullsized":"2024-09-11T22:27:24.814262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814753+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:27:24.814753+0000","last_peered":"2024-09-11T22:27:24.814753+0000","last_clean":"2024-09-11T22:27:24.814753+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:27:24.814753+0000","last_undegraded":"2024-09-11T22:27:24.814753+0000","last_fullsized":"2024-09-11T22:27:24.814753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815264+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:27:24.815264+0000","last_peered":"2024-09-11T22:27:24.815264+0000","last_clean":"2024-09-11T22:27:24.815264+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:27:24.815264+0000","last_undegraded":"2024-09-11T22:27:24.815264+0000","last_fullsized":"2024-09-11T22:27:24.815264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798812+0000","last_change":"2024-09-11T22:27:23.809950+0000","last_active":"2024-09-11T22:27:24.798812+0000","last_peered":"2024-09-11T22:27:24.798812+0000","last_clean":"2024-09-11T22:27:24.798812+0000","last_became_active":"2024-09-11T22:27:23.809603+0000","last_became_peered":"2024-09-11T22:27:23.809603+0000","last_unstale":"2024-09-11T22:27:24.798812+0000","last_undegraded":"2024-09-11T22:27:24.798812+0000","last_fullsized":"2024-09-11T22:27:24.798812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.114644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812041+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:27:24.812041+0000","last_peered":"2024-09-11T22:27:24.812041+0000","last_clean":"2024-09-11T22:27:24.812041+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:27:24.812041+0000","last_undegraded":"2024-09-11T22:27:24.812041+0000","last_fullsized":"2024-09-11T22:27:24.812041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799147+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:27:24.799147+0000","last_peered":"2024-09-11T22:27:24.799147+0000","last_clean":"2024-09-11T22:27:24.799147+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:27:24.799147+0000","last_undegraded":"2024-09-11T22:27:24.799147+0000","last_fullsized":"2024-09-11T22:27:24.799147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814326+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:27:24.814326+0000","last_peered":"2024-09-11T22:27:24.814326+0000","last_clean":"2024-09-11T22:27:24.814326+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:27:24.814326+0000","last_undegraded":"2024-09-11T22:27:24.814326+0000","last_fullsized":"2024-09-11T22:27:24.814326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814054+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:27:24.814054+0000","last_peered":"2024-09-11T22:27:24.814054+0000","last_clean":"2024-09-11T22:27:24.814054+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:27:24.814054+0000","last_undegraded":"2024-09-11T22:27:24.814054+0000","last_fullsized":"2024-09-11T22:27:24.814054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:44.814243+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:27:44.814243+0000","last_peered":"2024-09-11T22:27:44.814243+0000","last_clean":"2024-09-11T22:27:44.814243+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:27:44.814243+0000","last_undegraded":"2024-09-11T22:27:44.814243+0000","last_fullsized":"2024-09-11T22:27:44.814243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798405+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:27:24.798405+0000","last_peered":"2024-09-11T22:27:24.798405+0000","last_clean":"2024-09-11T22:27:24.798405+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:27:24.798405+0000","last_undegraded":"2024-09-11T22:27:24.798405+0000","last_fullsized":"2024-09-11T22:27:24.798405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818326+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.818326+0000","last_peered":"2024-09-11T22:27:24.818326+0000","last_clean":"2024-09-11T22:27:24.818326+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:27:24.818326+0000","last_undegraded":"2024-09-11T22:27:24.818326+0000","last_fullsized":"2024-09-11T22:27:24.818326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815857+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:27:24.815857+0000","last_peered":"2024-09-11T22:27:24.815857+0000","last_clean":"2024-09-11T22:27:24.815857+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:27:24.815857+0000","last_undegraded":"2024-09-11T22:27:24.815857+0000","last_fullsized":"2024-09-11T22:27:24.815857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812645+0000","last_change":"2024-09-11T22:27:21.998555+0000","last_active":"2024-09-11T22:27:24.812645+0000","last_peered":"2024-09-11T22:27:24.812645+0000","last_clean":"2024-09-11T22:27:24.812645+0000","last_became_active":"2024-09-11T22:27:21.998212+0000","last_became_peered":"2024-09-11T22:27:21.998212+0000","last_unstale":"2024-09-11T22:27:24.812645+0000","last_undegraded":"2024-09-11T22:27:24.812645+0000","last_fullsized":"2024-09-11T22:27:24.812645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812139+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:27:24.812139+0000","last_peered":"2024-09-11T22:27:24.812139+0000","last_clean":"2024-09-11T22:27:24.812139+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:27:24.812139+0000","last_undegraded":"2024-09-11T22:27:24.812139+0000","last_fullsized":"2024-09-11T22:27:24.812139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797996+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:27:24.797996+0000","last_peered":"2024-09-11T22:27:24.797996+0000","last_clean":"2024-09-11T22:27:24.797996+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:27:24.797996+0000","last_undegraded":"2024-09-11T22:27:24.797996+0000","last_fullsized":"2024-09-11T22:27:24.797996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801874+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:27:24.801874+0000","last_peered":"2024-09-11T22:27:24.801874+0000","last_clean":"2024-09-11T22:27:24.801874+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:27:24.801874+0000","last_undegraded":"2024-09-11T22:27:24.801874+0000","last_fullsized":"2024-09-11T22:27:24.801874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813107+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:27:24.813107+0000","last_peered":"2024-09-11T22:27:24.813107+0000","last_clean":"2024-09-11T22:27:24.813107+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:27:24.813107+0000","last_undegraded":"2024-09-11T22:27:24.813107+0000","last_fullsized":"2024-09-11T22:27:24.813107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797984+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:27:24.797984+0000","last_peered":"2024-09-11T22:27:24.797984+0000","last_clean":"2024-09-11T22:27:24.797984+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:27:24.797984+0000","last_undegraded":"2024-09-11T22:27:24.797984+0000","last_fullsized":"2024-09-11T22:27:24.797984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868295+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:27:24.868295+0000","last_peered":"2024-09-11T22:27:24.868295+0000","last_clean":"2024-09-11T22:27:24.868295+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:27:24.868295+0000","last_undegraded":"2024-09-11T22:27:24.868295+0000","last_fullsized":"2024-09-11T22:27:24.868295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815268+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:27:24.815268+0000","last_peered":"2024-09-11T22:27:24.815268+0000","last_clean":"2024-09-11T22:27:24.815268+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:27:24.815268+0000","last_undegraded":"2024-09-11T22:27:24.815268+0000","last_fullsized":"2024-09-11T22:27:24.815268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815698+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:27:24.815698+0000","last_peered":"2024-09-11T22:27:24.815698+0000","last_clean":"2024-09-11T22:27:24.815698+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:27:24.815698+0000","last_undegraded":"2024-09-11T22:27:24.815698+0000","last_fullsized":"2024-09-11T22:27:24.815698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818661+0000","last_change":"2024-09-11T22:27:21.801270+0000","last_active":"2024-09-11T22:27:24.818661+0000","last_peered":"2024-09-11T22:27:24.818661+0000","last_clean":"2024-09-11T22:27:24.818661+0000","last_became_active":"2024-09-11T22:27:21.800860+0000","last_became_peered":"2024-09-11T22:27:21.800860+0000","last_unstale":"2024-09-11T22:27:24.818661+0000","last_undegraded":"2024-09-11T22:27:24.818661+0000","last_fullsized":"2024-09-11T22:27:24.818661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:16.103906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812510+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:27:24.812510+0000","last_peered":"2024-09-11T22:27:24.812510+0000","last_clean":"2024-09-11T22:27:24.812510+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:27:24.812510+0000","last_undegraded":"2024-09-11T22:27:24.812510+0000","last_fullsized":"2024-09-11T22:27:24.812510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820276+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:27:24.820276+0000","last_peered":"2024-09-11T22:27:24.820276+0000","last_clean":"2024-09-11T22:27:24.820276+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:27:24.820276+0000","last_undegraded":"2024-09-11T22:27:24.820276+0000","last_fullsized":"2024-09-11T22:27:24.820276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815290+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:27:24.815290+0000","last_peered":"2024-09-11T22:27:24.815290+0000","last_clean":"2024-09-11T22:27:24.815290+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:27:24.815290+0000","last_undegraded":"2024-09-11T22:27:24.815290+0000","last_fullsized":"2024-09-11T22:27:24.815290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798473+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:27:24.798473+0000","last_peered":"2024-09-11T22:27:24.798473+0000","last_clean":"2024-09-11T22:27:24.798473+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:27:24.798473+0000","last_undegraded":"2024-09-11T22:27:24.798473+0000","last_fullsized":"2024-09-11T22:27:24.798473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798314+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:27:24.798314+0000","last_peered":"2024-09-11T22:27:24.798314+0000","last_clean":"2024-09-11T22:27:24.798314+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:27:24.798314+0000","last_undegraded":"2024-09-11T22:27:24.798314+0000","last_fullsized":"2024-09-11T22:27:24.798314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819062+0000","last_change":"2024-09-11T22:27:21.796897+0000","last_active":"2024-09-11T22:27:24.819062+0000","last_peered":"2024-09-11T22:27:24.819062+0000","last_clean":"2024-09-11T22:27:24.819062+0000","last_became_active":"2024-09-11T22:27:21.796540+0000","last_became_peered":"2024-09-11T22:27:21.796540+0000","last_unstale":"2024-09-11T22:27:24.819062+0000","last_undegraded":"2024-09-11T22:27:24.819062+0000","last_fullsized":"2024-09-11T22:27:24.819062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:43.650308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":61,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":860160,"data_stored":416573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36840,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708312,"statfs":{"total":95995035648,"available":95957311488,"internally_reserved":0,"allocated":1531904,"data_stored":1060419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":417155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":417177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1007640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1007240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":416595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":416911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":469774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":469740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:27:49.923 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:27:49.923 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T22:27:49.924 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T22:27:50.185 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:50.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:50 smithi022 ceph-mon[30966]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.3 KiB/s wr, 4 op/s 2024-09-11T22:27:50.547 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:50 smithi022 ceph-mon[30966]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:50.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 -- 172.21.15.22:0/3260455629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d81026d0 msgr2=0x7f14d8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3260455629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d81026d0 0x7f14d8108f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009ca0 tx=0x7f14d002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 -- 172.21.15.22:0/3260455629 shutdown_connections 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3260455629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d81026d0 0x7f14d8108f60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3260455629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 0x7f14d8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3260455629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d8100b10 0x7f14d8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 -- 172.21.15.22:0/3260455629 >> 172.21.15.22:0/3260455629 conn(0x7f14d80fc2a0 msgr2=0x7f14d80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 -- 172.21.15.22:0/3260455629 shutdown_connections 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 -- 172.21.15.22:0/3260455629 wait complete. 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.638+0000 7f14dcb38640 1 Processor -- start 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 -- start start 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 0x7f14d81030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 0x7f14d8103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810ca20 con 0x7f14d8100b10 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810c8a0 con 0x7f14d81026d0 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14dcb38640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14d810cba0 con 0x7f14d8101d10 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51976/0 (socket says 172.21.15.22:51976) 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 -- 172.21.15.22:0/3739834570 learned_addr learned my addr 172.21.15.22:0/3739834570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14cffff640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 0x7f14d81030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d6d9d640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 0x7f14d8103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 -- 172.21.15.22:0/3739834570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 msgr2=0x7f14d81030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 0x7f14d81030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 -- 172.21.15.22:0/3739834570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 msgr2=0x7f14d8103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 0x7f14d8103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 -- 172.21.15.22:0/3739834570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d8103ef0 con 0x7f14d8100b10 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d6d9d640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 0x7f14d8103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14d659c640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f14c800b450 tx=0x7f14c800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.639+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c8015020 con 0x7f14d8100b10 2024-09-11T22:27:50.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.640+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d81a2290 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.640+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f14c8011d30 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.640+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c800f2e0 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.640+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d81a2870 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.641+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d81a2b60 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.642+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f14c8018020 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.643+0000 7f14cf7fe640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 0x7f14c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.643+0000 7f14cffff640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 0x7f14c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.643+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14c80cec90 con 0x7f14d8100b10 2024-09-11T22:27:50.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.643+0000 7f14cffff640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 0x7f14c40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14d8104820 tx=0x7f14c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:50.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.646+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14c801f020 con 0x7f14d8100b10 2024-09-11T22:27:50.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:50 smithi169 ceph-mon[35628]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.3 KiB/s wr, 4 op/s 2024-09-11T22:27:50.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:50 smithi169 ceph-mon[35628]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:50 smithi045 ceph-mon[35556]: pgmap v291: 97 pgs: 97 active+clean; 629 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.3 KiB/s wr, 4 op/s 2024-09-11T22:27:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:50 smithi045 ceph-mon[35556]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:27:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.890+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f14d81a2d30 con 0x7f14d8100b10 2024-09-11T22:27:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.892+0000 7f14cf7fe640 1 -- 172.21.15.22:0/3739834570 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f14c809bc50 con 0x7f14d8100b10 2024-09-11T22:27:50.893 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-09-11T22:27:50.893 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQBmGeJmB0AsNRAASD2TD1APEwzuKydhk+ZP/g== 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 msgr2=0x7f14c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 0x7f14c40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14d8104820 tx=0x7f14c0009110 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 msgr2=0x7f14d8104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f14c800b450 tx=0x7f14c800b850 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 shutdown_connections 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d81026d0 0x7f14d8103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f14c40a2c10 0x7f14c40a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14d8101d10 0x7f14d81030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 --2- 172.21.15.22:0/3739834570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d8100b10 0x7f14d8104aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 >> 172.21.15.22:0/3739834570 conn(0x7f14d80fc2a0 msgr2=0x7f14d80fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 shutdown_connections 2024-09-11T22:27:50.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:50.895+0000 7f14dcb38640 1 -- 172.21.15.22:0/3739834570 wait complete. 2024-09-11T22:27:51.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:51 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:27:51.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:51 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:27:51.526 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:27:51.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T22:27:51.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T22:27:51.565 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T22:27:51.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T22:27:51.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T22:27:51.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:51 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:27:51.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:51 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:27:51.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:51 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:27:51.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:51 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3739834570' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:27:51.863 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 -- 172.21.15.22:0/1392981630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4102dd0 msgr2=0x7f08c41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/1392981630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4102dd0 0x7f08c41031b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009930 tx=0x7f08b402a420 comp rx=0 tx=0).stop 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 -- 172.21.15.22:0/1392981630 shutdown_connections 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/1392981630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4108300 0x7f08c410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/1392981630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/1392981630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4102dd0 0x7f08c41031b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 -- 172.21.15.22:0/1392981630 >> 172.21.15.22:0/1392981630 conn(0x7f08c40fc7d0 msgr2=0x7f08c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 -- 172.21.15.22:0/1392981630 shutdown_connections 2024-09-11T22:27:52.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.373+0000 7f08c8bb1640 1 -- 172.21.15.22:0/1392981630 wait complete. 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 Processor -- start 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 -- start start 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 0x7f08c41986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f08c41121f0 con 0x7f08c4108300 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4112070 con 0x7f08c4103780 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c8bb1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08c4112370 con 0x7f08c4102dd0 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52002/0 (socket says 172.21.15.22:52002) 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 -- 172.21.15.22:0/2321637268 learned_addr learned my addr 172.21.15.22:0/2321637268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c259c640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 0x7f08c41986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:52.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c1d9b640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 -- 172.21.15.22:0/2321637268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 msgr2=0x7f08c41986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 0x7f08c41986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 -- 172.21.15.22:0/2321637268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 msgr2=0x7f08c4198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c2d9d640 1 -- 172.21.15.22:0/2321637268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c419d660 con 0x7f08c4108300 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c1d9b640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.374+0000 7f08c259c640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 0x7f08c41986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08c2d9d640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00cad0 tx=0x7f08bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00ae20 con 0x7f08c4108300 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c419d950 con 0x7f08c4108300 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f08bc004b20 con 0x7f08c4108300 2024-09-11T22:27:52.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00f780 con 0x7f08c4108300 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.375+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c41a5230 con 0x7f08c4108300 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.376+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c406a7b0 con 0x7f08c4108300 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.377+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f08bc004cd0 con 0x7f08c4108300 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.378+0000 7f08b37fe640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 0x7f08ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.378+0000 7f08c259c640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 0x7f08ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.378+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f08bc0cf0c0 con 0x7f08c4108300 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.378+0000 7f08c259c640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 0x7f08ac0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:52.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.382+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08bc014030 con 0x7f08c4108300 2024-09-11T22:27:52.552 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:52 smithi022 ceph-mon[30966]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-09-11T22:27:52.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.608+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f08c410a2e0 con 0x7f08c4108300 2024-09-11T22:27:52.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.616+0000 7f08b37fe640 1 -- 172.21.15.22:0/2321637268 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7f08bc09c070 con 0x7f08c4108300 2024-09-11T22:27:52.620 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 msgr2=0x7f08ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 0x7f08ac0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b4005a20 comp rx=0 tx=0).stop 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 msgr2=0x7f08c419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00cad0 tx=0x7f08bc00cf90 comp rx=0 tx=0).stop 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 shutdown_connections 2024-09-11T22:27:52.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08c4108300 0x7f08c419cf80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08c4103780 0x7f08c4198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f08ac0a2c10 0x7f08ac0a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 --2- 172.21.15.22:0/2321637268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08c4102dd0 0x7f08c41986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 >> 172.21.15.22:0/2321637268 conn(0x7f08c40fc7d0 msgr2=0x7f08c4106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.619+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 shutdown_connections 2024-09-11T22:27:52.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:52.620+0000 7f08c8bb1640 1 -- 172.21.15.22:0/2321637268 wait complete. 2024-09-11T22:27:52.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:52 smithi169 ceph-mon[35628]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-09-11T22:27:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:52 smithi045 ceph-mon[35556]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-09-11T22:27:53.448 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3117763107},{"type":"v1","addr":"172.21.15.22:6801","nonce":3117763107}]},"active_addr":"172.21.15.22:6801/3117763107","active_change":"2024-09-11T22:20:26.526941+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1661302101}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1692369784}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1813461442}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":4017592669}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2071298810}]}]} 2024-09-11T22:27:53.454 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T22:27:53.455 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T22:27:53.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:53.574 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:53 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2321637268' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:27:53.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:53 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2321637268' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:27:53.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:53 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2321637268' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:27:53.716 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- 172.21.15.22:0/2221793785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc102790 msgr2=0x7fc4fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 --2- 172.21.15.22:0/2221793785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc102790 0x7fc4fc1067e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009900 tx=0x7fc4ec02a410 comp rx=0 tx=0).stop 2024-09-11T22:27:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- 172.21.15.22:0/2221793785 shutdown_connections 2024-09-11T22:27:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 --2- 172.21.15.22:0/2221793785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 0x7fc4fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 --2- 172.21.15.22:0/2221793785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc102790 0x7fc4fc1067e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 --2- 172.21.15.22:0/2221793785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc101de0 0x7fc4fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- 172.21.15.22:0/2221793785 >> 172.21.15.22:0/2221793785 conn(0x7fc4fc0fd8c0 msgr2=0x7fc4fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- 172.21.15.22:0/2221793785 shutdown_connections 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- 172.21.15.22:0/2221793785 wait complete. 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 Processor -- start 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.180+0000 7fc50334a640 1 -- start start 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc5010e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:54.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc112150 con 0x7fc4fc101de0 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc111fd0 con 0x7fc4fc102790 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc50334a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc1122d0 con 0x7fc4fc106f10 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc5010e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43816/0 (socket says 172.21.15.22:43816) 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.181+0000 7fc5010e6640 1 -- 172.21.15.22:0/3074697413 learned_addr learned my addr 172.21.15.22:0/3074697413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5008e5640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5018e7640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 -- 172.21.15.22:0/3074697413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 msgr2=0x7fc4fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 -- 172.21.15.22:0/3074697413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc102790 msgr2=0x7fc4fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 -- 172.21.15.22:0/3074697413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4fc1983d0 con 0x7fc4fc101de0 2024-09-11T22:27:54.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc5010e6640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b4a0 tx=0x7fc4f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:54.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8014070 con 0x7fc4fc101de0 2024-09-11T22:27:54.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4f8010b10 con 0x7fc4fc101de0 2024-09-11T22:27:54.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4fc1986c0 con 0x7fc4fc101de0 2024-09-11T22:27:54.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8017d60 con 0x7fc4fc101de0 2024-09-11T22:27:54.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.182+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4fc198c20 con 0x7fc4fc101de0 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.183+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4fc102240 con 0x7fc4fc101de0 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.185+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc4f8017070 con 0x7fc4fc101de0 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.185+0000 7fc4f27fc640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 0x7fc4e80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.185+0000 7fc5008e5640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 0x7fc4e80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.185+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc4f80ce570 con 0x7fc4fc101de0 2024-09-11T22:27:54.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.186+0000 7fc5008e5640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 0x7fc4e80a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009230 tx=0x7fc4ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:54.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.188+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4f809afe0 con 0x7fc4fc101de0 2024-09-11T22:27:54.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.365+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4fc075a20 con 0x7fc4fc101de0 2024-09-11T22:27:54.366 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:54 smithi022 ceph-mon[30966]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:54.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.366+0000 7fc4f27fc640 1 -- 172.21.15.22:0/3074697413 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22255 (secure 0 0 0) 0x7fc4f809f2e0 con 0x7fc4fc101de0 2024-09-11T22:27:54.367 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:54.367 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":80,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:27:24.459003+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:54.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 msgr2=0x7fc4e80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:54.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 0x7fc4e80a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009230 tx=0x7fc4ec0058d0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 msgr2=0x7fc4fc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:54.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800b4a0 tx=0x7fc4f800b960 comp rx=0 tx=0).stop 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 shutdown_connections 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc4e80a2c90 0x7fc4e80a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 --2- 172.21.15.22:0/3074697413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.368+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 >> 172.21.15.22:0/3074697413 conn(0x7fc4fc0fd8c0 msgr2=0x7fc4fc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.369+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 shutdown_connections 2024-09-11T22:27:54.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:54.369+0000 7fc50334a640 1 -- 172.21.15.22:0/3074697413 wait complete. 2024-09-11T22:27:54.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:54 smithi169 ceph-mon[35628]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:54.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:54 smithi045 ceph-mon[35556]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:55.145 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T22:27:55.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:55.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:55 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3074697413' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:55.409 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:55.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:55 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3074697413' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:55.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:55 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3074697413' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:55.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 -- 172.21.15.22:0/3517056523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 msgr2=0x7fc3341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 --2- 172.21.15.22:0/3517056523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc3341029b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc328009900 tx=0x7fc32802a480 comp rx=0 tx=0).stop 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 -- 172.21.15.22:0/3517056523 shutdown_connections 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 --2- 172.21.15.22:0/3517056523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc334102ef0 0x7fc33410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 --2- 172.21.15.22:0/3517056523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc3341029b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 --2- 172.21.15.22:0/3517056523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 0x7fc334101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 -- 172.21.15.22:0/3517056523 >> 172.21.15.22:0/3517056523 conn(0x7fc3340fc7d0 msgr2=0x7fc3340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 -- 172.21.15.22:0/3517056523 shutdown_connections 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 -- 172.21.15.22:0/3517056523 wait complete. 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.915+0000 7fc33a290640 1 Processor -- start 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 -- start start 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 0x7fc3341993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:55.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc334102ef0 0x7fc3341a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3341110a0 con 0x7fc334102570 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc334110f20 con 0x7fc334100e20 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc33a290640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc334111220 con 0x7fc334102ef0 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43828/0 (socket says 172.21.15.22:43828) 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 -- 172.21.15.22:0/4188282531 learned_addr learned my addr 172.21.15.22:0/4188282531 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc333fff640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 0x7fc3341993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 -- 172.21.15.22:0/4188282531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc334102ef0 msgr2=0x7fc3341a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc334102ef0 0x7fc3341a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 -- 172.21.15.22:0/4188282531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 msgr2=0x7fc3341993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 0x7fc3341993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.916+0000 7fc3337fe640 1 -- 172.21.15.22:0/4188282531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3341a49b0 con 0x7fc334102570 2024-09-11T22:27:55.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc3337fe640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc328006010 tx=0x7fc3280049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32803f030 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc328004dd0 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3341a4b80 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328035070 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.917+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3341a5060 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.918+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc334101200 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.919+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc328042030 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.919+0000 7fc3317fa640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 0x7fc31c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.920+0000 7fc333fff640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 0x7fc31c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.920+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc3280ef300 con 0x7fc334102570 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.920+0000 7fc333fff640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 0x7fc31c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc324009bd0 tx=0x7fc324005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:55.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:55.924+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3280bc2b0 con 0x7fc334102570 2024-09-11T22:27:56.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.098+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3341a5230 con 0x7fc334102570 2024-09-11T22:27:56.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.100+0000 7fc3317fa640 1 -- 172.21.15.22:0/4188282531 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22255 (secure 0 0 0) 0x7fc3280bbbb0 con 0x7fc334102570 2024-09-11T22:27:56.101 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:27:56.101 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":80,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:27:24.459003+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 msgr2=0x7fc31c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 0x7fc31c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc324009bd0 tx=0x7fc324005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 msgr2=0x7fc334199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc328006010 tx=0x7fc3280049d0 comp rx=0 tx=0).stop 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 shutdown_connections 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fc31c0a2c90 0x7fc31c0a5150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:56.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc334102ef0 0x7fc3341a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:56.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc334102570 0x7fc334199930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:56.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 --2- 172.21.15.22:0/4188282531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc334100e20 0x7fc3341993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:56.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.102+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 >> 172.21.15.22:0/4188282531 conn(0x7fc3340fc7d0 msgr2=0x7fc334106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:56.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.103+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 shutdown_connections 2024-09-11T22:27:56.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:56.103+0000 7fc33a290640 1 -- 172.21.15.22:0/4188282531 wait complete. 2024-09-11T22:27:56.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:56 smithi022 ceph-mon[30966]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4188282531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:56.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:56 smithi169 ceph-mon[35628]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:56.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:56 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4188282531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:56.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:56 smithi045 ceph-mon[35556]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.7 KiB/s wr, 4 op/s 2024-09-11T22:27:56.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:56 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4188282531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:56.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T22:27:56.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T22:27:56.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T22:27:56.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T22:27:56.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T22:27:56.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T22:27:56.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T22:27:56.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T22:27:56.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T22:27:56.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T22:27:56.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T22:27:56.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T22:27:57.650 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.661 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.665 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.734 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.748 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:58.379 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:27:58 smithi022 ceph-mon[30966]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-11T22:27:58.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:27:58 smithi169 ceph-mon[35628]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-11T22:27:58.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:27:58 smithi045 ceph-mon[35556]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-11T22:27:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 -- 172.21.15.22:0/3135446295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0100a80 msgr2=0x7fdde0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 --2- 172.21.15.22:0/3135446295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0100a80 0x7fdde0100ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009930 tx=0x7fddd402a420 comp rx=0 tx=0).stop 2024-09-11T22:27:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 -- 172.21.15.22:0/3135446295 shutdown_connections 2024-09-11T22:27:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 --2- 172.21.15.22:0/3135446295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdde0101420 0x7fdde010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 --2- 172.21.15.22:0/3135446295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0100a80 0x7fdde0100ee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.756+0000 7fdde75f0640 1 --2- 172.21.15.22:0/3135446295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 0x7fdde0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.757+0000 7fdde75f0640 1 -- 172.21.15.22:0/3135446295 >> 172.21.15.22:0/3135446295 conn(0x7fdde00fc7a0 msgr2=0x7fdde00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.757+0000 7fdde75f0640 1 -- 172.21.15.22:0/3135446295 shutdown_connections 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.757+0000 7fdde75f0640 1 -- 172.21.15.22:0/3135446295 wait complete. 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.757+0000 7fdde75f0640 1 Processor -- start 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.757+0000 7fdde75f0640 1 -- start start 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdde0100a80 0x7fdde0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 0x7fdde0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 0x7fdde019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0110fa0 con 0x7fdde0101420 2024-09-11T22:27:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0110e20 con 0x7fdde0106a80 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde75f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0111120 con 0x7fdde0100a80 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 0x7fdde0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 0x7fdde0198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43864/0 (socket says 172.21.15.22:43864) 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 -- 172.21.15.22:0/864673514 learned_addr learned my addr 172.21.15.22:0/864673514 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde538c640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdde0100a80 0x7fdde0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde5b8d640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 0x7fdde019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 -- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdde0100a80 msgr2=0x7fdde0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdde0100a80 0x7fdde0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 -- 172.21.15.22:0/864673514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 msgr2=0x7fdde019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 0x7fdde019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde019d540 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde5b8d640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdde0106a80 0x7fdde019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.758+0000 7fdde4b8b640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 0x7fdde0198ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009230 tx=0x7fddd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd403f030 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde019d7d0 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fddd4003af0 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4035070 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a5110 con 0x7fdde0101420 2024-09-11T22:27:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.759+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdde0062900 con 0x7fdde0101420 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.761+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fddd4042030 con 0x7fdde0101420 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.761+0000 7fddd27fc640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fddcc0a2c90 0x7fddcc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fdde538c640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fddcc0a2c90 0x7fddcc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fddd40efba0 con 0x7fdde0101420 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fddd27fc640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] conn(0x7fddcc0ac4e0 0x7fddcc0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddd4009080 con 0x7fddcc0ac4e0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fddd40f0080 con 0x7fdde0101420 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fdde538c640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fddcc0a2c90 0x7fddcc0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009b50 tx=0x7fdddc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.762+0000 7fdde5b8d640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] conn(0x7fddcc0ac4e0 0x7fddcc0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.763+0000 7fdde5b8d640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] conn(0x7fddcc0ac4e0 0x7fddcc0ae900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.763+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== osd.5 v2:172.21.15.169:6808/3288251566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddd4009080 con 0x7fddcc0ac4e0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.777+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 --> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdde0062d00 con 0x7fddcc0ac4e0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fddd27fc640 1 -- 172.21.15.22:0/864673514 <== osd.5 v2:172.21.15.169:6808/3288251566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdde0062d00 con 0x7fddcc0ac4e0 2024-09-11T22:27:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] conn(0x7fddcc0ac4e0 msgr2=0x7fddcc0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] conn(0x7fddcc0ac4e0 0x7fddcc0ae900 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fddcc0a2c90 msgr2=0x7fddcc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fddcc0a2c90 0x7fddcc0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009b50 tx=0x7fdddc005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 msgr2=0x7fdde0198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 --2- 172.21.15.22:0/864673514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdde0101420 0x7fdde0198ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009230 tx=0x7fddd4004270 comp rx=0 tx=0).stop 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde5b8d640 1 -- 172.21.15.22:0/864673514 reap_dead start 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 shutdown_connections 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 >> 172.21.15.22:0/864673514 conn(0x7fdde00fc7a0 msgr2=0x7fdde006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 shutdown_connections 2024-09-11T22:27:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.778+0000 7fdde75f0640 1 -- 172.21.15.22:0/864673514 wait complete. 2024-09-11T22:27:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 -- 172.21.15.22:0/362157969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 msgr2=0x7fb204100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/362157969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb204100860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb200009900 tx=0x7fb20002a410 comp rx=0 tx=0).stop 2024-09-11T22:27:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 -- 172.21.15.22:0/362157969 shutdown_connections 2024-09-11T22:27:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/362157969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 0x7fb20410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/362157969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 0x7fb204104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/362157969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb204100860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 -- 172.21.15.22:0/362157969 >> 172.21.15.22:0/362157969 conn(0x7fb204077210 msgr2=0x7fb2040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 -- 172.21.15.22:0/362157969 shutdown_connections 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.377+0000 7fb20b3fa640 1 -- 172.21.15.22:0/362157969 wait complete. 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 Processor -- start 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 -- start start 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb2041a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 0x7fb2041a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 0x7fb20419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2041107c0 con 0x7fb204100480 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb204110640 con 0x7fb204100e30 2024-09-11T22:27:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb20b3fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb204110940 con 0x7fb2041055b0 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb209196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb2041a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb209196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb2041a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43836/0 (socket says 172.21.15.22:43836) 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.378+0000 7fb209196640 1 -- 172.21.15.22:0/586841456 learned_addr learned my addr 172.21.15.22:0/586841456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb208995640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 0x7fb2041a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 -- 172.21.15.22:0/586841456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 msgr2=0x7fb20419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209997640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 0x7fb20419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 0x7fb20419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 -- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 msgr2=0x7fb2041a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 0x7fb2041a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20419ace0 con 0x7fb204100480 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb208995640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb204100e30 0x7fb2041a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209997640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2041055b0 0x7fb20419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb209196640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb2041a03f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb200006010 tx=0x7fb200032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20003f030 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb200003d00 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20419af70 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200035070 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.379+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2041a72c0 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.380+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb20410c690 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.381+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb200042030 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb1fa7fc640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1f00a2c10 0x7fb1f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb208995640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1f00a2c10 0x7fb1f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb2000efb40 con 0x7fb204100480 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb1fa7fc640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] conn(0x7fb1f00ac460 0x7fb1f00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1f00aef30 con 0x7fb1f00ac460 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.382+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb2000f0020 con 0x7fb204100480 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.383+0000 7fb208995640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1f00a2c10 0x7fb1f00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006fd0 tx=0x7fb1f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.383+0000 7fb209997640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] conn(0x7fb1f00ac460 0x7fb1f00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.383+0000 7fb209997640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] conn(0x7fb1f00ac460 0x7fb1f00ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.384+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== osd.4 v2:172.21.15.45:6808/2265581210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1f00aef30 con 0x7fb1f00ac460 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.398+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 --> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb204101960 con 0x7fb1f00ac460 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.398+0000 7fb1fa7fc640 1 -- 172.21.15.22:0/586841456 <== osd.4 v2:172.21.15.45:6808/2265581210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb204101960 con 0x7fb1f00ac460 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.398+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] conn(0x7fb1f00ac460 msgr2=0x7fb1f00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.398+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] conn(0x7fb1f00ac460 0x7fb1f00ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1f00a2c10 msgr2=0x7fb1f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1f00a2c10 0x7fb1f00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006fd0 tx=0x7fb1f4008040 comp rx=0 tx=0).stop 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 msgr2=0x7fb2041a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 --2- 172.21.15.22:0/586841456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb204100480 0x7fb2041a03f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb200006010 tx=0x7fb200032c70 comp rx=0 tx=0).stop 2024-09-11T22:27:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb209997640 1 -- 172.21.15.22:0/586841456 reap_dead start 2024-09-11T22:27:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 shutdown_connections 2024-09-11T22:27:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 >> 172.21.15.22:0/586841456 conn(0x7fb204077210 msgr2=0x7fb20410bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 shutdown_connections 2024-09-11T22:27:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:27:58.399+0000 7fb20b3fa640 1 -- 172.21.15.22:0/586841456 wait complete. 2024-09-11T22:27:59.949 INFO:teuthology.orchestra.run.smithi022.stdout:133143986230 2024-09-11T22:27:59.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T22:28:00.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:00 smithi022 ceph-mon[30966]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-11T22:28:00.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:00 smithi169 ceph-mon[35628]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-11T22:28:00.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:00 smithi045 ceph-mon[35556]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 -- 172.21.15.22:0/2008484274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4106a80 msgr2=0x7fd8f4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/2008484274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4106a80 0x7fd8f4106e60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009930 tx=0x7fd8f002a420 comp rx=0 tx=0).stop 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 -- 172.21.15.22:0/2008484274 shutdown_connections 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/2008484274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f4101420 0x7fd8f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/2008484274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4100a80 0x7fd8f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/2008484274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4106a80 0x7fd8f4106e60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 -- 172.21.15.22:0/2008484274 >> 172.21.15.22:0/2008484274 conn(0x7fd8f40fc7a0 msgr2=0x7fd8f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 -- 172.21.15.22:0/2008484274 shutdown_connections 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.712+0000 7fd8fb30a640 1 -- 172.21.15.22:0/2008484274 wait complete. 2024-09-11T22:28:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 Processor -- start 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 -- start start 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f4100a80 0x7fd8f4102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 0x7fd8f4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4106a80 0x7fd8f41030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4110fa0 con 0x7fd8f4101420 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4110e20 con 0x7fd8f4106a80 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8fb30a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4111120 con 0x7fd8f4100a80 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 0x7fd8f4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 0x7fd8f4102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43880/0 (socket says 172.21.15.22:43880) 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 -- 172.21.15.22:0/909189122 learned_addr learned my addr 172.21.15.22:0/909189122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f90a6640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f4100a80 0x7fd8f4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f98a7640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4106a80 0x7fd8f41030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 -- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f4100a80 msgr2=0x7fd8f4102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8f4100a80 0x7fd8f4102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 -- 172.21.15.22:0/909189122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4106a80 msgr2=0x7fd8f41030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4106a80 0x7fd8f41030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.713+0000 7fd8f88a5640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f41a69a0 con 0x7fd8f4101420 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8f88a5640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 0x7fd8f4102b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c890 tx=0x7fd8e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004220 con 0x7fd8f4101420 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f41a6c90 con 0x7fd8f4101420 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd8e40043c0 con 0x7fd8f4101420 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004b10 con 0x7fd8f4101420 2024-09-11T22:28:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.714+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f41a71c0 con 0x7fd8f4101420 2024-09-11T22:28:00.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.715+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8f406aa20 con 0x7fd8f4101420 2024-09-11T22:28:00.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.716+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd8e40051b0 con 0x7fd8f4101420 2024-09-11T22:28:00.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8ea7fc640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8e00a2c10 0x7fd8e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8f90a6640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8e00a2c10 0x7fd8e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd8e40cf210 con 0x7fd8f4101420 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8ea7fc640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] conn(0x7fd8e00ac460 0x7fd8e00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8e00aef30 con 0x7fd8e00ac460 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd8e40cf6f0 con 0x7fd8f4101420 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8f98a7640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] conn(0x7fd8e00ac460 0x7fd8e00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.717+0000 7fd8f90a6640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8e00a2c10 0x7fd8e00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009900 tx=0x7fd8f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.718+0000 7fd8f98a7640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] conn(0x7fd8e00ac460 0x7fd8e00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.718+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== osd.11 v2:172.21.15.169:6824/1239026325 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8e00aef30 con 0x7fd8e00ac460 2024-09-11T22:28:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.732+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 --> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8f41021c0 con 0x7fd8e00ac460 2024-09-11T22:28:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8ea7fc640 1 -- 172.21.15.22:0/909189122 <== osd.11 v2:172.21.15.169:6824/1239026325 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd8f41021c0 con 0x7fd8e00ac460 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] conn(0x7fd8e00ac460 msgr2=0x7fd8e00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] conn(0x7fd8e00ac460 0x7fd8e00ae880 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8e00a2c10 msgr2=0x7fd8e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8e00a2c10 0x7fd8e00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009900 tx=0x7fd8f00058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 msgr2=0x7fd8f4102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 --2- 172.21.15.22:0/909189122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8f4101420 0x7fd8f4102b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c890 tx=0x7fd8e400cd50 comp rx=0 tx=0).stop 2024-09-11T22:28:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8f98a7640 1 -- 172.21.15.22:0/909189122 reap_dead start 2024-09-11T22:28:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 shutdown_connections 2024-09-11T22:28:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 >> 172.21.15.22:0/909189122 conn(0x7fd8f40fc7a0 msgr2=0x7fd8f41047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 shutdown_connections 2024-09-11T22:28:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.733+0000 7fd8fb30a640 1 -- 172.21.15.22:0/909189122 wait complete. 2024-09-11T22:28:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.914+0000 7f9437471640 1 -- 172.21.15.22:0/2643406766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430101420 msgr2=0x7f943010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.914+0000 7f9437471640 1 --2- 172.21.15.22:0/2643406766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430101420 0x7f943010d950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9428009cd0 tx=0x7f942802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.914+0000 7f9437471640 1 -- 172.21.15.22:0/2643406766 shutdown_connections 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- 172.21.15.22:0/2643406766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430101420 0x7f943010d950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- 172.21.15.22:0/2643406766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9430100a80 0x7f9430100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- 172.21.15.22:0/2643406766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9430106a80 0x7f9430106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- 172.21.15.22:0/2643406766 >> 172.21.15.22:0/2643406766 conn(0x7f94300fc7a0 msgr2=0x7f94300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- 172.21.15.22:0/2643406766 shutdown_connections 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- 172.21.15.22:0/2643406766 wait complete. 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 Processor -- start 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- start start 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 0x7f94301992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9430101420 0x7f9430199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9430106a80 0x7f94301a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9430110fa0 con 0x7f9430100a80 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9430110e20 con 0x7f9430101420 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.915+0000 7f9437471640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9430111120 con 0x7f9430106a80 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 0x7f94301992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 0x7f94301992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43892/0 (socket says 172.21.15.22:43892) 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 -- 172.21.15.22:0/1202392380 learned_addr learned my addr 172.21.15.22:0/1202392380 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f9434a0c640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9430101420 0x7f9430199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f9435a0e640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9430106a80 0x7f94301a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 -- 172.21.15.22:0/1202392380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9430106a80 msgr2=0x7f94301a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9430106a80 0x7f94301a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 -- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9430101420 msgr2=0x7f9430199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9430101420 0x7f9430199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301a48b0 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f943520d640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 0x7f94301992f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f942c00e9f0 tx=0x7f942c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c00cd80 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f942c010930 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c018b00 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301a4a80 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.916+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301a4fc0 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.917+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94300fd760 con 0x7f9430100a80 2024-09-11T22:28:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.918+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f942c018ca0 con 0x7f9430100a80 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f94267fc640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f941c0a2c90 0x7f941c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f9434a0c640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f941c0a2c90 0x7f941c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f942c0cf850 con 0x7f9430100a80 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f94267fc640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] conn(0x7f941c0ac4e0 0x7f941c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f942c015e80 con 0x7f941c0ac4e0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f942c0cfd30 con 0x7f9430100a80 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.919+0000 7f9434a0c640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f941c0a2c90 0x7f941c0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f943006b2e0 tx=0x7f9420005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.920+0000 7f9435a0e640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] conn(0x7f941c0ac4e0 0x7f941c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.920+0000 7f9435a0e640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] conn(0x7f941c0ac4e0 0x7f941c0ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.921+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== osd.10 v2:172.21.15.45:6824/963190759 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f942c015e80 con 0x7f941c0ac4e0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.934+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 --> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94301021c0 con 0x7f941c0ac4e0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f94267fc640 1 -- 172.21.15.22:0/1202392380 <== osd.10 v2:172.21.15.45:6824/963190759 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f94301021c0 con 0x7f941c0ac4e0 2024-09-11T22:28:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] conn(0x7f941c0ac4e0 msgr2=0x7f941c0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] conn(0x7f941c0ac4e0 0x7f941c0ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f941c0a2c90 msgr2=0x7f941c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f941c0a2c90 0x7f941c0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f943006b2e0 tx=0x7f9420005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 msgr2=0x7f94301992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 --2- 172.21.15.22:0/1202392380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9430100a80 0x7f94301992f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f942c00e9f0 tx=0x7f942c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9435a0e640 1 -- 172.21.15.22:0/1202392380 reap_dead start 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 shutdown_connections 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.935+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 >> 172.21.15.22:0/1202392380 conn(0x7f94300fc7a0 msgr2=0x7f94300fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.936+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 shutdown_connections 2024-09-11T22:28:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:00.936+0000 7f9437471640 1 -- 172.21.15.22:0/1202392380 wait complete. 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 -- 172.21.15.22:0/1184970357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 msgr2=0x7f6f001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1184970357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f001021c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009ca0 tx=0x7f6efc02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 -- 172.21.15.22:0/1184970357 shutdown_connections 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1184970357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00106f10 0x7f6f0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1184970357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00102790 0x7f6f001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1184970357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f001021c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 -- 172.21.15.22:0/1184970357 >> 172.21.15.22:0/1184970357 conn(0x7f6f000fd8c0 msgr2=0x7f6f000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 -- 172.21.15.22:0/1184970357 shutdown_connections 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.644+0000 7f6f073bc640 1 -- 172.21.15.22:0/1184970357 wait complete. 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.645+0000 7f6f073bc640 1 Processor -- start 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.645+0000 7f6f073bc640 1 -- start start 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.645+0000 7f6f073bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f00198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.645+0000 7f6f073bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00102790 0x7f6f00198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00106f10 0x7f6f0019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00112090 con 0x7f6f00101de0 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00111f10 con 0x7f6f00106f10 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00112210 con 0x7f6f00102790 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f00198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f00198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43922/0 (socket says 172.21.15.22:43922) 2024-09-11T22:28:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 -- 172.21.15.22:0/1796360041 learned_addr learned my addr 172.21.15.22:0/1796360041 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f04957640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00102790 0x7f6f00198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05959640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00106f10 0x7f6f0019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 -- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00102790 msgr2=0x7f6f00198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00102790 0x7f6f00198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 -- 172.21.15.22:0/1796360041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00106f10 msgr2=0x7f6f0019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f00106f10 0x7f6f0019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0019d400 con 0x7f6f00101de0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f04957640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f00102790 0x7f6f00198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f05158640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f00198450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6efc02ade0 tx=0x7f6efc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc003b70 con 0x7f6f00101de0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0019d690 con 0x7f6f00101de0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6efc003d10 con 0x7f6f00101de0 2024-09-11T22:28:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc02fc00 con 0x7f6f00101de0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.646+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f001a4fd0 con 0x7f6f00101de0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.647+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f000fef40 con 0x7f6f00101de0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6efc004050 con 0x7f6f00101de0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6ef67fc640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6eec0a2c10 0x7f6eec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6efc0f0320 con 0x7f6f00101de0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6f04957640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6eec0a2c10 0x7f6eec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6ef67fc640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] conn(0x7f6eec0ac460 0x7f6eec0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.649+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6eec0aef30 con 0x7f6eec0ac460 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.650+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f6efc0f0800 con 0x7f6f00101de0 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.650+0000 7f6f05959640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] conn(0x7f6eec0ac460 0x7f6eec0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.650+0000 7f6f04957640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6eec0a2c10 0x7f6eec0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f001088e0 tx=0x7f6ef000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.650+0000 7f6f05959640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] conn(0x7f6eec0ac460 0x7f6eec0ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.651+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== osd.2 v2:172.21.15.169:6800/711069925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6eec0aef30 con 0x7f6eec0ac460 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 --> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f001032c0 con 0x7f6eec0ac460 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6ef67fc640 1 -- 172.21.15.22:0/1796360041 <== osd.2 v2:172.21.15.169:6800/711069925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f001032c0 con 0x7f6eec0ac460 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] conn(0x7f6eec0ac460 msgr2=0x7f6eec0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] conn(0x7f6eec0ac460 0x7f6eec0ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6eec0a2c10 msgr2=0x7f6eec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6eec0a2c10 0x7f6eec0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f001088e0 tx=0x7f6ef000a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 msgr2=0x7f6f00198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:01.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f073bc640 1 --2- 172.21.15.22:0/1796360041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f00101de0 0x7f6f00198450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6efc02ade0 tx=0x7f6efc0319f0 comp rx=0 tx=0).stop 2024-09-11T22:28:01.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.665+0000 7f6f05959640 1 -- 172.21.15.22:0/1796360041 reap_dead start 2024-09-11T22:28:01.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.666+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 shutdown_connections 2024-09-11T22:28:01.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.666+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 >> 172.21.15.22:0/1796360041 conn(0x7f6f000fd8c0 msgr2=0x7f6f000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:01.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.666+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 shutdown_connections 2024-09-11T22:28:01.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:01.666+0000 7f6f073bc640 1 -- 172.21.15.22:0/1796360041 wait complete. 2024-09-11T22:28:02.430 INFO:teuthology.orchestra.run.smithi022.stdout:73014444098 2024-09-11T22:28:02.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T22:28:02.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:02 smithi022 ceph-mon[30966]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T22:28:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 -- 172.21.15.22:0/3671461872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901082a0 msgr2=0x7f919010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 --2- 172.21.15.22:0/3671461872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901082a0 0x7f919010ec40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9188009cd0 tx=0x7f918802a910 comp rx=0 tx=0).stop 2024-09-11T22:28:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 -- 172.21.15.22:0/3671461872 shutdown_connections 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 --2- 172.21.15.22:0/3671461872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901082a0 0x7f919010ec40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 --2- 172.21.15.22:0/3671461872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901036e0 0x7f9190107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 --2- 172.21.15.22:0/3671461872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9190102d30 0x7f9190103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 -- 172.21.15.22:0/3671461872 >> 172.21.15.22:0/3671461872 conn(0x7f91900fc7d0 msgr2=0x7f91900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 -- 172.21.15.22:0/3671461872 shutdown_connections 2024-09-11T22:28:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 -- 172.21.15.22:0/3671461872 wait complete. 2024-09-11T22:28:02.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.569+0000 7f9197a30640 1 Processor -- start 2024-09-11T22:28:02.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 -- start start 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9190102d30 0x7f9190100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 0x7f9190100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901082a0 0x7f9190101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9190112220 con 0x7f91901036e0 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f91901120a0 con 0x7f91901082a0 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9197a30640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91901123a0 con 0x7f9190102d30 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 0x7f9190100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 0x7f9190100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43942/0 (socket says 172.21.15.22:43942) 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 -- 172.21.15.22:0/971787636 learned_addr learned my addr 172.21.15.22:0/971787636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f91957cc640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9190102d30 0x7f9190100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9195fcd640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901082a0 0x7f9190101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 -- 172.21.15.22:0/971787636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9190102d30 msgr2=0x7f9190100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9190102d30 0x7f9190100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 -- 172.21.15.22:0/971787636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901082a0 msgr2=0x7f9190101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901082a0 0x7f9190101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9194fcb640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91901a6b90 con 0x7f91901036e0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.570+0000 7f9195fcd640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91901082a0 0x7f9190101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f9194fcb640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 0x7f9190100ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9180006fd0 tx=0x7f918000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180015020 con 0x7f91901036e0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91901a6e80 con 0x7f91901036e0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91901a7380 con 0x7f91901036e0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9180011d30 con 0x7f91901036e0 2024-09-11T22:28:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.571+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918000f2e0 con 0x7f91901036e0 2024-09-11T22:28:02.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.572+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9190062900 con 0x7f91901036e0 2024-09-11T22:28:02.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.574+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9180018020 con 0x7f91901036e0 2024-09-11T22:28:02.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91867fc640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f917c0a2c90 0x7f917c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f91800ced30 con 0x7f91901036e0 2024-09-11T22:28:02.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91957cc640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f917c0a2c90 0x7f917c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91867fc640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] conn(0x7f917c0ac4e0 0x7f917c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9180013ec0 con 0x7f917c0ac4e0 2024-09-11T22:28:02.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.575+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f91800cf210 con 0x7f91901036e0 2024-09-11T22:28:02.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.576+0000 7f9195fcd640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] conn(0x7f917c0ac4e0 0x7f917c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.576+0000 7f91957cc640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f917c0a2c90 0x7f917c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c00abe0 tx=0x7f918c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.576+0000 7f9195fcd640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] conn(0x7f917c0ac4e0 0x7f917c0ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.577+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== osd.9 v2:172.21.15.22:6826/3132615329 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9180013ec0 con 0x7f917c0ac4e0 2024-09-11T22:28:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.590+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 --> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9190062d00 con 0x7f917c0ac4e0 2024-09-11T22:28:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f91867fc640 1 -- 172.21.15.22:0/971787636 <== osd.9 v2:172.21.15.22:6826/3132615329 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9190062d00 con 0x7f917c0ac4e0 2024-09-11T22:28:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] conn(0x7f917c0ac4e0 msgr2=0x7f917c0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] conn(0x7f917c0ac4e0 0x7f917c0ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f917c0a2c90 msgr2=0x7f917c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f917c0a2c90 0x7f917c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f918c00abe0 tx=0x7f918c00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 msgr2=0x7f9190100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 --2- 172.21.15.22:0/971787636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91901036e0 0x7f9190100ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9180006fd0 tx=0x7f918000b820 comp rx=0 tx=0).stop 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9195fcd640 1 -- 172.21.15.22:0/971787636 reap_dead start 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 shutdown_connections 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 >> 172.21.15.22:0/971787636 conn(0x7f91900fc7d0 msgr2=0x7f91900fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 shutdown_connections 2024-09-11T22:28:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:02.591+0000 7f9197a30640 1 -- 172.21.15.22:0/971787636 wait complete. 2024-09-11T22:28:02.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:02 smithi169 ceph-mon[35628]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T22:28:02.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:02 smithi045 ceph-mon[35556]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T22:28:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:03.508 INFO:teuthology.orchestra.run.smithi022.stdout:154618822706 2024-09-11T22:28:03.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T22:28:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 -- 172.21.15.22:0/4128149810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 msgr2=0x7fd30c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 --2- 172.21.15.22:0/4128149810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c101200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009900 tx=0x7fd2fc02a480 comp rx=0 tx=0).stop 2024-09-11T22:28:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 -- 172.21.15.22:0/4128149810 shutdown_connections 2024-09-11T22:28:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 --2- 172.21.15.22:0/4128149810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30c102ef0 0x7fd30c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 --2- 172.21.15.22:0/4128149810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102570 0x7fd30c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 --2- 172.21.15.22:0/4128149810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c101200 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 -- 172.21.15.22:0/4128149810 >> 172.21.15.22:0/4128149810 conn(0x7fd30c0fc7d0 msgr2=0x7fd30c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.760+0000 7fd311976640 1 -- 172.21.15.22:0/4128149810 shutdown_connections 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.761+0000 7fd311976640 1 -- 172.21.15.22:0/4128149810 wait complete. 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.761+0000 7fd311976640 1 Processor -- start 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.761+0000 7fd311976640 1 -- start start 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30c102570 0x7fd30c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102ef0 0x7fd30c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1110e0 con 0x7fd30c100e20 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c110f60 con 0x7fd30c102570 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c111260 con 0x7fd30c102ef0 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43960/0 (socket says 172.21.15.22:43960) 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 -- 172.21.15.22:0/2789515867 learned_addr learned my addr 172.21.15.22:0/2789515867 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30a7fc640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30c102570 0x7fd30c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30b7fe640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102ef0 0x7fd30c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 -- 172.21.15.22:0/2789515867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102ef0 msgr2=0x7fd30c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102ef0 0x7fd30c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 -- 172.21.15.22:0/2789515867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30c102570 msgr2=0x7fd30c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd30c102570 0x7fd30c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c1a6a90 con 0x7fd30c100e20 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30b7fe640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd30c102ef0 0x7fd30c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:03.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd30affd640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c0fcc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc03f030 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c1a6d20 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2fc005500 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc035070 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.762+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c1a71a0 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.763+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd30c062940 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.765+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd2fc042030 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.765+0000 7fd310974640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2f40a2c10 0x7fd2f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.765+0000 7fd30a7fc640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2f40a2c10 0x7fd2f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.765+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd2fc0efc10 con 0x7fd30c100e20 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd310974640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] conn(0x7fd2f40ac460 0x7fd2f40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2fc03be50 con 0x7fd2f40ac460 2024-09-11T22:28:03.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd2fc0f00f0 con 0x7fd30c100e20 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd30b7fe640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] conn(0x7fd2f40ac460 0x7fd2f40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd30a7fc640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2f40a2c10 0x7fd2f40a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0fe710 tx=0x7fd300009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.766+0000 7fd30b7fe640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] conn(0x7fd2f40ac460 0x7fd2f40ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.767+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== osd.3 v2:172.21.15.22:6810/3656884990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2fc03be50 con 0x7fd2f40ac460 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.780+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 --> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd30c062d40 con 0x7fd2f40ac460 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd310974640 1 -- 172.21.15.22:0/2789515867 <== osd.3 v2:172.21.15.22:6810/3656884990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd30c062d40 con 0x7fd2f40ac460 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] conn(0x7fd2f40ac460 msgr2=0x7fd2f40ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] conn(0x7fd2f40ac460 0x7fd2f40ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2f40a2c10 msgr2=0x7fd2f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd2f40a2c10 0x7fd2f40a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0fe710 tx=0x7fd300009110 comp rx=0 tx=0).stop 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 msgr2=0x7fd30c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 --2- 172.21.15.22:0/2789515867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd30c100e20 0x7fd30c0fcc80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc006010 tx=0x7fd2fc004c00 comp rx=0 tx=0).stop 2024-09-11T22:28:03.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd30b7fe640 1 -- 172.21.15.22:0/2789515867 reap_dead start 2024-09-11T22:28:03.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 shutdown_connections 2024-09-11T22:28:03.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 >> 172.21.15.22:0/2789515867 conn(0x7fd30c0fc7d0 msgr2=0x7fd30c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 shutdown_connections 2024-09-11T22:28:03.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:03.781+0000 7fd311976640 1 -- 172.21.15.22:0/2789515867 wait complete. 2024-09-11T22:28:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:04 smithi022 ceph-mon[30966]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:04 smithi169 ceph-mon[35628]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:04.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:04 smithi045 ceph-mon[35556]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:04.918 INFO:teuthology.orchestra.run.smithi022.stdout:103079215166 2024-09-11T22:28:04.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T22:28:05.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 -- 172.21.15.22:0/3227676713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858106f10 msgr2=0x7f985810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 --2- 172.21.15.22:0/3227676713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858106f10 0x7f985810ea90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9850009ca0 tx=0x7f985002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 -- 172.21.15.22:0/3227676713 shutdown_connections 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 --2- 172.21.15.22:0/3227676713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858106f10 0x7f985810ea90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 --2- 172.21.15.22:0/3227676713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9858102790 0x7f98581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 --2- 172.21.15.22:0/3227676713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 0x7f98581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 -- 172.21.15.22:0/3227676713 >> 172.21.15.22:0/3227676713 conn(0x7f98580fd8c0 msgr2=0x7f98580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 -- 172.21.15.22:0/3227676713 shutdown_connections 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.504+0000 7f985d6db640 1 -- 172.21.15.22:0/3227676713 wait complete. 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 Processor -- start 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 -- start start 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 0x7f98580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 0x7f9858074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9858106f10 0x7f9858074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:05.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9858112090 con 0x7f9858102790 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9858111f10 con 0x7f9858106f10 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f985d6db640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9858112210 con 0x7f9858101de0 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f984ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 0x7f9858074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f984ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 0x7f9858074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55288/0 (socket says 172.21.15.22:55288) 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f984ffff640 1 -- 172.21.15.22:0/239911668 learned_addr learned my addr 172.21.15.22:0/239911668 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f9856ffd640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 0x7f98580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.505+0000 7f98577fe640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9858106f10 0x7f9858074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 -- 172.21.15.22:0/239911668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 msgr2=0x7f98580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 0x7f98580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 -- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9858106f10 msgr2=0x7f9858074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9858106f10 0x7f9858074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98581a68d0 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f9856ffd640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9858101de0 0x7f98580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f984ffff640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 0x7f9858074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f984000c920 tx=0x7f984000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840007c70 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98581a6bc0 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9840007e10 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840018940 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.506+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98581a7150 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.507+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98580ffe70 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.508+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9840018b00 con 0x7f9858102790 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9854ff9640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f98440a2c10 0x7f98440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9856ffd640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f98440a2c10 0x7f98440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:05.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f98400cf4e0 con 0x7f9858102790 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9854ff9640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] conn(0x7f98440ac460 0x7f98440ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9840021e50 con 0x7f98440ac460 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.509+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f98400cf9c0 con 0x7f9858102790 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.510+0000 7f9856ffd640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f98440a2c10 0x7f98440a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9848009fc0 tx=0x7f9848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.510+0000 7f98577fe640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] conn(0x7f98440ac460 0x7f98440ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.510+0000 7f98577fe640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] conn(0x7f98440ac460 0x7f98440ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.511+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== osd.7 v2:172.21.15.45:6816/1044507788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9840021e50 con 0x7f98440ac460 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.525+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 --> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98581032c0 con 0x7f98440ac460 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.525+0000 7f9854ff9640 1 -- 172.21.15.22:0/239911668 <== osd.7 v2:172.21.15.45:6816/1044507788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f98581032c0 con 0x7f98440ac460 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.525+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] conn(0x7f98440ac460 msgr2=0x7f98440ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.525+0000 7f985d6db640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] conn(0x7f98440ac460 0x7f98440ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f98440a2c10 msgr2=0x7f98440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f98440a2c10 0x7f98440a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9848009fc0 tx=0x7f9848005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 msgr2=0x7f9858074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 --2- 172.21.15.22:0/239911668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9858102790 0x7f9858074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f984000c920 tx=0x7f984000cde0 comp rx=0 tx=0).stop 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f98577fe640 1 -- 172.21.15.22:0/239911668 reap_dead start 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 shutdown_connections 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 >> 172.21.15.22:0/239911668 conn(0x7f98580fd8c0 msgr2=0x7f98580fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 shutdown_connections 2024-09-11T22:28:05.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:05.526+0000 7f985d6db640 1 -- 172.21.15.22:0/239911668 wait complete. 2024-09-11T22:28:06.174 INFO:teuthology.orchestra.run.smithi022.stdout:206158430249 2024-09-11T22:28:06.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T22:28:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:06 smithi022 ceph-mon[30966]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:06.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.412+0000 7fce6f151640 1 -- 172.21.15.22:0/924230309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68100e20 msgr2=0x7fce68101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.412+0000 7fce6f151640 1 --2- 172.21.15.22:0/924230309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68100e20 0x7fce68101200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce58009900 tx=0x7fce5802a480 comp rx=0 tx=0).stop 2024-09-11T22:28:06.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- 172.21.15.22:0/924230309 shutdown_connections 2024-09-11T22:28:06.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- 172.21.15.22:0/924230309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce68102ef0 0x7fce6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- 172.21.15.22:0/924230309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce68102570 0x7fce681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- 172.21.15.22:0/924230309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68100e20 0x7fce68101200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- 172.21.15.22:0/924230309 >> 172.21.15.22:0/924230309 conn(0x7fce680fc7d0 msgr2=0x7fce680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- 172.21.15.22:0/924230309 shutdown_connections 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- 172.21.15.22:0/924230309 wait complete. 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 Processor -- start 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- start start 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce68100e20 0x7fce681985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce68102570 0x7fce68198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 0x7fce6819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fce681110e0 con 0x7fce68102ef0 2024-09-11T22:28:06.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce68110f60 con 0x7fce68100e20 2024-09-11T22:28:06.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.413+0000 7fce6f151640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce68111260 con 0x7fce68102570 2024-09-11T22:28:06.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 0x7fce6819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 0x7fce6819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55302/0 (socket says 172.21.15.22:55302) 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 -- 172.21.15.22:0/1891349385 learned_addr learned my addr 172.21.15.22:0/1891349385 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce67fff640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce68102570 0x7fce68198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6ceed640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce68100e20 0x7fce681985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 -- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce68102570 msgr2=0x7fce68198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce68102570 0x7fce68198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 -- 172.21.15.22:0/1891349385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce68100e20 msgr2=0x7fce681985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce68100e20 0x7fce681985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6819d5a0 con 0x7fce68102ef0 2024-09-11T22:28:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6d6ee640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 0x7fce6819cec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b970 tx=0x7fce6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60019070 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6819d890 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce6000cb40 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60007700 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.414+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce681a5170 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.415+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce680fe1c0 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.416+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fce6001c070 con 0x7fce68102ef0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce65ffb640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce6ceed640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fce600cedc0 con 0x7fce68102ef0 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce65ffb640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] conn(0x7fce540ac450 0x7fce540ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce600047d0 con 0x7fce540ac450 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.417+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fce600cf170 con 0x7fce68102ef0 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.418+0000 7fce6ceed640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce58005ab0 tx=0x7fce58005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.418+0000 7fce67fff640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] conn(0x7fce540ac450 0x7fce540ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.418+0000 7fce67fff640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] conn(0x7fce540ac450 0x7fce540ae870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.419+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== osd.8 v2:172.21.15.169:6816/3945465196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce600047d0 con 0x7fce540ac450 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.433+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 --> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce681021b0 con 0x7fce540ac450 2024-09-11T22:28:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.433+0000 7fce65ffb640 1 -- 172.21.15.22:0/1891349385 <== osd.8 v2:172.21.15.169:6816/3945465196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fce681021b0 con 0x7fce540ac450 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] conn(0x7fce540ac450 msgr2=0x7fce540ae870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] conn(0x7fce540ac450 0x7fce540ae870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce540a2c10 msgr2=0x7fce540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce58005ab0 tx=0x7fce58005a20 comp rx=0 tx=0).stop 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 msgr2=0x7fce6819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 --2- 172.21.15.22:0/1891349385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce68102ef0 0x7fce6819cec0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b970 tx=0x7fce6000be30 comp rx=0 tx=0).stop 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6d6ee640 1 -- 172.21.15.22:0/1891349385 reap_dead start 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 shutdown_connections 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 >> 172.21.15.22:0/1891349385 conn(0x7fce680fc7d0 msgr2=0x7fce68105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 shutdown_connections 2024-09-11T22:28:06.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.434+0000 7fce6f151640 1 -- 172.21.15.22:0/1891349385 wait complete. 2024-09-11T22:28:06.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:06 smithi169 ceph-mon[35628]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:06.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:06 smithi045 ceph-mon[35556]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 -- 172.21.15.22:0/767896034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8101de0 msgr2=0x7f1ef81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 --2- 172.21.15.22:0/767896034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8101de0 0x7f1ef81021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009900 tx=0x7f1ee802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 -- 172.21.15.22:0/767896034 shutdown_connections 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 --2- 172.21.15.22:0/767896034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ef8106f10 0x7f1ef810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 --2- 172.21.15.22:0/767896034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef8102790 0x7f1ef81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 --2- 172.21.15.22:0/767896034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8101de0 0x7f1ef81021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 -- 172.21.15.22:0/767896034 >> 172.21.15.22:0/767896034 conn(0x7f1ef80fd8c0 msgr2=0x7f1ef80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:06.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 -- 172.21.15.22:0/767896034 shutdown_connections 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.965+0000 7f1efd267640 1 -- 172.21.15.22:0/767896034 wait complete. 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 Processor -- start 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 -- start start 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ef8101de0 0x7f1ef8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef8102790 0x7f1ef8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 0x7f1ef819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef81120d0 con 0x7f1ef8106f10 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8111f50 con 0x7f1ef8101de0 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1efd267640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8112250 con 0x7f1ef8102790 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 0x7f1ef819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 0x7f1ef819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55328/0 (socket says 172.21.15.22:55328) 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 -- 172.21.15.22:0/1394202783 learned_addr learned my addr 172.21.15.22:0/1394202783 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef67fc640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef8102790 0x7f1ef8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef6ffd640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ef8101de0 0x7f1ef8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 -- 172.21.15.22:0/1394202783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef8102790 msgr2=0x7f1ef8198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ef8102790 0x7f1ef8198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 -- 172.21.15.22:0/1394202783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ef8101de0 msgr2=0x7f1ef8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ef8101de0 0x7f1ef8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.966+0000 7f1ef77fe640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef819d540 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1ef77fe640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 0x7f1ef819ce60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000eaa0 tx=0x7f1ef000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000cdb0 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef819d830 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ef0004b20 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0011760 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.967+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef81a5110 con 0x7f1ef8106f10 2024-09-11T22:28:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.968+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ef8062980 con 0x7f1ef8106f10 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.969+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1ef0011900 con 0x7f1ef8106f10 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1edffff640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1ee00a2c10 0x7f1ee00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f1ef00cefd0 con 0x7f1ef8106f10 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1ef6ffd640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1ee00a2c10 0x7f1ee00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1edffff640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] conn(0x7f1ee00ac460 0x7f1ee00ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ef000fe50 con 0x7f1ee00ac460 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f1ef00d6050 con 0x7f1ef8106f10 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1ef67fc640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] conn(0x7f1ee00ac460 0x7f1ee00ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.970+0000 7f1ef6ffd640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1ee00a2c10 0x7f1ee00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8005ab0 tx=0x7f1ee8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.971+0000 7f1ef67fc640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] conn(0x7f1ee00ac460 0x7f1ee00ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:06.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.971+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== osd.6 v2:172.21.15.22:6818/3560259389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ef000fe50 con 0x7f1ee00ac460 2024-09-11T22:28:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.985+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 --> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ef8062e00 con 0x7f1ee00ac460 2024-09-11T22:28:06.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.985+0000 7f1edffff640 1 -- 172.21.15.22:0/1394202783 <== osd.6 v2:172.21.15.22:6818/3560259389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ef8062e00 con 0x7f1ee00ac460 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] conn(0x7f1ee00ac460 msgr2=0x7f1ee00ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] conn(0x7f1ee00ac460 0x7f1ee00ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1ee00a2c10 msgr2=0x7f1ee00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1ee00a2c10 0x7f1ee00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8005ab0 tx=0x7f1ee8005a20 comp rx=0 tx=0).stop 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 msgr2=0x7f1ef819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 --2- 172.21.15.22:0/1394202783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef8106f10 0x7f1ef819ce60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000eaa0 tx=0x7f1ef000ef60 comp rx=0 tx=0).stop 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1ef77fe640 1 -- 172.21.15.22:0/1394202783 reap_dead start 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 shutdown_connections 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 >> 172.21.15.22:0/1394202783 conn(0x7f1ef80fd8c0 msgr2=0x7f1ef80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:06.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 shutdown_connections 2024-09-11T22:28:06.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:06.986+0000 7f1efd267640 1 -- 172.21.15.22:0/1394202783 wait complete. 2024-09-11T22:28:07.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 -- 172.21.15.22:0/4158738127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 msgr2=0x7f251810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 --2- 172.21.15.22:0/4158738127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251810ea90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2510009ca0 tx=0x7f251002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 -- 172.21.15.22:0/4158738127 shutdown_connections 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 --2- 172.21.15.22:0/4158738127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251810ea90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 --2- 172.21.15.22:0/4158738127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2518102790 0x7f25181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 --2- 172.21.15.22:0/4158738127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518101de0 0x7f25181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 -- 172.21.15.22:0/4158738127 >> 172.21.15.22:0/4158738127 conn(0x7f25180fd8c0 msgr2=0x7f25180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.399+0000 7f251f2b2640 1 -- 172.21.15.22:0/4158738127 shutdown_connections 2024-09-11T22:28:07.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.400+0000 7f251f2b2640 1 -- 172.21.15.22:0/4158738127 wait complete. 2024-09-11T22:28:07.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.400+0000 7f251f2b2640 1 Processor -- start 2024-09-11T22:28:07.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.400+0000 7f251f2b2640 1 -- start start 2024-09-11T22:28:07.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2518101de0 0x7f2518198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518102790 0x7f2518198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25181120f0 con 0x7f2518106f10 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2518111f70 con 0x7f2518101de0 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251f2b2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2518112270 con 0x7f2518102790 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251819cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55344/0 (socket says 172.21.15.22:55344) 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 -- 172.21.15.22:0/2811786566 learned_addr learned my addr 172.21.15.22:0/2811786566 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d04e640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2518101de0 0x7f2518198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251c84d640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518102790 0x7f2518198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 -- 172.21.15.22:0/2811786566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518102790 msgr2=0x7f2518198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2518102790 0x7f2518198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 -- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2518101de0 msgr2=0x7f2518198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2518101de0 0x7f2518198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.401+0000 7f251d84f640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251819d600 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f251d84f640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251819cf20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2510009dc0 tx=0x7f2510031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251002fba0 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f251002fd40 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251819d890 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510046910 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.402+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25181a51d0 con 0x7f2518106f10 2024-09-11T22:28:07.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.404+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2518062900 con 0x7f2518106f10 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.405+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f25100305c0 con 0x7f2518106f10 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.406+0000 7f250e7fc640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f25040a2c90 0x7f25040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.407+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f25100f0520 con 0x7f2518106f10 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.407+0000 7f251d04e640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f25040a2c90 0x7f25040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.407+0000 7f250e7fc640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] conn(0x7f25040ac4e0 0x7f25040ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.407+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25040aefb0 con 0x7f25040ac4e0 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.407+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f25100f7050 con 0x7f2518106f10 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.408+0000 7f251c84d640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] conn(0x7f25040ac4e0 0x7f25040ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.408+0000 7f251d04e640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f25040a2c90 0x7f25040a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25140058c0 tx=0x7f251400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.408+0000 7f251c84d640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] conn(0x7f25040ac4e0 0x7f25040ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:07.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.409+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== osd.1 v2:172.21.15.45:6800/1690638458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25040aefb0 con 0x7f25040ac4e0 2024-09-11T22:28:07.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.424+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 --> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2518062d00 con 0x7f25040ac4e0 2024-09-11T22:28:07.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.425+0000 7f250e7fc640 1 -- 172.21.15.22:0/2811786566 <== osd.1 v2:172.21.15.45:6800/1690638458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2518062d00 con 0x7f25040ac4e0 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.425+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] conn(0x7f25040ac4e0 msgr2=0x7f25040ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.425+0000 7f251f2b2640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] conn(0x7f25040ac4e0 0x7f25040ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f25040a2c90 msgr2=0x7f25040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f25040a2c90 0x7f25040a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25140058c0 tx=0x7f251400a250 comp rx=0 tx=0).stop 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 msgr2=0x7f251819cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 --2- 172.21.15.22:0/2811786566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2518106f10 0x7f251819cf20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2510009dc0 tx=0x7f2510031b10 comp rx=0 tx=0).stop 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251d84f640 1 -- 172.21.15.22:0/2811786566 reap_dead start 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 shutdown_connections 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 >> 172.21.15.22:0/2811786566 conn(0x7f25180fd8c0 msgr2=0x7f25180fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 shutdown_connections 2024-09-11T22:28:07.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:07.426+0000 7f251f2b2640 1 -- 172.21.15.22:0/2811786566 wait complete. 2024-09-11T22:28:08.129 INFO:teuthology.orchestra.run.smithi022.stdout:240518168613 2024-09-11T22:28:08.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T22:28:08.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:08 smithi022 ceph-mon[30966]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:08.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:08 smithi169 ceph-mon[35628]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:08.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:08 smithi045 ceph-mon[35556]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:08.668 INFO:teuthology.orchestra.run.smithi022.stdout:270582939679 2024-09-11T22:28:08.669 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T22:28:09.216 INFO:teuthology.orchestra.run.smithi022.stdout:317827579925 2024-09-11T22:28:09.217 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T22:28:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 -- 172.21.15.22:0/1747820787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc101440 msgr2=0x7ffadc10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/1747820787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc101440 0x7ffadc10df30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009900 tx=0x7ffacc02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 -- 172.21.15.22:0/1747820787 shutdown_connections 2024-09-11T22:28:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/1747820787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffadc10e500 0x7ffadc110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/1747820787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc101440 0x7ffadc10df30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/1747820787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffadc100b20 0x7ffadc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 -- 172.21.15.22:0/1747820787 >> 172.21.15.22:0/1747820787 conn(0x7ffadc0fc7d0 msgr2=0x7ffadc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 -- 172.21.15.22:0/1747820787 shutdown_connections 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.382+0000 7ffae3bb9640 1 -- 172.21.15.22:0/1747820787 wait complete. 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 Processor -- start 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 -- start start 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffadc100b20 0x7ffadc1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffadc101440 0x7ffadc1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 0x7ffadc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc1143b0 con 0x7ffadc10e500 2024-09-11T22:28:09.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc114230 con 0x7ffadc101440 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae3bb9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc114530 con 0x7ffadc100b20 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae2156640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 0x7ffadc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.383+0000 7ffae2156640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 0x7ffadc19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55366/0 (socket says 172.21.15.22:55366) 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 -- 172.21.15.22:0/2886772776 learned_addr learned my addr 172.21.15.22:0/2886772776 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae1154640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffadc101440 0x7ffadc1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae1955640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffadc100b20 0x7ffadc1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 -- 172.21.15.22:0/2886772776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffadc100b20 msgr2=0x7ffadc1a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffadc100b20 0x7ffadc1a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 -- 172.21.15.22:0/2886772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffadc101440 msgr2=0x7ffadc1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffadc101440 0x7ffadc1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc19af00 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae2156640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 0x7ffadc19a690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffad400dac0 tx=0x7ffad400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad4017070 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad400be30 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffadc19b1f0 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad40106c0 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.384+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffadc1a7540 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.385+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffadc062940 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.387+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffad4003970 con 0x7ffadc10e500 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.387+0000 7ffad2ffd640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffac80a2c10 0x7ffac80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:09.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ffad40cf090 con 0x7ffadc10e500 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffae1955640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffac80a2c10 0x7ffac80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffad2ffd640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] conn(0x7ffac80ac460 0x7ffac80ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffac80aef30 con 0x7ffac80ac460 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ffad40cf440 con 0x7ffadc10e500 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffae1154640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] conn(0x7ffac80ac460 0x7ffac80ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:09.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffae1955640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffac80a2c10 0x7ffac80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005fd0 tx=0x7ffad800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.388+0000 7ffae1154640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] conn(0x7ffac80ac460 0x7ffac80ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.389+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== osd.0 v2:172.21.15.22:6802/1086761455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffac80aef30 con 0x7ffac80ac460 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.403+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 --> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffadc062dc0 con 0x7ffac80ac460 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffad2ffd640 1 -- 172.21.15.22:0/2886772776 <== osd.0 v2:172.21.15.22:6802/1086761455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffadc062dc0 con 0x7ffac80ac460 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] conn(0x7ffac80ac460 msgr2=0x7ffac80ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] conn(0x7ffac80ac460 0x7ffac80ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffac80a2c10 msgr2=0x7ffac80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffac80a2c10 0x7ffac80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005fd0 tx=0x7ffad800b390 comp rx=0 tx=0).stop 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 msgr2=0x7ffadc19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 --2- 172.21.15.22:0/2886772776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc10e500 0x7ffadc19a690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffad400dac0 tx=0x7ffad400df80 comp rx=0 tx=0).stop 2024-09-11T22:28:09.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae2156640 1 -- 172.21.15.22:0/2886772776 reap_dead start 2024-09-11T22:28:09.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 shutdown_connections 2024-09-11T22:28:09.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 >> 172.21.15.22:0/2886772776 conn(0x7ffadc0fc7d0 msgr2=0x7ffadc10f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:09.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 shutdown_connections 2024-09-11T22:28:09.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:09.404+0000 7ffae3bb9640 1 -- 172.21.15.22:0/2886772776 wait complete. 2024-09-11T22:28:10.225 INFO:teuthology.orchestra.run.smithi022.stdout:287762808857 2024-09-11T22:28:10.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T22:28:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:10 smithi022 ceph-mon[30966]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:10.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:10 smithi169 ceph-mon[35628]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:10.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:10 smithi045 ceph-mon[35556]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:28:10.703 INFO:teuthology.orchestra.run.smithi022.stdout:184683593774 2024-09-11T22:28:10.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T22:28:11.123 INFO:teuthology.orchestra.run.smithi022.stdout:55834574921 2024-09-11T22:28:11.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T22:28:11.188 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.592 INFO:teuthology.orchestra.run.smithi022.stdout:34359738446 2024-09-11T22:28:11.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T22:28:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.721 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:11.955 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:12.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:12 smithi022 ceph-mon[30966]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 -- 172.21.15.22:0/2076263086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 msgr2=0x7f7378106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 --2- 172.21.15.22:0/2076263086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f7378106e60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7374009930 tx=0x7f737402a420 comp rx=0 tx=0).stop 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 -- 172.21.15.22:0/2076263086 shutdown_connections 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 --2- 172.21.15.22:0/2076263086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378101420 0x7f737810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 --2- 172.21.15.22:0/2076263086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378100a80 0x7f7378100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 --2- 172.21.15.22:0/2076263086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f7378106e60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 -- 172.21.15.22:0/2076263086 >> 172.21.15.22:0/2076263086 conn(0x7f73780fc7a0 msgr2=0x7f73780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 -- 172.21.15.22:0/2076263086 shutdown_connections 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.538+0000 7f738007f640 1 -- 172.21.15.22:0/2076263086 wait complete. 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 Processor -- start 2024-09-11T22:28:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 -- start start 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378100a80 0x7f73780fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 0x7f73780fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7378110fe0 con 0x7f7378106a80 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7378110e60 con 0x7f7378100a80 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f738007f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7378111160 con 0x7f7378101420 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f737e61c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f737e61c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55390/0 (socket says 172.21.15.22:55390) 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.539+0000 7f737e61c640 1 -- 172.21.15.22:0/1700523616 learned_addr learned my addr 172.21.15.22:0/1700523616 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737de1b640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378100a80 0x7f73780fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737d61a640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 0x7f73780fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:12.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 -- 172.21.15.22:0/1700523616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 msgr2=0x7f73780fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 0x7f73780fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 -- 172.21.15.22:0/1700523616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378100a80 msgr2=0x7f73780fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378100a80 0x7f73780fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 -- 172.21.15.22:0/1700523616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73781a6a50 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737d61a640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 0x7f73780fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f737e61c640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f737000cce0 tx=0x7f737000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737000f450 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f737000faf0 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73781a6d40 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370018cc0 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.540+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73781a7230 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.541+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7378100ee0 con 0x7f7378106a80 2024-09-11T22:28:12.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.542+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f737000f5f0 con 0x7f7378106a80 2024-09-11T22:28:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.543+0000 7f736effd640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.543+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f73700cf4e0 con 0x7f7378106a80 2024-09-11T22:28:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.543+0000 7f737de1b640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.544+0000 7f737de1b640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 0x7f73640a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7374009900 tx=0x7f73740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:12.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.547+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7370014030 con 0x7f7378106a80 2024-09-11T22:28:12.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:12 smithi169 ceph-mon[35628]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T22:28:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:12 smithi045 ceph-mon[35556]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T22:28:12.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.729+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f737810a000 con 0x7f7378106a80 2024-09-11T22:28:12.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.729+0000 7f736effd640 1 -- 172.21.15.22:0/1700523616 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f737009c490 con 0x7f7378106a80 2024-09-11T22:28:12.730 INFO:teuthology.orchestra.run.smithi022.stdout:154618822708 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 msgr2=0x7f73640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 0x7f73640a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7374009900 tx=0x7f73740058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 msgr2=0x7f73780fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f737000cce0 tx=0x7f737000a620 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 shutdown_connections 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7378106a80 0x7f73780fd7c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f73640a2c10 0x7f73640a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7378101420 0x7f73780fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 --2- 172.21.15.22:0/1700523616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7378100a80 0x7f73780fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 >> 172.21.15.22:0/1700523616 conn(0x7f73780fc7a0 msgr2=0x7f737806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 shutdown_connections 2024-09-11T22:28:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:12.731+0000 7f738007f640 1 -- 172.21.15.22:0/1700523616 wait complete. 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 -- 172.21.15.22:0/2241406422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200106f10 msgr2=0x7fb20010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 --2- 172.21.15.22:0/2241406422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200106f10 0x7fb20010ea90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009ca0 tx=0x7fb1f802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 -- 172.21.15.22:0/2241406422 shutdown_connections 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 --2- 172.21.15.22:0/2241406422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200106f10 0x7fb20010ea90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 --2- 172.21.15.22:0/2241406422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 0x7fb2001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 --2- 172.21.15.22:0/2241406422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200101de0 0x7fb2001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 -- 172.21.15.22:0/2241406422 >> 172.21.15.22:0/2241406422 conn(0x7fb2000fd8c0 msgr2=0x7fb2000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:13.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 -- 172.21.15.22:0/2241406422 shutdown_connections 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.149+0000 7fb2053de640 1 -- 172.21.15.22:0/2241406422 wait complete. 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 Processor -- start 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 -- start start 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 0x7fb2001989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200106f10 0x7fb20019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2001120d0 con 0x7fb200101de0 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb200111f50 con 0x7fb200102790 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.150+0000 7fb2053de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb200112250 con 0x7fb200106f10 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55410/0 (socket says 172.21.15.22:55410) 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 -- 172.21.15.22:0/2478445178 learned_addr learned my addr 172.21.15.22:0/2478445178 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1ff7fe640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200106f10 0x7fb20019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1f7fff640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 0x7fb2001989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 -- 172.21.15.22:0/2478445178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200106f10 msgr2=0x7fb20019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200106f10 0x7fb20019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 -- 172.21.15.22:0/2478445178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 msgr2=0x7fb2001989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 0x7fb2001989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 -- 172.21.15.22:0/2478445178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20019d460 con 0x7fb200101de0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1feffd640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b4a0 tx=0x7fb1f000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0015020 con 0x7fb200101de0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb1f0011d30 con 0x7fb200101de0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000f2e0 con 0x7fb200101de0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20019d750 con 0x7fb200101de0 2024-09-11T22:28:13.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.151+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2001a5030 con 0x7fb200101de0 2024-09-11T22:28:13.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.152+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e0005290 con 0x7fb200101de0 2024-09-11T22:28:13.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.154+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb1f0018020 con 0x7fb200101de0 2024-09-11T22:28:13.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.155+0000 7fb1fcff9640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 0x7fb1ec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.155+0000 7fb1f7fff640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 0x7fb1ec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.155+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb1f00ceae0 con 0x7fb200101de0 2024-09-11T22:28:13.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.155+0000 7fb1f7fff640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 0x7fb1ec0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2001088a0 tx=0x7fb1e800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:13.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.158+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1f001f020 con 0x7fb200101de0 2024-09-11T22:28:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.337+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb1e0005850 con 0x7fb200101de0 2024-09-11T22:28:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.337+0000 7fb1fcff9640 1 -- 172.21.15.22:0/2478445178 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1f009baa0 con 0x7fb200101de0 2024-09-11T22:28:13.338 INFO:teuthology.orchestra.run.smithi022.stdout:73014444101 2024-09-11T22:28:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 msgr2=0x7fb1ec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 0x7fb1ec0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2001088a0 tx=0x7fb1e800a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 msgr2=0x7fb2001984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b4a0 tx=0x7fb1f000b8a0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 shutdown_connections 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb1ec0a2c90 0x7fb1ec0a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb200106f10 0x7fb20019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb200102790 0x7fb2001989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 --2- 172.21.15.22:0/2478445178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb200101de0 0x7fb2001984b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 >> 172.21.15.22:0/2478445178 conn(0x7fb2000fd8c0 msgr2=0x7fb2000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 shutdown_connections 2024-09-11T22:28:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.339+0000 7fb2053de640 1 -- 172.21.15.22:0/2478445178 wait complete. 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 -- 172.21.15.22:0/1561353134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4100e20 msgr2=0x7fd8a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 --2- 172.21.15.22:0/1561353134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4100e20 0x7fd8a4101200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009900 tx=0x7fd8a002a480 comp rx=0 tx=0).stop 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 -- 172.21.15.22:0/1561353134 shutdown_connections 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 --2- 172.21.15.22:0/1561353134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4102ef0 0x7fd8a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 --2- 172.21.15.22:0/1561353134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 0x7fd8a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 --2- 172.21.15.22:0/1561353134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4100e20 0x7fd8a4101200 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.371+0000 7fd8abf53640 1 -- 172.21.15.22:0/1561353134 >> 172.21.15.22:0/1561353134 conn(0x7fd8a40fc7d0 msgr2=0x7fd8a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- 172.21.15.22:0/1561353134 shutdown_connections 2024-09-11T22:28:13.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- 172.21.15.22:0/1561353134 wait complete. 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 Processor -- start 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- start start 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4100e20 0x7fd8a4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 0x7fd8a4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a41110a0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a4110f20 con 0x7fd8a4102570 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8abf53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a4111220 con 0x7fd8a4100e20 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.372+0000 7fd8aa4f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55418/0 (socket says 172.21.15.22:55418) 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 -- 172.21.15.22:0/735863094 learned_addr learned my addr 172.21.15.22:0/735863094 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8a9cef640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4100e20 0x7fd8a4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8a94ee640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 0x7fd8a4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 -- 172.21.15.22:0/735863094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4100e20 msgr2=0x7fd8a4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4100e20 0x7fd8a4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 -- 172.21.15.22:0/735863094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 msgr2=0x7fd8a4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 0x7fd8a4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 -- 172.21.15.22:0/735863094 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a419d4c0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8aa4f0640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00cce0 tx=0x7fd89c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00f450 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a419d7b0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd89c00faf0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c018cc0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.373+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a41a5090 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.374+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a4101200 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.375+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd89c00f5f0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.376+0000 7fd89affd640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 0x7fd8900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:13.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.376+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd89c0cf480 con 0x7fd8a4102ef0 2024-09-11T22:28:13.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.376+0000 7fd8a9cef640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 0x7fd8900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:13.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.377+0000 7fd8a9cef640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 0x7fd8900a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009230 tx=0x7fd8a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:13.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.383+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd89c014030 con 0x7fd8a4102ef0 2024-09-11T22:28:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.559+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd8a41a52f0 con 0x7fd8a4102ef0 2024-09-11T22:28:13.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.560+0000 7fd89affd640 1 -- 172.21.15.22:0/735863094 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd89c09c430 con 0x7fd8a4102ef0 2024-09-11T22:28:13.561 INFO:teuthology.orchestra.run.smithi022.stdout:133143986233 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 msgr2=0x7fd8900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 0x7fd8900a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009230 tx=0x7fd8a00058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 msgr2=0x7fd8a419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00cce0 tx=0x7fd89c00a620 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 shutdown_connections 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8a4102ef0 0x7fd8a419cde0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8a4102570 0x7fd8a4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd8900a2c10 0x7fd8900a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 --2- 172.21.15.22:0/735863094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8a4100e20 0x7fd8a4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 >> 172.21.15.22:0/735863094 conn(0x7fd8a40fc7d0 msgr2=0x7fd8a406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:13.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 shutdown_connections 2024-09-11T22:28:13.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:13.562+0000 7fd8abf53640 1 -- 172.21.15.22:0/735863094 wait complete. 2024-09-11T22:28:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:13 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1700523616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:28:13.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:13 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1700523616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:28:13.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:13 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1700523616' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:28:14.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986230 got 133143986233 for osd.4 2024-09-11T22:28:14.153 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 -- 172.21.15.22:0/2433152304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994101420 msgr2=0x7fa99410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 --2- 172.21.15.22:0/2433152304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994101420 0x7fa99410d950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009930 tx=0x7fa98c02a420 comp rx=0 tx=0).stop 2024-09-11T22:28:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 -- 172.21.15.22:0/2433152304 shutdown_connections 2024-09-11T22:28:14.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 --2- 172.21.15.22:0/2433152304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994101420 0x7fa99410d950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 --2- 172.21.15.22:0/2433152304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994100a80 0x7fa994100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 --2- 172.21.15.22:0/2433152304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 0x7fa994106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 -- 172.21.15.22:0/2433152304 >> 172.21.15.22:0/2433152304 conn(0x7fa9940fc7a0 msgr2=0x7fa9940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 -- 172.21.15.22:0/2433152304 shutdown_connections 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.335+0000 7fa99adc0640 1 -- 172.21.15.22:0/2433152304 wait complete. 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 Processor -- start 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 -- start start 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994101420 0x7fa994198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 0x7fa99419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa994110fa0 con 0x7fa994100a80 2024-09-11T22:28:14.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa994110e20 con 0x7fa994106a80 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99adc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa994111120 con 0x7fa994101420 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60766/0 (socket says 172.21.15.22:60766) 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 -- 172.21.15.22:0/75232636 learned_addr learned my addr 172.21.15.22:0/75232636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa993fff640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994101420 0x7fa994198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa99935d640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 0x7fa99419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 -- 172.21.15.22:0/75232636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994101420 msgr2=0x7fa994198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994101420 0x7fa994198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 -- 172.21.15.22:0/75232636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 msgr2=0x7fa99419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 0x7fa99419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 -- 172.21.15.22:0/75232636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99419d530 con 0x7fa994100a80 2024-09-11T22:28:14.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.336+0000 7fa998b5c640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d950 tx=0x7fa97c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.337+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c017070 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.337+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa97c009c30 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.337+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00f740 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.337+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99419d820 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.337+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9941a5100 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.338+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa994100ee0 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.339+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa97c010a80 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.340+0000 7fa991ffb640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 0x7fa9800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.340+0000 7fa993fff640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 0x7fa9800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.340+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa97c0cecb0 con 0x7fa994100a80 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.340+0000 7fa993fff640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 0x7fa9800a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9941051b0 tx=0x7fa984009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:14.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.344+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa97c009de0 con 0x7fa994100a80 2024-09-11T22:28:14.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:14 smithi022 ceph-mon[30966]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:14.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:14 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2478445178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:28:14.385 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:14 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/735863094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:28:14.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.524+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa99410a080 con 0x7fa994100a80 2024-09-11T22:28:14.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.525+0000 7fa991ffb640 1 -- 172.21.15.22:0/75232636 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa97c09bb60 con 0x7fa994100a80 2024-09-11T22:28:14.526 INFO:teuthology.orchestra.run.smithi022.stdout:103079215167 2024-09-11T22:28:14.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 msgr2=0x7fa9800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 0x7fa9800a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9941051b0 tx=0x7fa984009680 comp rx=0 tx=0).stop 2024-09-11T22:28:14.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 msgr2=0x7fa994198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d950 tx=0x7fa97c00de10 comp rx=0 tx=0).stop 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 shutdown_connections 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa994106a80 0x7fa99419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fa9800a2c90 0x7fa9800a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa994101420 0x7fa994198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 --2- 172.21.15.22:0/75232636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa994100a80 0x7fa994198580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 >> 172.21.15.22:0/75232636 conn(0x7fa9940fc7a0 msgr2=0x7fa99406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 shutdown_connections 2024-09-11T22:28:14.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:14.527+0000 7fa99adc0640 1 -- 172.21.15.22:0/75232636 wait complete. 2024-09-11T22:28:14.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:14 smithi169 ceph-mon[35628]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:14 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2478445178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:28:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:14 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/735863094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:28:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:14 smithi045 ceph-mon[35556]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:14 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2478445178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:28:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:14 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/735863094' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:28:15.548 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215167 for osd.3 2024-09-11T22:28:15.548 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:15.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:15 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/75232636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:28:15.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:15 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/75232636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:28:15.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:15 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/75232636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 -- 172.21.15.22:0/370583607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588102790 msgr2=0x7fe5881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 --2- 172.21.15.22:0/370583607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588102790 0x7fe5881067e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009900 tx=0x7fe57c02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 -- 172.21.15.22:0/370583607 shutdown_connections 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 --2- 172.21.15.22:0/370583607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 0x7fe58810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 --2- 172.21.15.22:0/370583607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588102790 0x7fe5881067e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 --2- 172.21.15.22:0/370583607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588101de0 0x7fe5881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 -- 172.21.15.22:0/370583607 >> 172.21.15.22:0/370583607 conn(0x7fe5880fd8c0 msgr2=0x7fe5880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:15.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 -- 172.21.15.22:0/370583607 shutdown_connections 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.709+0000 7fe58dd87640 1 -- 172.21.15.22:0/370583607 wait complete. 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 Processor -- start 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 -- start start 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 0x7fe58819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe588112150 con 0x7fe588101de0 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe588111fd0 con 0x7fe588102790 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe58dd87640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881122d0 con 0x7fe588106f10 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe586ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:59802/0 (socket says 172.21.15.22:59802) 2024-09-11T22:28:15.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe586ffd640 1 -- 172.21.15.22:0/502083055 learned_addr learned my addr 172.21.15.22:0/502083055 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe5877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60782/0 (socket says 172.21.15.22:60782) 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.710+0000 7fe587fff640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 0x7fe58819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 -- 172.21.15.22:0/502083055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 msgr2=0x7fe58819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 0x7fe58819cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 -- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 msgr2=0x7fe588198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 -- 172.21.15.22:0/502083055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58819d6c0 con 0x7fe588102790 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe5877fe640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe586ffd640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe57c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c03f030 con 0x7fe588102790 2024-09-11T22:28:15.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58819d950 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe57c003d00 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c035070 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.711+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe588074420 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.712+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5881032c0 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.714+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe57c042030 con 0x7fe588102790 2024-09-11T22:28:15.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.714+0000 7fe584ff9640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 0x7fe5700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:15.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.714+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe57c0ef8a0 con 0x7fe588102790 2024-09-11T22:28:15.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.714+0000 7fe5877fe640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 0x7fe5700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:15.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.715+0000 7fe5877fe640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 0x7fe5700a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe57800dfd0 tx=0x7fe57800f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:15.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.718+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe57c0bc850 con 0x7fe588102790 2024-09-11T22:28:15.762 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:15.762 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:15.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.912+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe58810a0f0 con 0x7fe588102790 2024-09-11T22:28:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.912+0000 7fe584ff9640 1 -- 172.21.15.22:0/502083055 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe57c0bc150 con 0x7fe588102790 2024-09-11T22:28:15.913 INFO:teuthology.orchestra.run.smithi022.stdout:240518168614 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 msgr2=0x7fe5700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 0x7fe5700a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe57800dfd0 tx=0x7fe57800f040 comp rx=0 tx=0).stop 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 msgr2=0x7fe588198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe57c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 shutdown_connections 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe5700a2c10 0x7fe5700a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe588106f10 0x7fe58819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe588102790 0x7fe588198c50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 --2- 172.21.15.22:0/502083055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe588101de0 0x7fe588198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.914+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 >> 172.21.15.22:0/502083055 conn(0x7fe5880fd8c0 msgr2=0x7fe5880fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.915+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 shutdown_connections 2024-09-11T22:28:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:15.915+0000 7fe58dd87640 1 -- 172.21.15.22:0/502083055 wait complete. 2024-09-11T22:28:16.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:16 smithi022 ceph-mon[30966]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-11T22:28:16.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:16 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/502083055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:28:16.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:16 smithi169 ceph-mon[35628]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-11T22:28:16.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:16 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/502083055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:28:16.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:16 smithi045 ceph-mon[35556]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-11T22:28:16.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:16 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/502083055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:28:16.754 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168613 got 240518168614 for osd.8 2024-09-11T22:28:16.754 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- 172.21.15.22:0/3480854132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 msgr2=0x7fe0d8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3480854132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8100ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009930 tx=0x7fe0cc02a420 comp rx=0 tx=0).stop 2024-09-11T22:28:17.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- 172.21.15.22:0/3480854132 shutdown_connections 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3480854132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8101420 0x7fe0d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3480854132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8100ee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3480854132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8106a80 0x7fe0d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- 172.21.15.22:0/3480854132 >> 172.21.15.22:0/3480854132 conn(0x7fe0d80fc7a0 msgr2=0x7fe0d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- 172.21.15.22:0/3480854132 shutdown_connections 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- 172.21.15.22:0/3480854132 wait complete. 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 Processor -- start 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.507+0000 7fe0dded4640 1 -- start start 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 0x7fe0d8198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8106a80 0x7fe0d819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8111000 con 0x7fe0d8100a80 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8110e80 con 0x7fe0d8106a80 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8111180 con 0x7fe0d8101420 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60810/0 (socket says 172.21.15.22:60810) 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 -- 172.21.15.22:0/3510138194 learned_addr learned my addr 172.21.15.22:0/3510138194 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d6ffd640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 0x7fe0d8198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 -- 172.21.15.22:0/3510138194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 msgr2=0x7fe0d8198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 0x7fe0d8198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 -- 172.21.15.22:0/3510138194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8106a80 msgr2=0x7fe0d819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d7fff640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8106a80 0x7fe0d819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8106a80 0x7fe0d819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 -- 172.21.15.22:0/3510138194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d819d530 con 0x7fe0d8100a80 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d6ffd640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 0x7fe0d8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:17.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d77fe640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800d770 tx=0x7fe0c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8017070 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d819d820 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.508+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0c8005520 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.509+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8010460 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.509+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81a5100 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.509+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d8100ee0 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.511+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe0c8004ea0 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.511+0000 7fe0d4ff9640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 0x7fe0c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.511+0000 7fe0d6ffd640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 0x7fe0c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.511+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe0c80cec00 con 0x7fe0d8100a80 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.512+0000 7fe0d6ffd640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 0x7fe0c00a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:17.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.516+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0c80d4020 con 0x7fe0d8100a80 2024-09-11T22:28:17.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.694+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe0d81a5330 con 0x7fe0d8100a80 2024-09-11T22:28:17.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.694+0000 7fe0d4ff9640 1 -- 172.21.15.22:0/3510138194 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe0c809bbb0 con 0x7fe0d8100a80 2024-09-11T22:28:17.695 INFO:teuthology.orchestra.run.smithi022.stdout:184683593776 2024-09-11T22:28:17.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 msgr2=0x7fe0c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 0x7fe0c00a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc032c80 comp rx=0 tx=0).stop 2024-09-11T22:28:17.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 msgr2=0x7fe0d8198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800d770 tx=0x7fe0c800dc30 comp rx=0 tx=0).stop 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 shutdown_connections 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d8106a80 0x7fe0d819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe0c00a2c10 0x7fe0c00a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0d8101420 0x7fe0d8198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 --2- 172.21.15.22:0/3510138194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d8100a80 0x7fe0d8198580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.696+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 >> 172.21.15.22:0/3510138194 conn(0x7fe0d80fc7a0 msgr2=0x7fe0d81047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.697+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 shutdown_connections 2024-09-11T22:28:17.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.697+0000 7fe0dded4640 1 -- 172.21.15.22:0/3510138194 wait complete. 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/1890402433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64101de0 msgr2=0x7f6d641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/1890402433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64101de0 0x7f6d641021c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009900 tx=0x7f6d5802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/1890402433 shutdown_connections 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/1890402433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64106f10 0x7f6d6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/1890402433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64102790 0x7f6d641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/1890402433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64101de0 0x7f6d641021c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/1890402433 >> 172.21.15.22:0/1890402433 conn(0x7f6d640fd8c0 msgr2=0x7f6d640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/1890402433 shutdown_connections 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.744+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/1890402433 wait complete. 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 Processor -- start 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 -- start start 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64101de0 0x7f6d640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64102790 0x7f6d64074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64112090 con 0x7f6d64106f10 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64111f10 con 0x7f6d64101de0 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d6ab5d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64112210 con 0x7f6d64102790 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d690fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d690fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60826/0 (socket says 172.21.15.22:60826) 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d690fa640 1 -- 172.21.15.22:0/2429147359 learned_addr learned my addr 172.21.15.22:0/2429147359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d688f9640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64101de0 0x7f6d640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.745+0000 7f6d63fff640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64102790 0x7f6d64074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 -- 172.21.15.22:0/2429147359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64102790 msgr2=0x7f6d64074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64102790 0x7f6d64074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 -- 172.21.15.22:0/2429147359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64101de0 msgr2=0x7f6d640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64101de0 0x7f6d640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 -- 172.21.15.22:0/2429147359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d641a69f0 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d690fa640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00cad0 tx=0x7f6d5c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00ae20 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d5c004b20 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d641a6ce0 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00f780 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.746+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d641a71d0 con 0x7f6d64106f10 2024-09-11T22:28:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.747+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d641021c0 con 0x7f6d64106f10 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.748+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d5c004cd0 con 0x7f6d64106f10 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.749+0000 7f6d61ffb640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 0x7f6d540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.749+0000 7f6d688f9640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 0x7f6d540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.749+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f6d5c0cef90 con 0x7f6d64106f10 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.750+0000 7f6d688f9640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 0x7f6d540a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009230 tx=0x7f6d580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.753+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d5c014030 con 0x7f6d64106f10 2024-09-11T22:28:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.930+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6d6410a0f0 con 0x7f6d64106f10 2024-09-11T22:28:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.930+0000 7f6d61ffb640 1 -- 172.21.15.22:0/2429147359 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6d5c09b8f0 con 0x7f6d64106f10 2024-09-11T22:28:17.931 INFO:teuthology.orchestra.run.smithi022.stdout:317827579928 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 msgr2=0x7f6d540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 0x7f6d540a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009230 tx=0x7f6d580058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 msgr2=0x7f6d64074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00cad0 tx=0x7f6d5c00cf90 comp rx=0 tx=0).stop 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 shutdown_connections 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d64106f10 0x7f6d64074f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6d540a2c10 0x7f6d540a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d64102790 0x7f6d64074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 --2- 172.21.15.22:0/2429147359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d64101de0 0x7f6d640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 >> 172.21.15.22:0/2429147359 conn(0x7f6d640fd8c0 msgr2=0x7f6d640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 shutdown_connections 2024-09-11T22:28:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:17.932+0000 7f6d6ab5d640 1 -- 172.21.15.22:0/2429147359 wait complete. 2024-09-11T22:28:18.606 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:18 smithi022 ceph-mon[30966]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:18.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:18 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3510138194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:28:18.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:18 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2429147359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:28:18.637 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593774 got 184683593776 for osd.6 2024-09-11T22:28:18.638 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:18 smithi169 ceph-mon[35628]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:18 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3510138194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:28:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:18 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2429147359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:28:18.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:18 smithi045 ceph-mon[35556]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:18.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:18 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3510138194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:28:18.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:18 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2429147359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:28:19.056 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:19.076 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579925 got 317827579928 for osd.11 2024-09-11T22:28:19.076 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:19.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822706 got 154618822708 for osd.5 2024-09-11T22:28:19.634 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 -- 172.21.15.22:0/3489611704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c1036c0 msgr2=0x7f760c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 --2- 172.21.15.22:0/3489611704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c1036c0 0x7f760c10bbb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7600009900 tx=0x7f760002a480 comp rx=0 tx=0).stop 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 -- 172.21.15.22:0/3489611704 shutdown_connections 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 --2- 172.21.15.22:0/3489611704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 0x7f760c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 --2- 172.21.15.22:0/3489611704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c1036c0 0x7f760c10bbb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 --2- 172.21.15.22:0/3489611704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c102da0 0x7f760c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 -- 172.21.15.22:0/3489611704 >> 172.21.15.22:0/3489611704 conn(0x7f760c0fc7a0 msgr2=0x7f760c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.274+0000 7f7611bed640 1 -- 172.21.15.22:0/3489611704 shutdown_connections 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.275+0000 7f7611bed640 1 -- 172.21.15.22:0/3489611704 wait complete. 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.275+0000 7f7611bed640 1 Processor -- start 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.275+0000 7f7611bed640 1 -- start start 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.275+0000 7f7611bed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7611bed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c1036c0 0x7f760c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7611bed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 0x7f760c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7611bed640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f760c112080 con 0x7f760c102da0 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7611bed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f760c111f00 con 0x7f760c10c180 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7611bed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f760c112200 con 0x7f760c1036c0 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:20.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60842/0 (socket says 172.21.15.22:60842) 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 -- 172.21.15.22:0/1818475774 learned_addr learned my addr 172.21.15.22:0/1818475774 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stdout:287762808860 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760bfff640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 0x7f760c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760affd640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c1036c0 0x7f760c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 -- 172.21.15.22:0/1818475774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c1036c0 msgr2=0x7f760c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c1036c0 0x7f760c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 -- 172.21.15.22:0/1818475774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 msgr2=0x7f760c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 0x7f760c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 -- 172.21.15.22:0/1818475774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c19d460 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f760b7fe640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00cce0 tx=0x7f75fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc004b20 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.276+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75fc004cc0 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.277+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760c19d750 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.277+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00f8c0 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.277+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760c1a5030 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.278+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760c103180 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.279+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f75fc0056b0 con 0x7f760c102da0 2024-09-11T22:28:20.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.279+0000 7f7608ff9640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 0x7f75f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.280+0000 7f760affd640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 0x7f75f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.280+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f75fc0cf1a0 con 0x7f760c102da0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.280+0000 7f760affd640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 0x7f75f40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f760c10d5a0 tx=0x7f76000095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.284+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75fc014030 con 0x7f760c102da0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.467+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f760c02d7c0 con 0x7f760c102da0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.467+0000 7f7608ff9640 1 -- 172.21.15.22:0/1818475774 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f75fc09c150 con 0x7f760c102da0 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 msgr2=0x7f75f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 0x7f75f40a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f760c10d5a0 tx=0x7f76000095f0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 msgr2=0x7f760c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00cce0 tx=0x7f75fc00a620 comp rx=0 tx=0).stop 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 shutdown_connections 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f760c10c180 0x7f760c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f75f40a2c10 0x7f75f40a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f760c1036c0 0x7f760c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 --2- 172.21.15.22:0/1818475774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f760c102da0 0x7f760c1984b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 >> 172.21.15.22:0/1818475774 conn(0x7f760c0fc7a0 msgr2=0x7f760c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:20.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 shutdown_connections 2024-09-11T22:28:20.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:19.470+0000 7f7611bed640 1 -- 172.21.15.22:0/1818475774 wait complete. 2024-09-11T22:28:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:20 smithi022 ceph-mon[30966]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:20 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1818475774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:28:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:20 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:20.559 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:20 smithi045 ceph-mon[35556]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:20.560 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:20 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1818475774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:28:20.560 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:20 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:20.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:20 smithi169 ceph-mon[35628]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:20.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:20 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1818475774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:28:20.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:20 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:20.748 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808860 for osd.10 2024-09-11T22:28:20.748 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:21.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444101 for osd.2 2024-09-11T22:28:21.199 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 -- 172.21.15.22:0/1196825290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434108300 msgr2=0x7f843410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 --2- 172.21.15.22:0/1196825290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434108300 0x7f843410ec70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f842c009cd0 tx=0x7f842c02a8d0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 -- 172.21.15.22:0/1196825290 shutdown_connections 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 --2- 172.21.15.22:0/1196825290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434108300 0x7f843410ec70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 --2- 172.21.15.22:0/1196825290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434103780 0x7f8434107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 --2- 172.21.15.22:0/1196825290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434102dd0 0x7f84341031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 -- 172.21.15.22:0/1196825290 >> 172.21.15.22:0/1196825290 conn(0x7f84340fc7d0 msgr2=0x7f84340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 -- 172.21.15.22:0/1196825290 shutdown_connections 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.487+0000 7f8438b59640 1 -- 172.21.15.22:0/1196825290 wait complete. 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 Processor -- start 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 -- start start 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434102dd0 0x7f84341a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 0x7f843419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84341121f0 con 0x7f8434103780 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8434112070 con 0x7f8434108300 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8438b59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8434112370 con 0x7f8434102dd0 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8431d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8431d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60880/0 (socket says 172.21.15.22:60880) 2024-09-11T22:28:21.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.488+0000 7f8431d9b640 1 -- 172.21.15.22:0/608037605 learned_addr learned my addr 172.21.15.22:0/608037605 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:21.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8432d9d640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 0x7f843419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f843259c640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434102dd0 0x7f84341a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 -- 172.21.15.22:0/608037605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434102dd0 msgr2=0x7f84341a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434102dd0 0x7f84341a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 -- 172.21.15.22:0/608037605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 msgr2=0x7f843419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 0x7f843419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 -- 172.21.15.22:0/608037605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843419afe0 con 0x7f8434103780 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8432d9d640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 0x7f843419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8431d9b640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c00e9c0 tx=0x7f841c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00ccc0 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f841c005520 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843419b2d0 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.489+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c010690 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.490+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341a7620 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.491+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843406a7b0 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.492+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f841c0046c0 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.493+0000 7f842b7fe640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 0x7f84200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.493+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f841c0cf480 con 0x7f8434103780 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.493+0000 7f843259c640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 0x7f84200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.494+0000 7f843259c640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 0x7f84200a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8424009bd0 tx=0x7f8424005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:21.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.500+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f841c0541b0 con 0x7f8434103780 2024-09-11T22:28:21.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.684+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f843419bca0 con 0x7f8434103780 2024-09-11T22:28:21.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.685+0000 7f842b7fe640 1 -- 172.21.15.22:0/608037605 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f841c09c430 con 0x7f8434103780 2024-09-11T22:28:21.687 INFO:teuthology.orchestra.run.smithi022.stdout:270582939682 2024-09-11T22:28:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 msgr2=0x7f84200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 0x7f84200a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8424009bd0 tx=0x7f8424005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 msgr2=0x7f84341a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c00e9c0 tx=0x7f841c00ee80 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 shutdown_connections 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434108300 0x7f843419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103780 0x7f84341a0be0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f84200a2c90 0x7f84200a5150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 --2- 172.21.15.22:0/608037605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8434102dd0 0x7f84341a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 >> 172.21.15.22:0/608037605 conn(0x7f84340fc7d0 msgr2=0x7f8434101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 shutdown_connections 2024-09-11T22:28:21.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.687+0000 7f8438b59640 1 -- 172.21.15.22:0/608037605 wait complete. 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/2313053720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 msgr2=0x7f5e6810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/2313053720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e6810e610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ca0 tx=0x7f5e6002a950 comp rx=0 tx=0).stop 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/2313053720 shutdown_connections 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/2313053720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e6810e610 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/2313053720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 0x7f5e6810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/2313053720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e68103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/2313053720 >> 172.21.15.22:0/2313053720 conn(0x7f5e680fc7a0 msgr2=0x7f5e680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/2313053720 shutdown_connections 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.390+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/2313053720 wait complete. 2024-09-11T22:28:21.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 Processor -- start 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 -- start start 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e681009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 0x7f5e68100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681120b0 con 0x7f5e6810c170 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5e68111f30 con 0x7f5e68103660 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6e7e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5e68112230 con 0x7f5e68102d40 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60856/0 (socket says 172.21.15.22:60856) 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 -- 172.21.15.22:0/3815102766 learned_addr learned my addr 172.21.15.22:0/3815102766 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e677fe640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 0x7f5e68100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e67fff640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e681009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 -- 172.21.15.22:0/3815102766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 msgr2=0x7f5e681009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e681009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 -- 172.21.15.22:0/3815102766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 msgr2=0x7f5e68100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 0x7f5e68100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e6cd85640 1 -- 172.21.15.22:0/3815102766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e681a6a10 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.391+0000 7f5e67fff640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e681009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e6cd85640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005cc0 tx=0x7f5e6002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60034040 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e681a6ca0 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e60030940 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e600456e0 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.392+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e681a71d0 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.393+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e68103120 con 0x7f5e6810c170 2024-09-11T22:28:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.394+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5e60037020 con 0x7f5e6810c170 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.395+0000 7f5e657fa640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 0x7f5e500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.395+0000 7f5e67fff640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 0x7f5e500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.395+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5e600eff00 con 0x7f5e6810c170 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.395+0000 7f5e67fff640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 0x7f5e500a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e580058c0 tx=0x7f5e58005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.399+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e600bcfc0 con 0x7f5e6810c170 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.582+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5e68107210 con 0x7f5e6810c170 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.582+0000 7f5e657fa640 1 -- 172.21.15.22:0/3815102766 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e600bc8c0 con 0x7f5e6810c170 2024-09-11T22:28:21.855 INFO:teuthology.orchestra.run.smithi022.stdout:55834574923 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 msgr2=0x7f5e500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 0x7f5e500a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e580058c0 tx=0x7f5e58005850 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 msgr2=0x7f5e68101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5e60005cc0 tx=0x7f5e6002f790 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 shutdown_connections 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e6810c170 0x7f5e68101420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e68103660 0x7f5e68100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5e500a2c90 0x7f5e500a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 --2- 172.21.15.22:0/3815102766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e68102d40 0x7f5e681009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 >> 172.21.15.22:0/3815102766 conn(0x7f5e680fc7a0 msgr2=0x7f5e680fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 shutdown_connections 2024-09-11T22:28:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:21.584+0000 7f5e6e7e8640 1 -- 172.21.15.22:0/3815102766 wait complete. 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3815102766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:28:22.313 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/608037605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 -- 172.21.15.22:0/2132281209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c102790 msgr2=0x7ffa0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 --2- 172.21.15.22:0/2132281209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c102790 0x7ffa0c1067e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009900 tx=0x7ff9fc02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 -- 172.21.15.22:0/2132281209 shutdown_connections 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 --2- 172.21.15.22:0/2132281209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 --2- 172.21.15.22:0/2132281209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c102790 0x7ffa0c1067e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 --2- 172.21.15.22:0/2132281209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c101de0 0x7ffa0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 -- 172.21.15.22:0/2132281209 >> 172.21.15.22:0/2132281209 conn(0x7ffa0c0fd8c0 msgr2=0x7ffa0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 -- 172.21.15.22:0/2132281209 shutdown_connections 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 -- 172.21.15.22:0/2132281209 wait complete. 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.313+0000 7ffa14405640 1 Processor -- start 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 -- start start 2024-09-11T22:28:22.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 0x7ffa0c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c112090 con 0x7ffa0c101de0 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111f10 con 0x7ffa0c106f10 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa14405640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c112210 con 0x7ffa0c102790 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60898/0 (socket says 172.21.15.22:60898) 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 -- 172.21.15.22:0/1950359242 learned_addr learned my addr 172.21.15.22:0/1950359242 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:22.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa119a0640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 0x7ffa0c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa129a2640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 -- 172.21.15.22:0/1950359242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 msgr2=0x7ffa0c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 0x7ffa0c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 -- 172.21.15.22:0/1950359242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 msgr2=0x7ffa0c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 -- 172.21.15.22:0/1950359242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c19d500 con 0x7ffa0c101de0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa119a0640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 0x7ffa0c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa129a2640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.314+0000 7ffa121a1640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d770 tx=0x7ffa0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.315+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08017070 con 0x7ffa0c101de0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.315+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa08005520 con 0x7ffa0c101de0 2024-09-11T22:28:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.315+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c19d7f0 con 0x7ffa0c101de0 2024-09-11T22:28:22.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.315+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08010460 con 0x7ffa0c101de0 2024-09-11T22:28:22.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.315+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c1a50d0 con 0x7ffa0c101de0 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.316+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0c1021c0 con 0x7ffa0c101de0 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.318+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa08004ea0 con 0x7ffa0c101de0 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.318+0000 7ffa037fe640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 0x7ff9f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.319+0000 7ffa119a0640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 0x7ff9f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.319+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ffa080cf0c0 con 0x7ffa0c101de0 2024-09-11T22:28:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.319+0000 7ffa119a0640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 0x7ff9f80a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc000c00 tx=0x7ff9fc032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.322+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa0809bf70 con 0x7ffa0c101de0 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3815102766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:28:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/608037605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:28:22.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:22.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3815102766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:28:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/608037605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:28:22.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.500+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffa0c10a0f0 con 0x7ffa0c101de0 2024-09-11T22:28:22.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.500+0000 7ffa037fe640 1 -- 172.21.15.22:0/1950359242 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffa0809b870 con 0x7ffa0c101de0 2024-09-11T22:28:22.501 INFO:teuthology.orchestra.run.smithi022.stdout:206158430252 2024-09-11T22:28:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 msgr2=0x7ff9f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 0x7ff9f80a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc000c00 tx=0x7ff9fc032c80 comp rx=0 tx=0).stop 2024-09-11T22:28:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 msgr2=0x7ffa0c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d770 tx=0x7ffa0800dc30 comp rx=0 tx=0).stop 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 shutdown_connections 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa0c106f10 0x7ffa0c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ff9f80a2c10 0x7ff9f80a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa0c102790 0x7ffa0c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 --2- 172.21.15.22:0/1950359242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa0c101de0 0x7ffa0c198550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.502+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 >> 172.21.15.22:0/1950359242 conn(0x7ffa0c0fd8c0 msgr2=0x7ffa0c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.503+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 shutdown_connections 2024-09-11T22:28:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:22.503+0000 7ffa14405640 1 -- 172.21.15.22:0/1950359242 wait complete. 2024-09-11T22:28:22.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939679 got 270582939682 for osd.9 2024-09-11T22:28:22.973 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:23.243 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:23 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1950359242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:28:23.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:23 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1950359242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:28:23.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:23 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1950359242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 -- 172.21.15.22:0/1373557361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102ef0 msgr2=0x7f329810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 --2- 172.21.15.22:0/1373557361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102ef0 0x7f329810da40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3290009ca0 tx=0x7f329002a950 comp rx=0 tx=0).stop 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 -- 172.21.15.22:0/1373557361 shutdown_connections 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 --2- 172.21.15.22:0/1373557361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102ef0 0x7f329810da40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 --2- 172.21.15.22:0/1373557361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298102570 0x7f32981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 --2- 172.21.15.22:0/1373557361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298100e20 0x7f3298101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 -- 172.21.15.22:0/1373557361 >> 172.21.15.22:0/1373557361 conn(0x7f32980fc7d0 msgr2=0x7f32980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 -- 172.21.15.22:0/1373557361 shutdown_connections 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.571+0000 7f329e821640 1 -- 172.21.15.22:0/1373557361 wait complete. 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 Processor -- start 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 -- start start 2024-09-11T22:28:23.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298100e20 0x7f32981992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298102ef0 0x7f32981a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32981110a0 con 0x7f3298102570 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3298110f20 con 0x7f3298102ef0 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f329e821640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3298111220 con 0x7f3298100e20 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.572+0000 7f32977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60914/0 (socket says 172.21.15.22:60914) 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 -- 172.21.15.22:0/3818510756 learned_addr learned my addr 172.21.15.22:0/3818510756 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f3297fff640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298100e20 0x7f32981992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f329cdbe640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298102ef0 0x7f32981a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 -- 172.21.15.22:0/3818510756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298100e20 msgr2=0x7f32981992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298100e20 0x7f32981992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 -- 172.21.15.22:0/3818510756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298102ef0 msgr2=0x7f32981a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298102ef0 0x7f32981a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 -- 172.21.15.22:0/3818510756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32981a48a0 con 0x7f3298102570 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32977fe640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f328c00e9f0 tx=0x7f328c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c00ccc0 con 0x7f3298102570 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f328c00ce60 con 0x7f3298102570 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32981970d0 con 0x7f3298102570 2024-09-11T22:28:23.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c010690 con 0x7f3298102570 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.573+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981975c0 con 0x7f3298102570 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.574+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3298101200 con 0x7f3298102570 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.576+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f328c0046c0 con 0x7f3298102570 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.576+0000 7f32957fa640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 0x7f32800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.576+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f328c0cf640 con 0x7f3298102570 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.576+0000 7f3297fff640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 0x7f32800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.577+0000 7f3297fff640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 0x7f32800a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f328800abe0 tx=0x7f328800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:23.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.580+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f328c0541b0 con 0x7f3298102570 2024-09-11T22:28:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.758+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32981978d0 con 0x7f3298102570 2024-09-11T22:28:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.759+0000 7f32957fa640 1 -- 172.21.15.22:0/3818510756 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f328c09c5f0 con 0x7f3298102570 2024-09-11T22:28:23.760 INFO:teuthology.orchestra.run.smithi022.stdout:34359738449 2024-09-11T22:28:23.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.760+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 msgr2=0x7f32800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.760+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 0x7f32800a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f328800abe0 tx=0x7f328800a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 msgr2=0x7f3298199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f328c00e9f0 tx=0x7f328c00edf0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 shutdown_connections 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298102ef0 0x7f32981a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3298102570 0x7f3298199820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32800a2c10 0x7f32800a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 --2- 172.21.15.22:0/3818510756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3298100e20 0x7f32981992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 >> 172.21.15.22:0/3818510756 conn(0x7f32980fc7d0 msgr2=0x7f3298105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:23.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 shutdown_connections 2024-09-11T22:28:23.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:23.761+0000 7f329e821640 1 -- 172.21.15.22:0/3818510756 wait complete. 2024-09-11T22:28:24.070 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430249 got 206158430252 for osd.7 2024-09-11T22:28:24.070 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:24.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:24 smithi022 ceph-mon[30966]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:24.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:24 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3818510756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:28:24.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:24 smithi169 ceph-mon[35628]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:24.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:24 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3818510756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:28:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:24 smithi045 ceph-mon[35556]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:24 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3818510756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:28:24.772 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2024-09-11T22:28:24.772 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:25.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-09-11T22:28:25.219 DEBUG:teuthology.parallel:result is None 2024-09-11T22:28:25.219 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:28:25.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:28:26.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:26.144 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:26 smithi022 ceph-mon[30966]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:26.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:26 smithi169 ceph-mon[35628]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:26 smithi045 ceph-mon[35556]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:26.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 -- 172.21.15.22:0/620495859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 msgr2=0x7f45fc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 --2- 172.21.15.22:0/620495859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc100ee0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009930 tx=0x7f45ec02a420 comp rx=0 tx=0).stop 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 -- 172.21.15.22:0/620495859 shutdown_connections 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 --2- 172.21.15.22:0/620495859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 0x7f45fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 --2- 172.21.15.22:0/620495859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc100ee0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 --2- 172.21.15.22:0/620495859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 -- 172.21.15.22:0/620495859 >> 172.21.15.22:0/620495859 conn(0x7f45fc0fc7a0 msgr2=0x7f45fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 -- 172.21.15.22:0/620495859 shutdown_connections 2024-09-11T22:28:26.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 -- 172.21.15.22:0/620495859 wait complete. 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.522+0000 7f4602acc640 1 Processor -- start 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 -- start start 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 0x7f45fc198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc110f60 con 0x7f45fc100a80 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc110de0 con 0x7f45fc106a80 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4602acc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc1110e0 con 0x7f45fc101420 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59924/0 (socket says 172.21.15.22:59924) 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 -- 172.21.15.22:0/2418708852 learned_addr learned my addr 172.21.15.22:0/2418708852 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f45fbfff640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 0x7f45fc198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 -- 172.21.15.22:0/2418708852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 msgr2=0x7f45fc198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 0x7f45fc198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 -- 172.21.15.22:0/2418708852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 msgr2=0x7f45fc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4601069640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 -- 172.21.15.22:0/2418708852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc19d530 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4601069640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f4600868640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e9f0 tx=0x7f45e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.523+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e400cd80 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.524+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc19d820 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.524+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45e4010930 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.524+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4018b00 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.524+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1a5100 con 0x7f45fc100a80 2024-09-11T22:28:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.525+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc100ee0 con 0x7f45fc100a80 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.526+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f45e4018ca0 con 0x7f45fc100a80 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.527+0000 7f45f9ffb640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 0x7f45e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.527+0000 7f45fbfff640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 0x7f45e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.527+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f45e40cf910 con 0x7f45fc100a80 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.527+0000 7f45fbfff640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 0x7f45e80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:26.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.530+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e409c7c0 con 0x7f45fc100a80 2024-09-11T22:28:26.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.710+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45fc062630 con 0x7f45e80a2c10 2024-09-11T22:28:26.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.719+0000 7f45f9ffb640 1 -- 172.21.15.22:0/2418708852 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258633 (secure 0 0 0) 0x7f45fc062630 con 0x7f45e80a2c10 2024-09-11T22:28:26.723 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:26.724 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:28:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 msgr2=0x7f45e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 0x7f45e80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec005a20 comp rx=0 tx=0).stop 2024-09-11T22:28:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 msgr2=0x7f45fc198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45e400e9f0 tx=0x7f45e400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 shutdown_connections 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45fc106a80 0x7f45fc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f45e80a2c10 0x7f45e80a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45fc101420 0x7f45fc198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 --2- 172.21.15.22:0/2418708852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45fc100a80 0x7f45fc198580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 >> 172.21.15.22:0/2418708852 conn(0x7f45fc0fc7a0 msgr2=0x7f45fc06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 shutdown_connections 2024-09-11T22:28:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:26.722+0000 7f4602acc640 1 -- 172.21.15.22:0/2418708852 wait complete. 2024-09-11T22:28:27.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-11T22:28:27.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T22:28:27.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:27.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-11T22:28:27.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.353 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:27 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-11T22:28:27.381 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-11T22:28:26.625213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":257,"num_read_kb":243,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386344,"kb_used_data":12120,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555480,"statfs":{"total":1151940427776,"available":1151544811520,"internally_reserved":0,"allocated":12410880,"data_stored":6961533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801883+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:27:24.801883+0000","last_peered":"2024-09-11T22:27:24.801883+0000","last_clean":"2024-09-11T22:27:24.801883+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:27:24.801883+0000","last_undegraded":"2024-09-11T22:27:24.801883+0000","last_fullsized":"2024-09-11T22:27:24.801883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815697+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:27:24.815697+0000","last_peered":"2024-09-11T22:27:24.815697+0000","last_clean":"2024-09-11T22:27:24.815697+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:27:24.815697+0000","last_undegraded":"2024-09-11T22:27:24.815697+0000","last_fullsized":"2024-09-11T22:27:24.815697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815042+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:27:24.815042+0000","last_peered":"2024-09-11T22:27:24.815042+0000","last_clean":"2024-09-11T22:27:24.815042+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:27:24.815042+0000","last_undegraded":"2024-09-11T22:27:24.815042+0000","last_fullsized":"2024-09-11T22:27:24.815042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813145+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:27:24.813145+0000","last_peered":"2024-09-11T22:27:24.813145+0000","last_clean":"2024-09-11T22:27:24.813145+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:27:24.813145+0000","last_undegraded":"2024-09-11T22:27:24.813145+0000","last_fullsized":"2024-09-11T22:27:24.813145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812652+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:27:24.812652+0000","last_peered":"2024-09-11T22:27:24.812652+0000","last_clean":"2024-09-11T22:27:24.812652+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:27:24.812652+0000","last_undegraded":"2024-09-11T22:27:24.812652+0000","last_fullsized":"2024-09-11T22:27:24.812652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798604+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:27:24.798604+0000","last_peered":"2024-09-11T22:27:24.798604+0000","last_clean":"2024-09-11T22:27:24.798604+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:27:24.798604+0000","last_undegraded":"2024-09-11T22:27:24.798604+0000","last_fullsized":"2024-09-11T22:27:24.798604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814490+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:27:24.814490+0000","last_peered":"2024-09-11T22:27:24.814490+0000","last_clean":"2024-09-11T22:27:24.814490+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:27:24.814490+0000","last_undegraded":"2024-09-11T22:27:24.814490+0000","last_fullsized":"2024-09-11T22:27:24.814490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797808+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:27:24.797808+0000","last_peered":"2024-09-11T22:27:24.797808+0000","last_clean":"2024-09-11T22:27:24.797808+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:27:24.797808+0000","last_undegraded":"2024-09-11T22:27:24.797808+0000","last_fullsized":"2024-09-11T22:27:24.797808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813062+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:27:24.813062+0000","last_peered":"2024-09-11T22:27:24.813062+0000","last_clean":"2024-09-11T22:27:24.813062+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:27:24.813062+0000","last_undegraded":"2024-09-11T22:27:24.813062+0000","last_fullsized":"2024-09-11T22:27:24.813062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799180+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:27:24.799180+0000","last_peered":"2024-09-11T22:27:24.799180+0000","last_clean":"2024-09-11T22:27:24.799180+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:27:24.799180+0000","last_undegraded":"2024-09-11T22:27:24.799180+0000","last_fullsized":"2024-09-11T22:27:24.799180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814952+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:27:24.814952+0000","last_peered":"2024-09-11T22:27:24.814952+0000","last_clean":"2024-09-11T22:27:24.814952+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:27:24.814952+0000","last_undegraded":"2024-09-11T22:27:24.814952+0000","last_fullsized":"2024-09-11T22:27:24.814952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813304+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:27:24.813304+0000","last_peered":"2024-09-11T22:27:24.813304+0000","last_clean":"2024-09-11T22:27:24.813304+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:27:24.813304+0000","last_undegraded":"2024-09-11T22:27:24.813304+0000","last_fullsized":"2024-09-11T22:27:24.813304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813242+0000","last_change":"2024-09-11T22:27:23.809690+0000","last_active":"2024-09-11T22:27:24.813242+0000","last_peered":"2024-09-11T22:27:24.813242+0000","last_clean":"2024-09-11T22:27:24.813242+0000","last_became_active":"2024-09-11T22:27:23.808196+0000","last_became_peered":"2024-09-11T22:27:23.808196+0000","last_unstale":"2024-09-11T22:27:24.813242+0000","last_undegraded":"2024-09-11T22:27:24.813242+0000","last_fullsized":"2024-09-11T22:27:24.813242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:14.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815583+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:27:24.815583+0000","last_peered":"2024-09-11T22:27:24.815583+0000","last_clean":"2024-09-11T22:27:24.815583+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:27:24.815583+0000","last_undegraded":"2024-09-11T22:27:24.815583+0000","last_fullsized":"2024-09-11T22:27:24.815583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815206+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:27:24.815206+0000","last_peered":"2024-09-11T22:27:24.815206+0000","last_clean":"2024-09-11T22:27:24.815206+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:27:24.815206+0000","last_undegraded":"2024-09-11T22:27:24.815206+0000","last_fullsized":"2024-09-11T22:27:24.815206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812429+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:27:24.812429+0000","last_peered":"2024-09-11T22:27:24.812429+0000","last_clean":"2024-09-11T22:27:24.812429+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:27:24.812429+0000","last_undegraded":"2024-09-11T22:27:24.812429+0000","last_fullsized":"2024-09-11T22:27:24.812429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801938+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:27:24.801938+0000","last_peered":"2024-09-11T22:27:24.801938+0000","last_clean":"2024-09-11T22:27:24.801938+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:27:24.801938+0000","last_undegraded":"2024-09-11T22:27:24.801938+0000","last_fullsized":"2024-09-11T22:27:24.801938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.811962+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:27:24.811962+0000","last_peered":"2024-09-11T22:27:24.811962+0000","last_clean":"2024-09-11T22:27:24.811962+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:27:24.811962+0000","last_undegraded":"2024-09-11T22:27:24.811962+0000","last_fullsized":"2024-09-11T22:27:24.811962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814680+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:27:24.814680+0000","last_peered":"2024-09-11T22:27:24.814680+0000","last_clean":"2024-09-11T22:27:24.814680+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:27:24.814680+0000","last_undegraded":"2024-09-11T22:27:24.814680+0000","last_fullsized":"2024-09-11T22:27:24.814680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801631+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:27:24.801631+0000","last_peered":"2024-09-11T22:27:24.801631+0000","last_clean":"2024-09-11T22:27:24.801631+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:27:24.801631+0000","last_undegraded":"2024-09-11T22:27:24.801631+0000","last_fullsized":"2024-09-11T22:27:24.801631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813380+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:27:24.813380+0000","last_peered":"2024-09-11T22:27:24.813380+0000","last_clean":"2024-09-11T22:27:24.813380+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:27:24.813380+0000","last_undegraded":"2024-09-11T22:27:24.813380+0000","last_fullsized":"2024-09-11T22:27:24.813380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812658+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:27:24.812658+0000","last_peered":"2024-09-11T22:27:24.812658+0000","last_clean":"2024-09-11T22:27:24.812658+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:27:24.812658+0000","last_undegraded":"2024-09-11T22:27:24.812658+0000","last_fullsized":"2024-09-11T22:27:24.812658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797795+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:27:24.797795+0000","last_peered":"2024-09-11T22:27:24.797795+0000","last_clean":"2024-09-11T22:27:24.797795+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:27:24.797795+0000","last_undegraded":"2024-09-11T22:27:24.797795+0000","last_fullsized":"2024-09-11T22:27:24.797795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814583+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:27:24.814583+0000","last_peered":"2024-09-11T22:27:24.814583+0000","last_clean":"2024-09-11T22:27:24.814583+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:27:24.814583+0000","last_undegraded":"2024-09-11T22:27:24.814583+0000","last_fullsized":"2024-09-11T22:27:24.814583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798380+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:27:24.798380+0000","last_peered":"2024-09-11T22:27:24.798380+0000","last_clean":"2024-09-11T22:27:24.798380+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:27:24.798380+0000","last_undegraded":"2024-09-11T22:27:24.798380+0000","last_fullsized":"2024-09-11T22:27:24.798380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814791+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:27:24.814791+0000","last_peered":"2024-09-11T22:27:24.814791+0000","last_clean":"2024-09-11T22:27:24.814791+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:27:24.814791+0000","last_undegraded":"2024-09-11T22:27:24.814791+0000","last_fullsized":"2024-09-11T22:27:24.814791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801740+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:27:24.801740+0000","last_peered":"2024-09-11T22:27:24.801740+0000","last_clean":"2024-09-11T22:27:24.801740+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:27:24.801740+0000","last_undegraded":"2024-09-11T22:27:24.801740+0000","last_fullsized":"2024-09-11T22:27:24.801740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813892+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.813892+0000","last_peered":"2024-09-11T22:27:24.813892+0000","last_clean":"2024-09-11T22:27:24.813892+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:27:24.813892+0000","last_undegraded":"2024-09-11T22:27:24.813892+0000","last_fullsized":"2024-09-11T22:27:24.813892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815715+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:27:24.815715+0000","last_peered":"2024-09-11T22:27:24.815715+0000","last_clean":"2024-09-11T22:27:24.815715+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:27:24.815715+0000","last_undegraded":"2024-09-11T22:27:24.815715+0000","last_fullsized":"2024-09-11T22:27:24.815715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812989+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:27:24.812989+0000","last_peered":"2024-09-11T22:27:24.812989+0000","last_clean":"2024-09-11T22:27:24.812989+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:27:24.812989+0000","last_undegraded":"2024-09-11T22:27:24.812989+0000","last_fullsized":"2024-09-11T22:27:24.812989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812794+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:27:24.812794+0000","last_peered":"2024-09-11T22:27:24.812794+0000","last_clean":"2024-09-11T22:27:24.812794+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:27:24.812794+0000","last_undegraded":"2024-09-11T22:27:24.812794+0000","last_fullsized":"2024-09-11T22:27:24.812794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801704+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:27:24.801704+0000","last_peered":"2024-09-11T22:27:24.801704+0000","last_clean":"2024-09-11T22:27:24.801704+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:27:24.801704+0000","last_undegraded":"2024-09-11T22:27:24.801704+0000","last_fullsized":"2024-09-11T22:27:24.801704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812498+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:27:24.812498+0000","last_peered":"2024-09-11T22:27:24.812498+0000","last_clean":"2024-09-11T22:27:24.812498+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:27:24.812498+0000","last_undegraded":"2024-09-11T22:27:24.812498+0000","last_fullsized":"2024-09-11T22:27:24.812498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814805+0000","last_change":"2024-09-11T22:27:21.801880+0000","last_active":"2024-09-11T22:27:24.814805+0000","last_peered":"2024-09-11T22:27:24.814805+0000","last_clean":"2024-09-11T22:27:24.814805+0000","last_became_active":"2024-09-11T22:27:21.801516+0000","last_became_peered":"2024-09-11T22:27:21.801516+0000","last_unstale":"2024-09-11T22:27:24.814805+0000","last_undegraded":"2024-09-11T22:27:24.814805+0000","last_fullsized":"2024-09-11T22:27:24.814805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.512123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814588+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:27:24.814588+0000","last_peered":"2024-09-11T22:27:24.814588+0000","last_clean":"2024-09-11T22:27:24.814588+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:27:24.814588+0000","last_undegraded":"2024-09-11T22:27:24.814588+0000","last_fullsized":"2024-09-11T22:27:24.814588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799022+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:27:24.799022+0000","last_peered":"2024-09-11T22:27:24.799022+0000","last_clean":"2024-09-11T22:27:24.799022+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:27:24.799022+0000","last_undegraded":"2024-09-11T22:27:24.799022+0000","last_fullsized":"2024-09-11T22:27:24.799022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813970+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:27:24.813970+0000","last_peered":"2024-09-11T22:27:24.813970+0000","last_clean":"2024-09-11T22:27:24.813970+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:27:24.813970+0000","last_undegraded":"2024-09-11T22:27:24.813970+0000","last_fullsized":"2024-09-11T22:27:24.813970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797968+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:27:24.797968+0000","last_peered":"2024-09-11T22:27:24.797968+0000","last_clean":"2024-09-11T22:27:24.797968+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:27:24.797968+0000","last_undegraded":"2024-09-11T22:27:24.797968+0000","last_fullsized":"2024-09-11T22:27:24.797968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815026+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:27:24.815026+0000","last_peered":"2024-09-11T22:27:24.815026+0000","last_clean":"2024-09-11T22:27:24.815026+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:27:24.815026+0000","last_undegraded":"2024-09-11T22:27:24.815026+0000","last_fullsized":"2024-09-11T22:27:24.815026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812047+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.812047+0000","last_peered":"2024-09-11T22:27:24.812047+0000","last_clean":"2024-09-11T22:27:24.812047+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:27:24.812047+0000","last_undegraded":"2024-09-11T22:27:24.812047+0000","last_fullsized":"2024-09-11T22:27:24.812047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798965+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:27:24.798965+0000","last_peered":"2024-09-11T22:27:24.798965+0000","last_clean":"2024-09-11T22:27:24.798965+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:27:24.798965+0000","last_undegraded":"2024-09-11T22:27:24.798965+0000","last_fullsized":"2024-09-11T22:27:24.798965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813648+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:27:24.813648+0000","last_peered":"2024-09-11T22:27:24.813648+0000","last_clean":"2024-09-11T22:27:24.813648+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:27:24.813648+0000","last_undegraded":"2024-09-11T22:27:24.813648+0000","last_fullsized":"2024-09-11T22:27:24.813648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814756+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:27:24.814756+0000","last_peered":"2024-09-11T22:27:24.814756+0000","last_clean":"2024-09-11T22:27:24.814756+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:27:24.814756+0000","last_undegraded":"2024-09-11T22:27:24.814756+0000","last_fullsized":"2024-09-11T22:27:24.814756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815477+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:27:24.815477+0000","last_peered":"2024-09-11T22:27:24.815477+0000","last_clean":"2024-09-11T22:27:24.815477+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:27:24.815477+0000","last_undegraded":"2024-09-11T22:27:24.815477+0000","last_fullsized":"2024-09-11T22:27:24.815477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819448+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:27:24.819448+0000","last_peered":"2024-09-11T22:27:24.819448+0000","last_clean":"2024-09-11T22:27:24.819448+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:27:24.819448+0000","last_undegraded":"2024-09-11T22:27:24.819448+0000","last_fullsized":"2024-09-11T22:27:24.819448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812684+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:27:24.812684+0000","last_peered":"2024-09-11T22:27:24.812684+0000","last_clean":"2024-09-11T22:27:24.812684+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:27:24.812684+0000","last_undegraded":"2024-09-11T22:27:24.812684+0000","last_fullsized":"2024-09-11T22:27:24.812684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:28:23.923710+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:28:23.923710+0000","last_peered":"2024-09-11T22:28:23.923710+0000","last_clean":"2024-09-11T22:28:23.923710+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:28:23.923710+0000","last_undegraded":"2024-09-11T22:28:23.923710+0000","last_fullsized":"2024-09-11T22:28:23.923710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813564+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:27:24.813564+0000","last_peered":"2024-09-11T22:27:24.813564+0000","last_clean":"2024-09-11T22:27:24.813564+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:27:24.813564+0000","last_undegraded":"2024-09-11T22:27:24.813564+0000","last_fullsized":"2024-09-11T22:27:24.813564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819927+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:27:24.819927+0000","last_peered":"2024-09-11T22:27:24.819927+0000","last_clean":"2024-09-11T22:27:24.819927+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:27:24.819927+0000","last_undegraded":"2024-09-11T22:27:24.819927+0000","last_fullsized":"2024-09-11T22:27:24.819927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813166+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:27:24.813166+0000","last_peered":"2024-09-11T22:27:24.813166+0000","last_clean":"2024-09-11T22:27:24.813166+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:27:24.813166+0000","last_undegraded":"2024-09-11T22:27:24.813166+0000","last_fullsized":"2024-09-11T22:27:24.813166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814871+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:27:24.814871+0000","last_peered":"2024-09-11T22:27:24.814871+0000","last_clean":"2024-09-11T22:27:24.814871+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:27:24.814871+0000","last_undegraded":"2024-09-11T22:27:24.814871+0000","last_fullsized":"2024-09-11T22:27:24.814871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814873+0000","last_change":"2024-09-11T22:27:23.821877+0000","last_active":"2024-09-11T22:27:24.814873+0000","last_peered":"2024-09-11T22:27:24.814873+0000","last_clean":"2024-09-11T22:27:24.814873+0000","last_became_active":"2024-09-11T22:27:23.821282+0000","last_became_peered":"2024-09-11T22:27:23.821282+0000","last_unstale":"2024-09-11T22:27:24.814873+0000","last_undegraded":"2024-09-11T22:27:24.814873+0000","last_fullsized":"2024-09-11T22:27:24.814873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.453027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812791+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:27:24.812791+0000","last_peered":"2024-09-11T22:27:24.812791+0000","last_clean":"2024-09-11T22:27:24.812791+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:27:24.812791+0000","last_undegraded":"2024-09-11T22:27:24.812791+0000","last_fullsized":"2024-09-11T22:27:24.812791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814443+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:27:24.814443+0000","last_peered":"2024-09-11T22:27:24.814443+0000","last_clean":"2024-09-11T22:27:24.814443+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:27:24.814443+0000","last_undegraded":"2024-09-11T22:27:24.814443+0000","last_fullsized":"2024-09-11T22:27:24.814443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820705+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:27:24.820705+0000","last_peered":"2024-09-11T22:27:24.820705+0000","last_clean":"2024-09-11T22:27:24.820705+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:27:24.820705+0000","last_undegraded":"2024-09-11T22:27:24.820705+0000","last_fullsized":"2024-09-11T22:27:24.820705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815253+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:27:24.815253+0000","last_peered":"2024-09-11T22:27:24.815253+0000","last_clean":"2024-09-11T22:27:24.815253+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:27:24.815253+0000","last_undegraded":"2024-09-11T22:27:24.815253+0000","last_fullsized":"2024-09-11T22:27:24.815253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868332+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:27:24.868332+0000","last_peered":"2024-09-11T22:27:24.868332+0000","last_clean":"2024-09-11T22:27:24.868332+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:27:24.868332+0000","last_undegraded":"2024-09-11T22:27:24.868332+0000","last_fullsized":"2024-09-11T22:27:24.868332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801823+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:27:24.801823+0000","last_peered":"2024-09-11T22:27:24.801823+0000","last_clean":"2024-09-11T22:27:24.801823+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:27:24.801823+0000","last_undegraded":"2024-09-11T22:27:24.801823+0000","last_fullsized":"2024-09-11T22:27:24.801823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819267+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:27:24.819267+0000","last_peered":"2024-09-11T22:27:24.819267+0000","last_clean":"2024-09-11T22:27:24.819267+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:27:24.819267+0000","last_undegraded":"2024-09-11T22:27:24.819267+0000","last_fullsized":"2024-09-11T22:27:24.819267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814958+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:27:24.814958+0000","last_peered":"2024-09-11T22:27:24.814958+0000","last_clean":"2024-09-11T22:27:24.814958+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:27:24.814958+0000","last_undegraded":"2024-09-11T22:27:24.814958+0000","last_fullsized":"2024-09-11T22:27:24.814958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819175+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:27:24.819175+0000","last_peered":"2024-09-11T22:27:24.819175+0000","last_clean":"2024-09-11T22:27:24.819175+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:27:24.819175+0000","last_undegraded":"2024-09-11T22:27:24.819175+0000","last_fullsized":"2024-09-11T22:27:24.819175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:25.683202+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:27:25.683202+0000","last_peered":"2024-09-11T22:27:25.683202+0000","last_clean":"2024-09-11T22:27:25.683202+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:27:25.683202+0000","last_undegraded":"2024-09-11T22:27:25.683202+0000","last_fullsized":"2024-09-11T22:27:25.683202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815132+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.815132+0000","last_peered":"2024-09-11T22:27:24.815132+0000","last_clean":"2024-09-11T22:27:24.815132+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:27:24.815132+0000","last_undegraded":"2024-09-11T22:27:24.815132+0000","last_fullsized":"2024-09-11T22:27:24.815132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815048+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:27:24.815048+0000","last_peered":"2024-09-11T22:27:24.815048+0000","last_clean":"2024-09-11T22:27:24.815048+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:27:24.815048+0000","last_undegraded":"2024-09-11T22:27:24.815048+0000","last_fullsized":"2024-09-11T22:27:24.815048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814543+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:27:24.814543+0000","last_peered":"2024-09-11T22:27:24.814543+0000","last_clean":"2024-09-11T22:27:24.814543+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:27:24.814543+0000","last_undegraded":"2024-09-11T22:27:24.814543+0000","last_fullsized":"2024-09-11T22:27:24.814543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813387+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:27:24.813387+0000","last_peered":"2024-09-11T22:27:24.813387+0000","last_clean":"2024-09-11T22:27:24.813387+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:27:24.813387+0000","last_undegraded":"2024-09-11T22:27:24.813387+0000","last_fullsized":"2024-09-11T22:27:24.813387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798081+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:27:24.798081+0000","last_peered":"2024-09-11T22:27:24.798081+0000","last_clean":"2024-09-11T22:27:24.798081+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:27:24.798081+0000","last_undegraded":"2024-09-11T22:27:24.798081+0000","last_fullsized":"2024-09-11T22:27:24.798081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814621+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:27:24.814621+0000","last_peered":"2024-09-11T22:27:24.814621+0000","last_clean":"2024-09-11T22:27:24.814621+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:27:24.814621+0000","last_undegraded":"2024-09-11T22:27:24.814621+0000","last_fullsized":"2024-09-11T22:27:24.814621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813647+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:27:24.813647+0000","last_peered":"2024-09-11T22:27:24.813647+0000","last_clean":"2024-09-11T22:27:24.813647+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:27:24.813647+0000","last_undegraded":"2024-09-11T22:27:24.813647+0000","last_fullsized":"2024-09-11T22:27:24.813647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814262+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:27:24.814262+0000","last_peered":"2024-09-11T22:27:24.814262+0000","last_clean":"2024-09-11T22:27:24.814262+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:27:24.814262+0000","last_undegraded":"2024-09-11T22:27:24.814262+0000","last_fullsized":"2024-09-11T22:27:24.814262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814753+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:27:24.814753+0000","last_peered":"2024-09-11T22:27:24.814753+0000","last_clean":"2024-09-11T22:27:24.814753+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:27:24.814753+0000","last_undegraded":"2024-09-11T22:27:24.814753+0000","last_fullsized":"2024-09-11T22:27:24.814753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815264+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:27:24.815264+0000","last_peered":"2024-09-11T22:27:24.815264+0000","last_clean":"2024-09-11T22:27:24.815264+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:27:24.815264+0000","last_undegraded":"2024-09-11T22:27:24.815264+0000","last_fullsized":"2024-09-11T22:27:24.815264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798812+0000","last_change":"2024-09-11T22:27:23.809950+0000","last_active":"2024-09-11T22:27:24.798812+0000","last_peered":"2024-09-11T22:27:24.798812+0000","last_clean":"2024-09-11T22:27:24.798812+0000","last_became_active":"2024-09-11T22:27:23.809603+0000","last_became_peered":"2024-09-11T22:27:23.809603+0000","last_unstale":"2024-09-11T22:27:24.798812+0000","last_undegraded":"2024-09-11T22:27:24.798812+0000","last_fullsized":"2024-09-11T22:27:24.798812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.114644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812041+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:27:24.812041+0000","last_peered":"2024-09-11T22:27:24.812041+0000","last_clean":"2024-09-11T22:27:24.812041+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:27:24.812041+0000","last_undegraded":"2024-09-11T22:27:24.812041+0000","last_fullsized":"2024-09-11T22:27:24.812041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799147+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:27:24.799147+0000","last_peered":"2024-09-11T22:27:24.799147+0000","last_clean":"2024-09-11T22:27:24.799147+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:27:24.799147+0000","last_undegraded":"2024-09-11T22:27:24.799147+0000","last_fullsized":"2024-09-11T22:27:24.799147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814326+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:27:24.814326+0000","last_peered":"2024-09-11T22:27:24.814326+0000","last_clean":"2024-09-11T22:27:24.814326+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:27:24.814326+0000","last_undegraded":"2024-09-11T22:27:24.814326+0000","last_fullsized":"2024-09-11T22:27:24.814326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814054+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:27:24.814054+0000","last_peered":"2024-09-11T22:27:24.814054+0000","last_clean":"2024-09-11T22:27:24.814054+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:27:24.814054+0000","last_undegraded":"2024-09-11T22:27:24.814054+0000","last_fullsized":"2024-09-11T22:27:24.814054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:47.814321+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:27:47.814321+0000","last_peered":"2024-09-11T22:27:47.814321+0000","last_clean":"2024-09-11T22:27:47.814321+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:27:47.814321+0000","last_undegraded":"2024-09-11T22:27:47.814321+0000","last_fullsized":"2024-09-11T22:27:47.814321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798405+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:27:24.798405+0000","last_peered":"2024-09-11T22:27:24.798405+0000","last_clean":"2024-09-11T22:27:24.798405+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:27:24.798405+0000","last_undegraded":"2024-09-11T22:27:24.798405+0000","last_fullsized":"2024-09-11T22:27:24.798405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818326+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.818326+0000","last_peered":"2024-09-11T22:27:24.818326+0000","last_clean":"2024-09-11T22:27:24.818326+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:27:24.818326+0000","last_undegraded":"2024-09-11T22:27:24.818326+0000","last_fullsized":"2024-09-11T22:27:24.818326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815857+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:27:24.815857+0000","last_peered":"2024-09-11T22:27:24.815857+0000","last_clean":"2024-09-11T22:27:24.815857+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:27:24.815857+0000","last_undegraded":"2024-09-11T22:27:24.815857+0000","last_fullsized":"2024-09-11T22:27:24.815857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812645+0000","last_change":"2024-09-11T22:27:21.998555+0000","last_active":"2024-09-11T22:27:24.812645+0000","last_peered":"2024-09-11T22:27:24.812645+0000","last_clean":"2024-09-11T22:27:24.812645+0000","last_became_active":"2024-09-11T22:27:21.998212+0000","last_became_peered":"2024-09-11T22:27:21.998212+0000","last_unstale":"2024-09-11T22:27:24.812645+0000","last_undegraded":"2024-09-11T22:27:24.812645+0000","last_fullsized":"2024-09-11T22:27:24.812645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812139+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:27:24.812139+0000","last_peered":"2024-09-11T22:27:24.812139+0000","last_clean":"2024-09-11T22:27:24.812139+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:27:24.812139+0000","last_undegraded":"2024-09-11T22:27:24.812139+0000","last_fullsized":"2024-09-11T22:27:24.812139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797996+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:27:24.797996+0000","last_peered":"2024-09-11T22:27:24.797996+0000","last_clean":"2024-09-11T22:27:24.797996+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:27:24.797996+0000","last_undegraded":"2024-09-11T22:27:24.797996+0000","last_fullsized":"2024-09-11T22:27:24.797996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801874+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:27:24.801874+0000","last_peered":"2024-09-11T22:27:24.801874+0000","last_clean":"2024-09-11T22:27:24.801874+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:27:24.801874+0000","last_undegraded":"2024-09-11T22:27:24.801874+0000","last_fullsized":"2024-09-11T22:27:24.801874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813107+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:27:24.813107+0000","last_peered":"2024-09-11T22:27:24.813107+0000","last_clean":"2024-09-11T22:27:24.813107+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:27:24.813107+0000","last_undegraded":"2024-09-11T22:27:24.813107+0000","last_fullsized":"2024-09-11T22:27:24.813107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797984+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:27:24.797984+0000","last_peered":"2024-09-11T22:27:24.797984+0000","last_clean":"2024-09-11T22:27:24.797984+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:27:24.797984+0000","last_undegraded":"2024-09-11T22:27:24.797984+0000","last_fullsized":"2024-09-11T22:27:24.797984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868295+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:27:24.868295+0000","last_peered":"2024-09-11T22:27:24.868295+0000","last_clean":"2024-09-11T22:27:24.868295+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:27:24.868295+0000","last_undegraded":"2024-09-11T22:27:24.868295+0000","last_fullsized":"2024-09-11T22:27:24.868295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815268+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:27:24.815268+0000","last_peered":"2024-09-11T22:27:24.815268+0000","last_clean":"2024-09-11T22:27:24.815268+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:27:24.815268+0000","last_undegraded":"2024-09-11T22:27:24.815268+0000","last_fullsized":"2024-09-11T22:27:24.815268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815698+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:27:24.815698+0000","last_peered":"2024-09-11T22:27:24.815698+0000","last_clean":"2024-09-11T22:27:24.815698+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:27:24.815698+0000","last_undegraded":"2024-09-11T22:27:24.815698+0000","last_fullsized":"2024-09-11T22:27:24.815698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818661+0000","last_change":"2024-09-11T22:27:21.801270+0000","last_active":"2024-09-11T22:27:24.818661+0000","last_peered":"2024-09-11T22:27:24.818661+0000","last_clean":"2024-09-11T22:27:24.818661+0000","last_became_active":"2024-09-11T22:27:21.800860+0000","last_became_peered":"2024-09-11T22:27:21.800860+0000","last_unstale":"2024-09-11T22:27:24.818661+0000","last_undegraded":"2024-09-11T22:27:24.818661+0000","last_fullsized":"2024-09-11T22:27:24.818661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:16.103906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812510+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:27:24.812510+0000","last_peered":"2024-09-11T22:27:24.812510+0000","last_clean":"2024-09-11T22:27:24.812510+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:27:24.812510+0000","last_undegraded":"2024-09-11T22:27:24.812510+0000","last_fullsized":"2024-09-11T22:27:24.812510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820276+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:27:24.820276+0000","last_peered":"2024-09-11T22:27:24.820276+0000","last_clean":"2024-09-11T22:27:24.820276+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:27:24.820276+0000","last_undegraded":"2024-09-11T22:27:24.820276+0000","last_fullsized":"2024-09-11T22:27:24.820276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815290+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:27:24.815290+0000","last_peered":"2024-09-11T22:27:24.815290+0000","last_clean":"2024-09-11T22:27:24.815290+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:27:24.815290+0000","last_undegraded":"2024-09-11T22:27:24.815290+0000","last_fullsized":"2024-09-11T22:27:24.815290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798473+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:27:24.798473+0000","last_peered":"2024-09-11T22:27:24.798473+0000","last_clean":"2024-09-11T22:27:24.798473+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:27:24.798473+0000","last_undegraded":"2024-09-11T22:27:24.798473+0000","last_fullsized":"2024-09-11T22:27:24.798473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798314+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:27:24.798314+0000","last_peered":"2024-09-11T22:27:24.798314+0000","last_clean":"2024-09-11T22:27:24.798314+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:27:24.798314+0000","last_undegraded":"2024-09-11T22:27:24.798314+0000","last_fullsized":"2024-09-11T22:27:24.798314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819062+0000","last_change":"2024-09-11T22:27:21.796897+0000","last_active":"2024-09-11T22:27:24.819062+0000","last_peered":"2024-09-11T22:27:24.819062+0000","last_clean":"2024-09-11T22:27:24.819062+0000","last_became_active":"2024-09-11T22:27:21.796540+0000","last_became_peered":"2024-09-11T22:27:21.796540+0000","last_unstale":"2024-09-11T22:27:24.819062+0000","last_undegraded":"2024-09-11T22:27:24.819062+0000","last_fullsized":"2024-09-11T22:27:24.819062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:43.650308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":121,"num_read_kb":124,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":860160,"data_stored":416573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36852,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708300,"statfs":{"total":95995035648,"available":95957299200,"internally_reserved":0,"allocated":1544192,"data_stored":1070071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":417155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":417177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1007640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1007240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":416595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":416911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":479426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":479392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:28:27.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:28:27.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-11T22:28:27.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T22:28:27.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:27.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-11T22:28:27.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:27 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-11T22:28:27.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-11T22:28:27.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T22:28:27.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:27.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-11T22:28:27.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T22:28:27.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:27 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-11T22:28:27.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 -- 172.21.15.22:0/588232426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394106f10 msgr2=0x7f639410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 --2- 172.21.15.22:0/588232426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394106f10 0x7f639410ea90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f638c009ca0 tx=0x7f638c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 -- 172.21.15.22:0/588232426 shutdown_connections 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 --2- 172.21.15.22:0/588232426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394106f10 0x7f639410ea90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 --2- 172.21.15.22:0/588232426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 --2- 172.21.15.22:0/588232426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394101de0 0x7f63941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 -- 172.21.15.22:0/588232426 >> 172.21.15.22:0/588232426 conn(0x7f63940fd8c0 msgr2=0x7f63940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 -- 172.21.15.22:0/588232426 shutdown_connections 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.145+0000 7f639a9b5640 1 -- 172.21.15.22:0/588232426 wait complete. 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 Processor -- start 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 -- start start 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 0x7f639419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6394112120 con 0x7f6394101de0 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6394111fa0 con 0x7f6394102790 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f639a9b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63941122a0 con 0x7f6394106f10 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f6393fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f6393fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59950/0 (socket says 172.21.15.22:59950) 2024-09-11T22:28:28.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.146+0000 7f6393fff640 1 -- 172.21.15.22:0/2137324838 learned_addr learned my addr 172.21.15.22:0/2137324838 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f63937fe640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6398f52640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 0x7f639419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 -- 172.21.15.22:0/2137324838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 msgr2=0x7f639419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 0x7f639419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 -- 172.21.15.22:0/2137324838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 msgr2=0x7f63941989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 -- 172.21.15.22:0/2137324838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639419d440 con 0x7f6394101de0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f63937fe640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6398f52640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 0x7f639419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f6393fff640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f638400c920 tx=0x7f638400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384007c70 con 0x7f6394101de0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6384007e10 con 0x7f6394101de0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639419d730 con 0x7f6394101de0 2024-09-11T22:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384018940 con 0x7f6394101de0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.147+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63941a5010 con 0x7f6394101de0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.148+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63941021c0 con 0x7f6394101de0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.149+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6384018b20 con 0x7f6394101de0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.150+0000 7f63917fa640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 0x7f637c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.150+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f63840cf450 con 0x7f6394101de0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.150+0000 7f63937fe640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 0x7f637c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.150+0000 7f63937fe640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 0x7f637c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63941088a0 tx=0x7f6388008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:28.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.154+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6384014030 con 0x7f6394101de0 2024-09-11T22:28:28.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.330+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63940ffbe0 con 0x7f637c0a2c10 2024-09-11T22:28:28.331 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T22:28:28.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:28.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:28 smithi022 ceph-mon[30966]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.337+0000 7f63917fa640 1 -- 172.21.15.22:0/2137324838 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258632 (secure 0 0 0) 0x7f63940ffbe0 con 0x7f637c0a2c10 2024-09-11T22:28:28.340 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:28.341 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 msgr2=0x7f637c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 0x7f637c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63941088a0 tx=0x7f6388008040 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 msgr2=0x7f6394198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f638400c920 tx=0x7f638400cde0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 shutdown_connections 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f637c0a2c10 0x7f637c0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6394106f10 0x7f639419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6394102790 0x7f63941989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 --2- 172.21.15.22:0/2137324838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6394101de0 0x7f6394198490 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:28.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 >> 172.21.15.22:0/2137324838 conn(0x7f63940fd8c0 msgr2=0x7f63940fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 shutdown_connections 2024-09-11T22:28:28.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:28.340+0000 7f639a9b5640 1 -- 172.21.15.22:0/2137324838 wait complete. 2024-09-11T22:28:28.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:28.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:28.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:28 smithi169 ceph-mon[35628]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:28.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:28.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:28 smithi045 ceph-mon[35556]: from='mgr.14150 172.21.15.22:0/935159271' entity='mgr.x' 2024-09-11T22:28:29.050 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-11T22:28:28.031780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":257,"num_read_kb":243,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386344,"kb_used_data":12120,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555480,"statfs":{"total":1151940427776,"available":1151544811520,"internally_reserved":0,"allocated":12410880,"data_stored":6961533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.408387"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801883+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:27:24.801883+0000","last_peered":"2024-09-11T22:27:24.801883+0000","last_clean":"2024-09-11T22:27:24.801883+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:27:24.801883+0000","last_undegraded":"2024-09-11T22:27:24.801883+0000","last_fullsized":"2024-09-11T22:27:24.801883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815697+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:27:24.815697+0000","last_peered":"2024-09-11T22:27:24.815697+0000","last_clean":"2024-09-11T22:27:24.815697+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:27:24.815697+0000","last_undegraded":"2024-09-11T22:27:24.815697+0000","last_fullsized":"2024-09-11T22:27:24.815697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815042+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:27:24.815042+0000","last_peered":"2024-09-11T22:27:24.815042+0000","last_clean":"2024-09-11T22:27:24.815042+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:27:24.815042+0000","last_undegraded":"2024-09-11T22:27:24.815042+0000","last_fullsized":"2024-09-11T22:27:24.815042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813145+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:27:24.813145+0000","last_peered":"2024-09-11T22:27:24.813145+0000","last_clean":"2024-09-11T22:27:24.813145+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:27:24.813145+0000","last_undegraded":"2024-09-11T22:27:24.813145+0000","last_fullsized":"2024-09-11T22:27:24.813145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812652+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:27:24.812652+0000","last_peered":"2024-09-11T22:27:24.812652+0000","last_clean":"2024-09-11T22:27:24.812652+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:27:24.812652+0000","last_undegraded":"2024-09-11T22:27:24.812652+0000","last_fullsized":"2024-09-11T22:27:24.812652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798604+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:27:24.798604+0000","last_peered":"2024-09-11T22:27:24.798604+0000","last_clean":"2024-09-11T22:27:24.798604+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:27:24.798604+0000","last_undegraded":"2024-09-11T22:27:24.798604+0000","last_fullsized":"2024-09-11T22:27:24.798604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814490+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:27:24.814490+0000","last_peered":"2024-09-11T22:27:24.814490+0000","last_clean":"2024-09-11T22:27:24.814490+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:27:24.814490+0000","last_undegraded":"2024-09-11T22:27:24.814490+0000","last_fullsized":"2024-09-11T22:27:24.814490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797808+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:27:24.797808+0000","last_peered":"2024-09-11T22:27:24.797808+0000","last_clean":"2024-09-11T22:27:24.797808+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:27:24.797808+0000","last_undegraded":"2024-09-11T22:27:24.797808+0000","last_fullsized":"2024-09-11T22:27:24.797808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813062+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:27:24.813062+0000","last_peered":"2024-09-11T22:27:24.813062+0000","last_clean":"2024-09-11T22:27:24.813062+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:27:24.813062+0000","last_undegraded":"2024-09-11T22:27:24.813062+0000","last_fullsized":"2024-09-11T22:27:24.813062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799180+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:27:24.799180+0000","last_peered":"2024-09-11T22:27:24.799180+0000","last_clean":"2024-09-11T22:27:24.799180+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:27:24.799180+0000","last_undegraded":"2024-09-11T22:27:24.799180+0000","last_fullsized":"2024-09-11T22:27:24.799180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814952+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:27:24.814952+0000","last_peered":"2024-09-11T22:27:24.814952+0000","last_clean":"2024-09-11T22:27:24.814952+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:27:24.814952+0000","last_undegraded":"2024-09-11T22:27:24.814952+0000","last_fullsized":"2024-09-11T22:27:24.814952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813304+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:27:24.813304+0000","last_peered":"2024-09-11T22:27:24.813304+0000","last_clean":"2024-09-11T22:27:24.813304+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:27:24.813304+0000","last_undegraded":"2024-09-11T22:27:24.813304+0000","last_fullsized":"2024-09-11T22:27:24.813304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813242+0000","last_change":"2024-09-11T22:27:23.809690+0000","last_active":"2024-09-11T22:27:24.813242+0000","last_peered":"2024-09-11T22:27:24.813242+0000","last_clean":"2024-09-11T22:27:24.813242+0000","last_became_active":"2024-09-11T22:27:23.808196+0000","last_became_peered":"2024-09-11T22:27:23.808196+0000","last_unstale":"2024-09-11T22:27:24.813242+0000","last_undegraded":"2024-09-11T22:27:24.813242+0000","last_fullsized":"2024-09-11T22:27:24.813242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:14.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815583+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:27:24.815583+0000","last_peered":"2024-09-11T22:27:24.815583+0000","last_clean":"2024-09-11T22:27:24.815583+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:27:24.815583+0000","last_undegraded":"2024-09-11T22:27:24.815583+0000","last_fullsized":"2024-09-11T22:27:24.815583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815206+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:27:24.815206+0000","last_peered":"2024-09-11T22:27:24.815206+0000","last_clean":"2024-09-11T22:27:24.815206+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:27:24.815206+0000","last_undegraded":"2024-09-11T22:27:24.815206+0000","last_fullsized":"2024-09-11T22:27:24.815206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812429+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:27:24.812429+0000","last_peered":"2024-09-11T22:27:24.812429+0000","last_clean":"2024-09-11T22:27:24.812429+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:27:24.812429+0000","last_undegraded":"2024-09-11T22:27:24.812429+0000","last_fullsized":"2024-09-11T22:27:24.812429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801938+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:27:24.801938+0000","last_peered":"2024-09-11T22:27:24.801938+0000","last_clean":"2024-09-11T22:27:24.801938+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:27:24.801938+0000","last_undegraded":"2024-09-11T22:27:24.801938+0000","last_fullsized":"2024-09-11T22:27:24.801938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.811962+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:27:24.811962+0000","last_peered":"2024-09-11T22:27:24.811962+0000","last_clean":"2024-09-11T22:27:24.811962+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:27:24.811962+0000","last_undegraded":"2024-09-11T22:27:24.811962+0000","last_fullsized":"2024-09-11T22:27:24.811962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.037818+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:28:27.037818+0000","last_peered":"2024-09-11T22:28:27.037818+0000","last_clean":"2024-09-11T22:28:27.037818+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:28:27.037818+0000","last_undegraded":"2024-09-11T22:28:27.037818+0000","last_fullsized":"2024-09-11T22:28:27.037818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801631+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:27:24.801631+0000","last_peered":"2024-09-11T22:27:24.801631+0000","last_clean":"2024-09-11T22:27:24.801631+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:27:24.801631+0000","last_undegraded":"2024-09-11T22:27:24.801631+0000","last_fullsized":"2024-09-11T22:27:24.801631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813380+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:27:24.813380+0000","last_peered":"2024-09-11T22:27:24.813380+0000","last_clean":"2024-09-11T22:27:24.813380+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:27:24.813380+0000","last_undegraded":"2024-09-11T22:27:24.813380+0000","last_fullsized":"2024-09-11T22:27:24.813380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812658+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:27:24.812658+0000","last_peered":"2024-09-11T22:27:24.812658+0000","last_clean":"2024-09-11T22:27:24.812658+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:27:24.812658+0000","last_undegraded":"2024-09-11T22:27:24.812658+0000","last_fullsized":"2024-09-11T22:27:24.812658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797795+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:27:24.797795+0000","last_peered":"2024-09-11T22:27:24.797795+0000","last_clean":"2024-09-11T22:27:24.797795+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:27:24.797795+0000","last_undegraded":"2024-09-11T22:27:24.797795+0000","last_fullsized":"2024-09-11T22:27:24.797795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814583+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:27:24.814583+0000","last_peered":"2024-09-11T22:27:24.814583+0000","last_clean":"2024-09-11T22:27:24.814583+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:27:24.814583+0000","last_undegraded":"2024-09-11T22:27:24.814583+0000","last_fullsized":"2024-09-11T22:27:24.814583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798380+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:27:24.798380+0000","last_peered":"2024-09-11T22:27:24.798380+0000","last_clean":"2024-09-11T22:27:24.798380+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:27:24.798380+0000","last_undegraded":"2024-09-11T22:27:24.798380+0000","last_fullsized":"2024-09-11T22:27:24.798380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.038203+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:28:27.038203+0000","last_peered":"2024-09-11T22:28:27.038203+0000","last_clean":"2024-09-11T22:28:27.038203+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:28:27.038203+0000","last_undegraded":"2024-09-11T22:28:27.038203+0000","last_fullsized":"2024-09-11T22:28:27.038203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801740+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:27:24.801740+0000","last_peered":"2024-09-11T22:27:24.801740+0000","last_clean":"2024-09-11T22:27:24.801740+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:27:24.801740+0000","last_undegraded":"2024-09-11T22:27:24.801740+0000","last_fullsized":"2024-09-11T22:27:24.801740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813892+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.813892+0000","last_peered":"2024-09-11T22:27:24.813892+0000","last_clean":"2024-09-11T22:27:24.813892+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:27:24.813892+0000","last_undegraded":"2024-09-11T22:27:24.813892+0000","last_fullsized":"2024-09-11T22:27:24.813892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815715+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:27:24.815715+0000","last_peered":"2024-09-11T22:27:24.815715+0000","last_clean":"2024-09-11T22:27:24.815715+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:27:24.815715+0000","last_undegraded":"2024-09-11T22:27:24.815715+0000","last_fullsized":"2024-09-11T22:27:24.815715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.037550+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:28:27.037550+0000","last_peered":"2024-09-11T22:28:27.037550+0000","last_clean":"2024-09-11T22:28:27.037550+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:28:27.037550+0000","last_undegraded":"2024-09-11T22:28:27.037550+0000","last_fullsized":"2024-09-11T22:28:27.037550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.037570+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:28:27.037570+0000","last_peered":"2024-09-11T22:28:27.037570+0000","last_clean":"2024-09-11T22:28:27.037570+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:28:27.037570+0000","last_undegraded":"2024-09-11T22:28:27.037570+0000","last_fullsized":"2024-09-11T22:28:27.037570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801704+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:27:24.801704+0000","last_peered":"2024-09-11T22:27:24.801704+0000","last_clean":"2024-09-11T22:27:24.801704+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:27:24.801704+0000","last_undegraded":"2024-09-11T22:27:24.801704+0000","last_fullsized":"2024-09-11T22:27:24.801704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812498+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:27:24.812498+0000","last_peered":"2024-09-11T22:27:24.812498+0000","last_clean":"2024-09-11T22:27:24.812498+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:27:24.812498+0000","last_undegraded":"2024-09-11T22:27:24.812498+0000","last_fullsized":"2024-09-11T22:27:24.812498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814805+0000","last_change":"2024-09-11T22:27:21.801880+0000","last_active":"2024-09-11T22:27:24.814805+0000","last_peered":"2024-09-11T22:27:24.814805+0000","last_clean":"2024-09-11T22:27:24.814805+0000","last_became_active":"2024-09-11T22:27:21.801516+0000","last_became_peered":"2024-09-11T22:27:21.801516+0000","last_unstale":"2024-09-11T22:27:24.814805+0000","last_undegraded":"2024-09-11T22:27:24.814805+0000","last_fullsized":"2024-09-11T22:27:24.814805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:51.512123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814588+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:27:24.814588+0000","last_peered":"2024-09-11T22:27:24.814588+0000","last_clean":"2024-09-11T22:27:24.814588+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:27:24.814588+0000","last_undegraded":"2024-09-11T22:27:24.814588+0000","last_fullsized":"2024-09-11T22:27:24.814588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799022+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:27:24.799022+0000","last_peered":"2024-09-11T22:27:24.799022+0000","last_clean":"2024-09-11T22:27:24.799022+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:27:24.799022+0000","last_undegraded":"2024-09-11T22:27:24.799022+0000","last_fullsized":"2024-09-11T22:27:24.799022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813970+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:27:24.813970+0000","last_peered":"2024-09-11T22:27:24.813970+0000","last_clean":"2024-09-11T22:27:24.813970+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:27:24.813970+0000","last_undegraded":"2024-09-11T22:27:24.813970+0000","last_fullsized":"2024-09-11T22:27:24.813970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797968+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:27:24.797968+0000","last_peered":"2024-09-11T22:27:24.797968+0000","last_clean":"2024-09-11T22:27:24.797968+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:27:24.797968+0000","last_undegraded":"2024-09-11T22:27:24.797968+0000","last_fullsized":"2024-09-11T22:27:24.797968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815026+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:27:24.815026+0000","last_peered":"2024-09-11T22:27:24.815026+0000","last_clean":"2024-09-11T22:27:24.815026+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:27:24.815026+0000","last_undegraded":"2024-09-11T22:27:24.815026+0000","last_fullsized":"2024-09-11T22:27:24.815026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812047+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:27:24.812047+0000","last_peered":"2024-09-11T22:27:24.812047+0000","last_clean":"2024-09-11T22:27:24.812047+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:27:24.812047+0000","last_undegraded":"2024-09-11T22:27:24.812047+0000","last_fullsized":"2024-09-11T22:27:24.812047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798965+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:27:24.798965+0000","last_peered":"2024-09-11T22:27:24.798965+0000","last_clean":"2024-09-11T22:27:24.798965+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:27:24.798965+0000","last_undegraded":"2024-09-11T22:27:24.798965+0000","last_fullsized":"2024-09-11T22:27:24.798965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813648+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:27:24.813648+0000","last_peered":"2024-09-11T22:27:24.813648+0000","last_clean":"2024-09-11T22:27:24.813648+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:27:24.813648+0000","last_undegraded":"2024-09-11T22:27:24.813648+0000","last_fullsized":"2024-09-11T22:27:24.813648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814756+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:27:24.814756+0000","last_peered":"2024-09-11T22:27:24.814756+0000","last_clean":"2024-09-11T22:27:24.814756+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:27:24.814756+0000","last_undegraded":"2024-09-11T22:27:24.814756+0000","last_fullsized":"2024-09-11T22:27:24.814756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815477+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:27:24.815477+0000","last_peered":"2024-09-11T22:27:24.815477+0000","last_clean":"2024-09-11T22:27:24.815477+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:27:24.815477+0000","last_undegraded":"2024-09-11T22:27:24.815477+0000","last_fullsized":"2024-09-11T22:27:24.815477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819448+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:27:24.819448+0000","last_peered":"2024-09-11T22:27:24.819448+0000","last_clean":"2024-09-11T22:27:24.819448+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:27:24.819448+0000","last_undegraded":"2024-09-11T22:27:24.819448+0000","last_fullsized":"2024-09-11T22:27:24.819448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812684+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:27:24.812684+0000","last_peered":"2024-09-11T22:27:24.812684+0000","last_clean":"2024-09-11T22:27:24.812684+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:27:24.812684+0000","last_undegraded":"2024-09-11T22:27:24.812684+0000","last_fullsized":"2024-09-11T22:27:24.812684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:28:23.923710+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:28:23.923710+0000","last_peered":"2024-09-11T22:28:23.923710+0000","last_clean":"2024-09-11T22:28:23.923710+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:28:23.923710+0000","last_undegraded":"2024-09-11T22:28:23.923710+0000","last_fullsized":"2024-09-11T22:28:23.923710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813564+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:27:24.813564+0000","last_peered":"2024-09-11T22:27:24.813564+0000","last_clean":"2024-09-11T22:27:24.813564+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:27:24.813564+0000","last_undegraded":"2024-09-11T22:27:24.813564+0000","last_fullsized":"2024-09-11T22:27:24.813564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.037973+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:28:27.037973+0000","last_peered":"2024-09-11T22:28:27.037973+0000","last_clean":"2024-09-11T22:28:27.037973+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:28:27.037973+0000","last_undegraded":"2024-09-11T22:28:27.037973+0000","last_fullsized":"2024-09-11T22:28:27.037973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813166+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:27:24.813166+0000","last_peered":"2024-09-11T22:27:24.813166+0000","last_clean":"2024-09-11T22:27:24.813166+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:27:24.813166+0000","last_undegraded":"2024-09-11T22:27:24.813166+0000","last_fullsized":"2024-09-11T22:27:24.813166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814871+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:27:24.814871+0000","last_peered":"2024-09-11T22:27:24.814871+0000","last_clean":"2024-09-11T22:27:24.814871+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:27:24.814871+0000","last_undegraded":"2024-09-11T22:27:24.814871+0000","last_fullsized":"2024-09-11T22:27:24.814871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814873+0000","last_change":"2024-09-11T22:27:23.821877+0000","last_active":"2024-09-11T22:27:24.814873+0000","last_peered":"2024-09-11T22:27:24.814873+0000","last_clean":"2024-09-11T22:27:24.814873+0000","last_became_active":"2024-09-11T22:27:23.821282+0000","last_became_peered":"2024-09-11T22:27:23.821282+0000","last_unstale":"2024-09-11T22:27:24.814873+0000","last_undegraded":"2024-09-11T22:27:24.814873+0000","last_fullsized":"2024-09-11T22:27:24.814873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.453027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812791+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:27:24.812791+0000","last_peered":"2024-09-11T22:27:24.812791+0000","last_clean":"2024-09-11T22:27:24.812791+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:27:24.812791+0000","last_undegraded":"2024-09-11T22:27:24.812791+0000","last_fullsized":"2024-09-11T22:27:24.812791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814443+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:27:24.814443+0000","last_peered":"2024-09-11T22:27:24.814443+0000","last_clean":"2024-09-11T22:27:24.814443+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:27:24.814443+0000","last_undegraded":"2024-09-11T22:27:24.814443+0000","last_fullsized":"2024-09-11T22:27:24.814443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820705+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:27:24.820705+0000","last_peered":"2024-09-11T22:27:24.820705+0000","last_clean":"2024-09-11T22:27:24.820705+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:27:24.820705+0000","last_undegraded":"2024-09-11T22:27:24.820705+0000","last_fullsized":"2024-09-11T22:27:24.820705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815253+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:27:24.815253+0000","last_peered":"2024-09-11T22:27:24.815253+0000","last_clean":"2024-09-11T22:27:24.815253+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:27:24.815253+0000","last_undegraded":"2024-09-11T22:27:24.815253+0000","last_fullsized":"2024-09-11T22:27:24.815253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868332+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:27:24.868332+0000","last_peered":"2024-09-11T22:27:24.868332+0000","last_clean":"2024-09-11T22:27:24.868332+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:27:24.868332+0000","last_undegraded":"2024-09-11T22:27:24.868332+0000","last_fullsized":"2024-09-11T22:27:24.868332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801823+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:27:24.801823+0000","last_peered":"2024-09-11T22:27:24.801823+0000","last_clean":"2024-09-11T22:27:24.801823+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:27:24.801823+0000","last_undegraded":"2024-09-11T22:27:24.801823+0000","last_fullsized":"2024-09-11T22:27:24.801823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819267+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:27:24.819267+0000","last_peered":"2024-09-11T22:27:24.819267+0000","last_clean":"2024-09-11T22:27:24.819267+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:27:24.819267+0000","last_undegraded":"2024-09-11T22:27:24.819267+0000","last_fullsized":"2024-09-11T22:27:24.819267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814958+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:27:24.814958+0000","last_peered":"2024-09-11T22:27:24.814958+0000","last_clean":"2024-09-11T22:27:24.814958+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:27:24.814958+0000","last_undegraded":"2024-09-11T22:27:24.814958+0000","last_fullsized":"2024-09-11T22:27:24.814958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819175+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:27:24.819175+0000","last_peered":"2024-09-11T22:27:24.819175+0000","last_clean":"2024-09-11T22:27:24.819175+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:27:24.819175+0000","last_undegraded":"2024-09-11T22:27:24.819175+0000","last_fullsized":"2024-09-11T22:27:24.819175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:25.683202+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:27:25.683202+0000","last_peered":"2024-09-11T22:27:25.683202+0000","last_clean":"2024-09-11T22:27:25.683202+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:27:25.683202+0000","last_undegraded":"2024-09-11T22:27:25.683202+0000","last_fullsized":"2024-09-11T22:27:25.683202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.038246+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:28:27.038246+0000","last_peered":"2024-09-11T22:28:27.038246+0000","last_clean":"2024-09-11T22:28:27.038246+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:28:27.038246+0000","last_undegraded":"2024-09-11T22:28:27.038246+0000","last_fullsized":"2024-09-11T22:28:27.038246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815048+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:27:24.815048+0000","last_peered":"2024-09-11T22:27:24.815048+0000","last_clean":"2024-09-11T22:27:24.815048+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:27:24.815048+0000","last_undegraded":"2024-09-11T22:27:24.815048+0000","last_fullsized":"2024-09-11T22:27:24.815048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814543+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:27:24.814543+0000","last_peered":"2024-09-11T22:27:24.814543+0000","last_clean":"2024-09-11T22:27:24.814543+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:27:24.814543+0000","last_undegraded":"2024-09-11T22:27:24.814543+0000","last_fullsized":"2024-09-11T22:27:24.814543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813387+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:27:24.813387+0000","last_peered":"2024-09-11T22:27:24.813387+0000","last_clean":"2024-09-11T22:27:24.813387+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:27:24.813387+0000","last_undegraded":"2024-09-11T22:27:24.813387+0000","last_fullsized":"2024-09-11T22:27:24.813387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798081+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:27:24.798081+0000","last_peered":"2024-09-11T22:27:24.798081+0000","last_clean":"2024-09-11T22:27:24.798081+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:27:24.798081+0000","last_undegraded":"2024-09-11T22:27:24.798081+0000","last_fullsized":"2024-09-11T22:27:24.798081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814621+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:27:24.814621+0000","last_peered":"2024-09-11T22:27:24.814621+0000","last_clean":"2024-09-11T22:27:24.814621+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:27:24.814621+0000","last_undegraded":"2024-09-11T22:27:24.814621+0000","last_fullsized":"2024-09-11T22:27:24.814621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.813647+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:27:24.813647+0000","last_peered":"2024-09-11T22:27:24.813647+0000","last_clean":"2024-09-11T22:27:24.813647+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:27:24.813647+0000","last_undegraded":"2024-09-11T22:27:24.813647+0000","last_fullsized":"2024-09-11T22:27:24.813647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814262+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:27:24.814262+0000","last_peered":"2024-09-11T22:27:24.814262+0000","last_clean":"2024-09-11T22:27:24.814262+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:27:24.814262+0000","last_undegraded":"2024-09-11T22:27:24.814262+0000","last_fullsized":"2024-09-11T22:27:24.814262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814753+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:27:24.814753+0000","last_peered":"2024-09-11T22:27:24.814753+0000","last_clean":"2024-09-11T22:27:24.814753+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:27:24.814753+0000","last_undegraded":"2024-09-11T22:27:24.814753+0000","last_fullsized":"2024-09-11T22:27:24.814753+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815264+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:27:24.815264+0000","last_peered":"2024-09-11T22:27:24.815264+0000","last_clean":"2024-09-11T22:27:24.815264+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:27:24.815264+0000","last_undegraded":"2024-09-11T22:27:24.815264+0000","last_fullsized":"2024-09-11T22:27:24.815264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798812+0000","last_change":"2024-09-11T22:27:23.809950+0000","last_active":"2024-09-11T22:27:24.798812+0000","last_peered":"2024-09-11T22:27:24.798812+0000","last_clean":"2024-09-11T22:27:24.798812+0000","last_became_active":"2024-09-11T22:27:23.809603+0000","last_became_peered":"2024-09-11T22:27:23.809603+0000","last_unstale":"2024-09-11T22:27:24.798812+0000","last_undegraded":"2024-09-11T22:27:24.798812+0000","last_fullsized":"2024-09-11T22:27:24.798812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:39.114644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812041+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:27:24.812041+0000","last_peered":"2024-09-11T22:27:24.812041+0000","last_clean":"2024-09-11T22:27:24.812041+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:27:24.812041+0000","last_undegraded":"2024-09-11T22:27:24.812041+0000","last_fullsized":"2024-09-11T22:27:24.812041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.799147+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:27:24.799147+0000","last_peered":"2024-09-11T22:27:24.799147+0000","last_clean":"2024-09-11T22:27:24.799147+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:27:24.799147+0000","last_undegraded":"2024-09-11T22:27:24.799147+0000","last_fullsized":"2024-09-11T22:27:24.799147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814326+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:27:24.814326+0000","last_peered":"2024-09-11T22:27:24.814326+0000","last_clean":"2024-09-11T22:27:24.814326+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:27:24.814326+0000","last_undegraded":"2024-09-11T22:27:24.814326+0000","last_fullsized":"2024-09-11T22:27:24.814326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.814054+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:27:24.814054+0000","last_peered":"2024-09-11T22:27:24.814054+0000","last_clean":"2024-09-11T22:27:24.814054+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:27:24.814054+0000","last_undegraded":"2024-09-11T22:27:24.814054+0000","last_fullsized":"2024-09-11T22:27:24.814054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:47.814321+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:27:47.814321+0000","last_peered":"2024-09-11T22:27:47.814321+0000","last_clean":"2024-09-11T22:27:47.814321+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:27:47.814321+0000","last_undegraded":"2024-09-11T22:27:47.814321+0000","last_fullsized":"2024-09-11T22:27:47.814321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798405+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:27:24.798405+0000","last_peered":"2024-09-11T22:27:24.798405+0000","last_clean":"2024-09-11T22:27:24.798405+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:27:24.798405+0000","last_undegraded":"2024-09-11T22:27:24.798405+0000","last_fullsized":"2024-09-11T22:27:24.798405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818326+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:27:24.818326+0000","last_peered":"2024-09-11T22:27:24.818326+0000","last_clean":"2024-09-11T22:27:24.818326+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:27:24.818326+0000","last_undegraded":"2024-09-11T22:27:24.818326+0000","last_fullsized":"2024-09-11T22:27:24.818326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815857+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:27:24.815857+0000","last_peered":"2024-09-11T22:27:24.815857+0000","last_clean":"2024-09-11T22:27:24.815857+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:27:24.815857+0000","last_undegraded":"2024-09-11T22:27:24.815857+0000","last_fullsized":"2024-09-11T22:27:24.815857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812645+0000","last_change":"2024-09-11T22:27:21.998555+0000","last_active":"2024-09-11T22:27:24.812645+0000","last_peered":"2024-09-11T22:27:24.812645+0000","last_clean":"2024-09-11T22:27:24.812645+0000","last_became_active":"2024-09-11T22:27:21.998212+0000","last_became_peered":"2024-09-11T22:27:21.998212+0000","last_unstale":"2024-09-11T22:27:24.812645+0000","last_undegraded":"2024-09-11T22:27:24.812645+0000","last_fullsized":"2024-09-11T22:27:24.812645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812139+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:27:24.812139+0000","last_peered":"2024-09-11T22:27:24.812139+0000","last_clean":"2024-09-11T22:27:24.812139+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:27:24.812139+0000","last_undegraded":"2024-09-11T22:27:24.812139+0000","last_fullsized":"2024-09-11T22:27:24.812139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797996+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:27:24.797996+0000","last_peered":"2024-09-11T22:27:24.797996+0000","last_clean":"2024-09-11T22:27:24.797996+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:27:24.797996+0000","last_undegraded":"2024-09-11T22:27:24.797996+0000","last_fullsized":"2024-09-11T22:27:24.797996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.801874+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:27:24.801874+0000","last_peered":"2024-09-11T22:27:24.801874+0000","last_clean":"2024-09-11T22:27:24.801874+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:27:24.801874+0000","last_undegraded":"2024-09-11T22:27:24.801874+0000","last_fullsized":"2024-09-11T22:27:24.801874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T22:28:27.037558+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:28:27.037558+0000","last_peered":"2024-09-11T22:28:27.037558+0000","last_clean":"2024-09-11T22:28:27.037558+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:28:27.037558+0000","last_undegraded":"2024-09-11T22:28:27.037558+0000","last_fullsized":"2024-09-11T22:28:27.037558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.797984+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:27:24.797984+0000","last_peered":"2024-09-11T22:27:24.797984+0000","last_clean":"2024-09-11T22:27:24.797984+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:27:24.797984+0000","last_undegraded":"2024-09-11T22:27:24.797984+0000","last_fullsized":"2024-09-11T22:27:24.797984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.868295+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:27:24.868295+0000","last_peered":"2024-09-11T22:27:24.868295+0000","last_clean":"2024-09-11T22:27:24.868295+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:27:24.868295+0000","last_undegraded":"2024-09-11T22:27:24.868295+0000","last_fullsized":"2024-09-11T22:27:24.868295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815268+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:27:24.815268+0000","last_peered":"2024-09-11T22:27:24.815268+0000","last_clean":"2024-09-11T22:27:24.815268+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:27:24.815268+0000","last_undegraded":"2024-09-11T22:27:24.815268+0000","last_fullsized":"2024-09-11T22:27:24.815268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815698+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:27:24.815698+0000","last_peered":"2024-09-11T22:27:24.815698+0000","last_clean":"2024-09-11T22:27:24.815698+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:27:24.815698+0000","last_undegraded":"2024-09-11T22:27:24.815698+0000","last_fullsized":"2024-09-11T22:27:24.815698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.818661+0000","last_change":"2024-09-11T22:27:21.801270+0000","last_active":"2024-09-11T22:27:24.818661+0000","last_peered":"2024-09-11T22:27:24.818661+0000","last_clean":"2024-09-11T22:27:24.818661+0000","last_became_active":"2024-09-11T22:27:21.800860+0000","last_became_peered":"2024-09-11T22:27:21.800860+0000","last_unstale":"2024-09-11T22:27:24.818661+0000","last_undegraded":"2024-09-11T22:27:24.818661+0000","last_fullsized":"2024-09-11T22:27:24.818661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:16.103906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.812510+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:27:24.812510+0000","last_peered":"2024-09-11T22:27:24.812510+0000","last_clean":"2024-09-11T22:27:24.812510+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:27:24.812510+0000","last_undegraded":"2024-09-11T22:27:24.812510+0000","last_fullsized":"2024-09-11T22:27:24.812510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.820276+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:27:24.820276+0000","last_peered":"2024-09-11T22:27:24.820276+0000","last_clean":"2024-09-11T22:27:24.820276+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:27:24.820276+0000","last_undegraded":"2024-09-11T22:27:24.820276+0000","last_fullsized":"2024-09-11T22:27:24.820276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.815290+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:27:24.815290+0000","last_peered":"2024-09-11T22:27:24.815290+0000","last_clean":"2024-09-11T22:27:24.815290+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:27:24.815290+0000","last_undegraded":"2024-09-11T22:27:24.815290+0000","last_fullsized":"2024-09-11T22:27:24.815290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798473+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:27:24.798473+0000","last_peered":"2024-09-11T22:27:24.798473+0000","last_clean":"2024-09-11T22:27:24.798473+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:27:24.798473+0000","last_undegraded":"2024-09-11T22:27:24.798473+0000","last_fullsized":"2024-09-11T22:27:24.798473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.798314+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:27:24.798314+0000","last_peered":"2024-09-11T22:27:24.798314+0000","last_clean":"2024-09-11T22:27:24.798314+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:27:24.798314+0000","last_undegraded":"2024-09-11T22:27:24.798314+0000","last_fullsized":"2024-09-11T22:27:24.798314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-11T22:27:24.819062+0000","last_change":"2024-09-11T22:27:21.796897+0000","last_active":"2024-09-11T22:27:24.819062+0000","last_peered":"2024-09-11T22:27:24.819062+0000","last_clean":"2024-09-11T22:27:24.819062+0000","last_became_active":"2024-09-11T22:27:21.796540+0000","last_became_peered":"2024-09-11T22:27:21.796540+0000","last_unstale":"2024-09-11T22:27:24.819062+0000","last_undegraded":"2024-09-11T22:27:24.819062+0000","last_fullsized":"2024-09-11T22:27:24.819062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:43.650308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":121,"num_read_kb":124,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":860160,"data_stored":416573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36852,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708300,"statfs":{"total":95995035648,"available":95957299200,"internally_reserved":0,"allocated":1544192,"data_stored":1070071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":417155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":417177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1007640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":416690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712532,"statfs":{"total":95995035648,"available":95961632768,"internally_reserved":0,"allocated":1470464,"data_stored":1007240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":416595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":416911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":479426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":479392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40356,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704796,"statfs":{"total":95995035648,"available":95953711104,"internally_reserved":0,"allocated":864256,"data_stored":416663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:28:29.054 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:28:29.054 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T22:28:29.055 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T22:28:29.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T22:28:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:29.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:29 smithi022 ceph-mon[30966]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:29.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:29 smithi022 ceph-mon[30966]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:29.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:29 smithi169 ceph-mon[35628]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:29.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:29 smithi169 ceph-mon[35628]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:29.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:29 smithi045 ceph-mon[35556]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:29.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:29 smithi045 ceph-mon[35556]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 -- 172.21.15.22:0/3565612170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c102d40 msgr2=0x7f143c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 --2- 172.21.15.22:0/3565612170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c102d40 0x7f143c103120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1430009900 tx=0x7f143002a480 comp rx=0 tx=0).stop 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 -- 172.21.15.22:0/3565612170 shutdown_connections 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 --2- 172.21.15.22:0/3565612170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c10c170 0x7f143c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 --2- 172.21.15.22:0/3565612170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c103660 0x7f143c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 --2- 172.21.15.22:0/3565612170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c102d40 0x7f143c103120 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 -- 172.21.15.22:0/3565612170 >> 172.21.15.22:0/3565612170 conn(0x7f143c0fc7a0 msgr2=0x7f143c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 -- 172.21.15.22:0/3565612170 shutdown_connections 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.784+0000 7f1442acb640 1 -- 172.21.15.22:0/3565612170 wait complete. 2024-09-11T22:28:29.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 Processor -- start 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 -- start start 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c102d40 0x7f143c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c10c170 0x7f143c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f143c112090 con 0x7f143c103660 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f143c111f10 con 0x7f143c102d40 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1442acb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f143c112210 con 0x7f143c10c170 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f143bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f143bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59966/0 (socket says 172.21.15.22:59966) 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f143bfff640 1 -- 172.21.15.22:0/1101573865 learned_addr learned my addr 172.21.15.22:0/1101573865 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1440867640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c102d40 0x7f143c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f1441068640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c10c170 0x7f143c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:29.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.785+0000 7f143bfff640 1 -- 172.21.15.22:0/1101573865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c10c170 msgr2=0x7f143c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f143bfff640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c10c170 0x7f143c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f143bfff640 1 -- 172.21.15.22:0/1101573865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c102d40 msgr2=0x7f143c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f143bfff640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c102d40 0x7f143c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f143bfff640 1 -- 172.21.15.22:0/1101573865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c1a69b0 con 0x7f143c103660 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f143bfff640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f142800d740 tx=0x7f142800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428017070 con 0x7f143c103660 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c1a6ca0 con 0x7f143c103660 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f142800de50 con 0x7f143c103660 2024-09-11T22:28:29.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142800f620 con 0x7f143c103660 2024-09-11T22:28:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.786+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1a7180 con 0x7f143c103660 2024-09-11T22:28:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.788+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c103120 con 0x7f143c103660 2024-09-11T22:28:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.789+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1428009c30 con 0x7f143c103660 2024-09-11T22:28:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.790+0000 7f1439ffb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 0x7f142c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.790+0000 7f1440867640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 0x7f142c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.790+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f14280cee10 con 0x7f143c103660 2024-09-11T22:28:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.790+0000 7f1440867640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 0x7f142c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1430009230 tx=0x7f14300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:29.794+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f142809bc40 con 0x7f143c103660 2024-09-11T22:28:30.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.005+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f143c1a74b0 con 0x7f143c103660 2024-09-11T22:28:30.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.006+0000 7f1439ffb640 1 -- 172.21.15.22:0/1101573865 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f142809b540 con 0x7f143c103660 2024-09-11T22:28:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:30.007 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 msgr2=0x7f142c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 0x7f142c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1430009230 tx=0x7f14300058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 msgr2=0x7f143c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f142800d740 tx=0x7f142800dc00 comp rx=0 tx=0).stop 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 shutdown_connections 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f142c0a2c10 0x7f142c0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f143c10c170 0x7f143c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f143c103660 0x7f143c100ee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 --2- 172.21.15.22:0/1101573865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f143c102d40 0x7f143c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 >> 172.21.15.22:0/1101573865 conn(0x7f143c0fc7a0 msgr2=0x7f143c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 shutdown_connections 2024-09-11T22:28:30.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:30.008+0000 7f1442acb640 1 -- 172.21.15.22:0/1101573865 wait complete. 2024-09-11T22:28:30.303 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:30 smithi169 ceph-mon[35628]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T22:28:30.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:30 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1101573865' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:28:30.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:30 smithi022 ceph-mon[30966]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T22:28:30.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:30 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1101573865' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:28:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:30 smithi045 ceph-mon[35556]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T22:28:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:30 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1101573865' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:28:30.709 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T22:28:30.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:30.969 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:31.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 -- 172.21.15.22:0/3627863810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 msgr2=0x7fd480106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 --2- 172.21.15.22:0/3627863810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480106f80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd468009900 tx=0x7fd46802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:31.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 -- 172.21.15.22:0/3627863810 shutdown_connections 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 --2- 172.21.15.22:0/3627863810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd48010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 --2- 172.21.15.22:0/3627863810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd480100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 --2- 172.21.15.22:0/3627863810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480106f80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 -- 172.21.15.22:0/3627863810 >> 172.21.15.22:0/3627863810 conn(0x7fd480077210 msgr2=0x7fd4800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 -- 172.21.15.22:0/3627863810 shutdown_connections 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.467+0000 7fd48707a640 1 -- 172.21.15.22:0/3627863810 wait complete. 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 Processor -- start 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 -- start start 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd4801012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd4801017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd480112260 con 0x7fd480106ba0 2024-09-11T22:28:31.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd4801120e0 con 0x7fd4801000d0 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd48707a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4801123e0 con 0x7fd480100a70 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd485617640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd485617640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59984/0 (socket says 172.21.15.22:59984) 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd485617640 1 -- 172.21.15.22:0/649711398 learned_addr learned my addr 172.21.15.22:0/649711398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd484e16640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd4801012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd47ffff640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd4801017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.468+0000 7fd485617640 1 -- 172.21.15.22:0/649711398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 msgr2=0x7fd4801017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd485617640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd4801017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd485617640 1 -- 172.21.15.22:0/649711398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 msgr2=0x7fd4801012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd485617640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd4801012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd485617640 1 -- 172.21.15.22:0/649711398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4801a6ae0 con 0x7fd480106ba0 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd484e16640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd4801012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:31.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd47ffff640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd4801017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd485617640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd47800d750 tx=0x7fd47800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478017070 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd478005520 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4801a6dd0 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478004e00 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.469+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4801a7330 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.470+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd480100530 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.471+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd478004fa0 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.472+0000 7fd47dffb640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 0x7fd46c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.472+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd4780ceb70 con 0x7fd480106ba0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.472+0000 7fd484e16640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 0x7fd46c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.472+0000 7fd484e16640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 0x7fd46c0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd468031580 tx=0x7fd468000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.476+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd47809b9a0 con 0x7fd480106ba0 2024-09-11T22:28:31.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.686+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4801a7560 con 0x7fd480106ba0 2024-09-11T22:28:31.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.687+0000 7fd47dffb640 1 -- 172.21.15.22:0/649711398 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7fd47809b2a0 con 0x7fd480106ba0 2024-09-11T22:28:31.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:31.689 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:28:31.689 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:31.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 msgr2=0x7fd46c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 0x7fd46c0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd468031580 tx=0x7fd468000bc0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 msgr2=0x7fd480101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd47800d750 tx=0x7fd47800dc10 comp rx=0 tx=0).stop 2024-09-11T22:28:31.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 shutdown_connections 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd480106ba0 0x7fd480101d30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fd46c0a2c90 0x7fd46c0a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd480100a70 0x7fd4801017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 --2- 172.21.15.22:0/649711398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4801000d0 0x7fd4801012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 >> 172.21.15.22:0/649711398 conn(0x7fd480077210 msgr2=0x7fd480104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.689+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 shutdown_connections 2024-09-11T22:28:31.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:31.690+0000 7fd48707a640 1 -- 172.21.15.22:0/649711398 wait complete. 2024-09-11T22:28:32.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:32 smithi022 ceph-mon[30966]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:28:32.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:32 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/649711398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:32.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:32.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:32 smithi169 ceph-mon[35628]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:28:32.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:32 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/649711398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:32 smithi045 ceph-mon[35556]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:28:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:32 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/649711398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:33.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 -- 172.21.15.22:0/3401158213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102ef0 msgr2=0x7f4e3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 --2- 172.21.15.22:0/3401158213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102ef0 0x7f4e3010da40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009ca0 tx=0x7f4e2802a950 comp rx=0 tx=0).stop 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 -- 172.21.15.22:0/3401158213 shutdown_connections 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 --2- 172.21.15.22:0/3401158213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102ef0 0x7f4e3010da40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 --2- 172.21.15.22:0/3401158213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102570 0x7f4e301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 --2- 172.21.15.22:0/3401158213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 0x7f4e30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 -- 172.21.15.22:0/3401158213 >> 172.21.15.22:0/3401158213 conn(0x7f4e300fc7d0 msgr2=0x7f4e300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 -- 172.21.15.22:0/3401158213 shutdown_connections 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 -- 172.21.15.22:0/3401158213 wait complete. 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.076+0000 7f4e35de0640 1 Processor -- start 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 -- start start 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 0x7f4e3010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:33.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102ef0 0x7f4e3010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30112260 con 0x7f4e30102570 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301120e0 con 0x7f4e30102ef0 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e35de0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301123e0 con 0x7f4e30100e20 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60000/0 (socket says 172.21.15.22:60000) 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 -- 172.21.15.22:0/125606118 learned_addr learned my addr 172.21.15.22:0/125606118 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2f7fe640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 0x7f4e3010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2ffff640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102ef0 0x7f4e3010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 -- 172.21.15.22:0/125606118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 msgr2=0x7f4e3010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 0x7f4e3010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 -- 172.21.15.22:0/125606118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102ef0 msgr2=0x7f4e3010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:33.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102ef0 0x7f4e3010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.077+0000 7f4e2effd640 1 -- 172.21.15.22:0/125606118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e301a6b60 con 0x7f4e30102570 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e2effd640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400b4a0 tx=0x7f4e2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24015020 con 0x7f4e30102570 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e24011d30 con 0x7f4e30102570 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e301a6e50 con 0x7f4e30102570 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400f2e0 con 0x7f4e30102570 2024-09-11T22:28:33.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.078+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e301a7300 con 0x7f4e30102570 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.079+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e30101200 con 0x7f4e30102570 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.080+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4e24018020 con 0x7f4e30102570 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.081+0000 7f4e2cff9640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 0x7f4e180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.081+0000 7f4e2f7fe640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 0x7f4e180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.081+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f4e240ce8a0 con 0x7f4e30102570 2024-09-11T22:28:33.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.081+0000 7f4e2f7fe640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 0x7f4e180a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009990 tx=0x7f4e20009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:33.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.085+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e2401f020 con 0x7f4e30102570 2024-09-11T22:28:33.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.296+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e301a7590 con 0x7f4e30102570 2024-09-11T22:28:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.297+0000 7f4e2cff9640 1 -- 172.21.15.22:0/125606118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f4e2409b7e0 con 0x7f4e30102570 2024-09-11T22:28:33.298 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:33.298 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:28:33.298 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:33.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 msgr2=0x7f4e180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:33.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 0x7f4e180a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009990 tx=0x7f4e20009110 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 msgr2=0x7f4e3010ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400b4a0 tx=0x7f4e2400b8a0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 shutdown_connections 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e30102ef0 0x7f4e3010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e30102570 0x7f4e3010ea10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4e180a2c10 0x7f4e180a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 --2- 172.21.15.22:0/125606118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e30100e20 0x7f4e3010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 >> 172.21.15.22:0/125606118 conn(0x7f4e300fc7d0 msgr2=0x7f4e30106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 shutdown_connections 2024-09-11T22:28:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:33.300+0000 7f4e35de0640 1 -- 172.21.15.22:0/125606118 wait complete. 2024-09-11T22:28:34.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:28:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:34 smithi022 ceph-mon[30966]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:34 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/125606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:34 smithi169 ceph-mon[35628]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:34.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:34 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/125606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:34 smithi045 ceph-mon[35556]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:34 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/125606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:34.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 -- 172.21.15.22:0/3306507293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 msgr2=0x7f31b410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/3306507293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b410d950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009cd0 tx=0x7f31ac02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 -- 172.21.15.22:0/3306507293 shutdown_connections 2024-09-11T22:28:34.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/3306507293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b410d950 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/3306507293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/3306507293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 -- 172.21.15.22:0/3306507293 >> 172.21.15.22:0/3306507293 conn(0x7f31b40fc7a0 msgr2=0x7f31b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 -- 172.21.15.22:0/3306507293 shutdown_connections 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.784+0000 7f31bb7c6640 1 -- 172.21.15.22:0/3306507293 wait complete. 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 Processor -- start 2024-09-11T22:28:34.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 -- start start 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b41079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31b4110fa0 con 0x7f31b4101420 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31b4110e20 con 0x7f31b4106a80 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31bb7c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31b4111120 con 0x7f31b4100a80 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31b8d61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31b8d61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43230/0 (socket says 172.21.15.22:43230) 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31b8d61640 1 -- 172.21.15.22:0/2053598866 learned_addr learned my addr 172.21.15.22:0/2053598866 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:34.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.785+0000 7f31b9d63640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b9562640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b41079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 -- 172.21.15.22:0/2053598866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 msgr2=0x7f31b41079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b41079f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 -- 172.21.15.22:0/2053598866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 msgr2=0x7f31b4108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 -- 172.21.15.22:0/2053598866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b41a6970 con 0x7f31b4101420 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b9d63640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b9562640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b41079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31b8d61640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d770 tx=0x7f31a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4017070 con 0x7f31b4101420 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31a4005520 con 0x7f31b4101420 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b41a6c60 con 0x7f31b4101420 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4010460 con 0x7f31b4101420 2024-09-11T22:28:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.786+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b41a7150 con 0x7f31b4101420 2024-09-11T22:28:34.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.787+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b4106e60 con 0x7f31b4101420 2024-09-11T22:28:34.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.788+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f31a4004ea0 con 0x7f31b4101420 2024-09-11T22:28:34.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.789+0000 7f31aa7fc640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 0x7f31a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.789+0000 7f31b9562640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 0x7f31a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.789+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f31a40ced60 con 0x7f31b4101420 2024-09-11T22:28:34.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.790+0000 7f31b9562640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 0x7f31a00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009ab0 tx=0x7f31b00094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.793+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31a409bb90 con 0x7f31b4101420 2024-09-11T22:28:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.970+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31b41a73f0 con 0x7f31b4101420 2024-09-11T22:28:34.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.972+0000 7f31aa7fc640 1 -- 172.21.15.22:0/2053598866 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22642 (secure 0 0 0) 0x7f31a409b490 con 0x7f31b4101420 2024-09-11T22:28:34.973 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:34.973 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":82,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:28:28.029994+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:28:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 msgr2=0x7f31a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 0x7f31a00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009ab0 tx=0x7f31b00094b0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 msgr2=0x7f31b4107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d770 tx=0x7f31a400dc30 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 shutdown_connections 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b4106a80 0x7f31b4108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31b4101420 0x7f31b4107f30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f31a00a2c10 0x7f31a00a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 --2- 172.21.15.22:0/2053598866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b4100a80 0x7f31b41079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 >> 172.21.15.22:0/2053598866 conn(0x7f31b40fc7a0 msgr2=0x7f31b4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 shutdown_connections 2024-09-11T22:28:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:34.974+0000 7f31bb7c6640 1 -- 172.21.15.22:0/2053598866 wait complete. 2024-09-11T22:28:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:35 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2053598866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:35.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:35 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2053598866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:35.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:35 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2053598866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:35.560 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:35.821 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:36.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:36 smithi022 ceph-mon[30966]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:36.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 -- 172.21.15.22:0/949791222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc103660 msgr2=0x7f76dc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:36.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 --2- 172.21.15.22:0/949791222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc103660 0x7f76dc10bb50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009900 tx=0x7f76c402a480 comp rx=0 tx=0).stop 2024-09-11T22:28:36.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 -- 172.21.15.22:0/949791222 shutdown_connections 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 --2- 172.21.15.22:0/949791222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc10c170 0x7f76dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 --2- 172.21.15.22:0/949791222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc103660 0x7f76dc10bb50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 --2- 172.21.15.22:0/949791222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc102d40 0x7f76dc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 -- 172.21.15.22:0/949791222 >> 172.21.15.22:0/949791222 conn(0x7f76dc0fc7a0 msgr2=0x7f76dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 -- 172.21.15.22:0/949791222 shutdown_connections 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.256+0000 7f76e19b1640 1 -- 172.21.15.22:0/949791222 wait complete. 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.257+0000 7f76e19b1640 1 Processor -- start 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.257+0000 7f76e19b1640 1 -- start start 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc103660 0x7f76dc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 0x7f76dc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:36.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc112090 con 0x7f76dc102d40 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc111f10 con 0x7f76dc10c170 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc112210 con 0x7f76dc103660 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43256/0 (socket says 172.21.15.22:43256) 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 -- 172.21.15.22:0/3830450268 learned_addr learned my addr 172.21.15.22:0/3830450268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76db7fe640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 0x7f76dc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76d27fc640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc103660 0x7f76dc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 -- 172.21.15.22:0/3830450268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc103660 msgr2=0x7f76dc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc103660 0x7f76dc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 -- 172.21.15.22:0/3830450268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 msgr2=0x7f76dc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 0x7f76dc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 -- 172.21.15.22:0/3830450268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc19d3c0 con 0x7f76dc102d40 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76db7fe640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 0x7f76dc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76daffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00c920 tx=0x7f76cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc007c70 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.258+0000 7f76e19b1640 1 -- 172.21.15.22:0/3830450268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc19d6b0 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.259+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76cc007e10 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.259+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc018940 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.259+0000 7f76e19b1640 1 -- 172.21.15.22:0/3830450268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc1a4f90 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.260+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c0005290 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.261+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f76cc018b20 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.261+0000 7f76e09af640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 0x7f76c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.261+0000 7f76d27fc640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 0x7f76c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.261+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f76cc0cf3f0 con 0x7f76dc102d40 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.262+0000 7f76d27fc640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 0x7f76c80a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76dc10d420 tx=0x7f76c40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.265+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76cc014030 con 0x7f76dc102d40 2024-09-11T22:28:36.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:36 smithi169 ceph-mon[35628]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:36.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:36 smithi045 ceph-mon[35556]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-11T22:28:36.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.480+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c0005850 con 0x7f76dc102d40 2024-09-11T22:28:36.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.481+0000 7f76e09af640 1 -- 172.21.15.22:0/3830450268 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f76cc09c220 con 0x7f76dc102d40 2024-09-11T22:28:36.482 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:36.482 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:28:36.482 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:36.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 msgr2=0x7f76c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:36.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 0x7f76c80a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76dc10d420 tx=0x7f76c40095f0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 msgr2=0x7f76dc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:36.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00c920 tx=0x7f76cc00cde0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 shutdown_connections 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc10c170 0x7f76dc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f76c80a2c10 0x7f76c80a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76dc103660 0x7f76dc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 --2- 172.21.15.22:0/3830450268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76dc102d40 0x7f76dc198410 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 >> 172.21.15.22:0/3830450268 conn(0x7f76dc0fc7a0 msgr2=0x7f76dc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 shutdown_connections 2024-09-11T22:28:36.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:36.483+0000 7f76d2ffd640 1 -- 172.21.15.22:0/3830450268 wait complete. 2024-09-11T22:28:37.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:27:24.459196+0000', 'modified': '2024-09-11T22:27:33.502987+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/1224562712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 1224562712}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 1224562712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6839/2293732037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 2293732037}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 2293732037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-11T22:28:37.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:28:37.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:28:37.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:37 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3830450268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:37.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:37 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3830450268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:37.403 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:37.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:37 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3830450268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 -- 172.21.15.22:0/4016177808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102570 msgr2=0x7f1f901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 --2- 172.21.15.22:0/4016177808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102570 0x7f1f901029b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009900 tx=0x7f1f8402a480 comp rx=0 tx=0).stop 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 -- 172.21.15.22:0/4016177808 shutdown_connections 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 --2- 172.21.15.22:0/4016177808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102ef0 0x7f1f9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 --2- 172.21.15.22:0/4016177808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102570 0x7f1f901029b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 --2- 172.21.15.22:0/4016177808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 -- 172.21.15.22:0/4016177808 >> 172.21.15.22:0/4016177808 conn(0x7f1f900fc7d0 msgr2=0x7f1f900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 -- 172.21.15.22:0/4016177808 shutdown_connections 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.864+0000 7f1f95faa640 1 -- 172.21.15.22:0/4016177808 wait complete. 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 Processor -- start 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 -- start start 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f901984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 0x7f1f90198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1f90111070 con 0x7f1f90102ef0 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1f90110ef0 con 0x7f1f90100e20 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f95faa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1f901111f0 con 0x7f1f90102570 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43272/0 (socket says 172.21.15.22:43272) 2024-09-11T22:28:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 -- 172.21.15.22:0/3353381014 learned_addr learned my addr 172.21.15.22:0/3353381014 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 0x7f1f90198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f901984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 -- 172.21.15.22:0/3353381014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 msgr2=0x7f1f90198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 0x7f1f90198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 -- 172.21.15.22:0/3353381014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 msgr2=0x7f1f901984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f901984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8ffff640 1 -- 172.21.15.22:0/3353381014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9019d470 con 0x7f1f90102ef0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.865+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 0x7f1f90198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f901984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f8ffff640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c970 tx=0x7f1f8800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f8cff9640 1 -- 172.21.15.22:0/3353381014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88007bb0 con 0x7f1f90102ef0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f8cff9640 1 -- 172.21.15.22:0/3353381014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f88007d50 con 0x7f1f90102ef0 2024-09-11T22:28:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9019d760 con 0x7f1f90102ef0 2024-09-11T22:28:37.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f8cff9640 1 -- 172.21.15.22:0/3353381014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f880188a0 con 0x7f1f90102ef0 2024-09-11T22:28:37.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.866+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f901a5040 con 0x7f1f90102ef0 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f8cff9640 1 -- 172.21.15.22:0/3353381014 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1f8800f450 con 0x7f1f90102ef0 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 Processor -- start 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 -- start start 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a71edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a729670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56518a685090 con 0x56518a729bb0 2024-09-11T22:28:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56518a62ca70 con 0x56518a71f2f0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f98383740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56518a681050 con 0x56518a71e9d0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43288/0 (socket says 172.21.15.22:43288) 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.869+0000 7f1f8effd640 1 -- 172.21.15.22:0/2669307462 learned_addr learned my addr 172.21.15.22:0/2669307462 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8cff9640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 0x7f1f780a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a71edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 -- 172.21.15.22:0/2669307462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 msgr2=0x56518a71edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a71edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 -- 172.21.15.22:0/2669307462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 msgr2=0x56518a729670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a729670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 -- 172.21.15.22:0/2669307462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518a639130 con 0x56518a729bb0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8cff9640 1 -- 172.21.15.22:0/3353381014 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1f880cf250 con 0x7f1f90102ef0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8ffff640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 0x7f1f780a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f8effd640 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a9a0 tx=0x7f1f840095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6015ba64e4e801b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f75ffb640 1 -- 172.21.15.22:0/2669307462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84035040 con 0x56518a729bb0 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f75ffb640 1 -- 172.21.15.22:0/2669307462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f84031830 con 0x56518a729bb0 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.870+0000 7f1f75ffb640 1 -- 172.21.15.22:0/2669307462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840047a0 con 0x56518a729bb0 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 -- 172.21.15.22:0/2669307462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 msgr2=0x56518a72bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f8ffff640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 0x7f1f780a5220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f880cd1b0 tx=0x7f1f8800feb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a9a0 tx=0x7f1f840095e0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 -- 172.21.15.22:0/2669307462 shutdown_connections 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a72bfa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a729670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 --2- 172.21.15.22:0/2669307462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a71edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 -- 172.21.15.22:0/2669307462 >> 172.21.15.22:0/2669307462 conn(0x56518a71af60 msgr2=0x56518a71b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 -- 172.21.15.22:0/2669307462 shutdown_connections 2024-09-11T22:28:37.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.871+0000 7f1f98383740 1 -- 172.21.15.22:0/2669307462 wait complete. 2024-09-11T22:28:37.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 -- start start 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 Processor -- start 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a729420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a726770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56518a730b90 con 0x56518a729bb0 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56518a63ff20 con 0x56518a71e9d0 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56518a730d10 con 0x56518a71f2f0 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f98383740 10 client.0 _ll_register_callbacks cb 0x56518a609030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43298/0 (socket says 172.21.15.22:43298) 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f8effd640 1 -- 172.21.15.22:0/1878377216 learned_addr learned my addr 172.21.15.22:0/1878377216 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a726770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.872+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a729420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 -- 172.21.15.22:0/1878377216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 msgr2=0x56518a726770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a726770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 -- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 msgr2=0x56518a729420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a729420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 -- 172.21.15.22:0/1878377216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518a3f62b0 con 0x56518a729bb0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1f84045040 tx=0x7f1f84005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85058ef4cbc4c42a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840049a0 con 0x56518a729bb0 2024-09-11T22:28:37.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f84031830 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1f84004b40 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1f840319e0 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f98383740 10 client.14952 fetch_fsmap learned FSMap version 20 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56518a73c480 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.873+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f84031830 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1f8403a040 con 0x56518a729bb0 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 10 client.14952 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 10 client.14952 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:37.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 20 client.14952 populate_metadata read hostname 'smithi022' 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a73e5e0 0x56518a73fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 4 client.14952 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56518a692600 con 0x56518a73e5e0 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a73e5e0 0x56518a73fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a73e5e0 0x56518a73fa50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a6dcd3d13f16c0 server_cookie=13e4d07056ce2814 in_seq=0 out_seq=0 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.874+0000 7f1f6effd640 10 client.14952 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.875+0000 7f1f6effd640 1 -- 172.21.15.22:0/1878377216 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56518a692600 con 0x56518a73e5e0 2024-09-11T22:28:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.875+0000 7f1f6effd640 10 client.14952 handle_command_reply: tid=0 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.875+0000 7f1f98383740 1 client.14952 shutdown 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.875+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 msgr2=0x56518a726cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.875+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1f84045040 tx=0x7f1f84005370 comp rx=0 tx=0).stop 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 shutdown_connections 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a73e5e0 0x56518a73fa50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a726cb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a726770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 --2- 172.21.15.22:0/1878377216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a729420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f6effd640 0 client.14952 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 >> 172.21.15.22:0/1878377216 conn(0x56518a71af60 msgr2=0x56518a720c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 shutdown_connections 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 1 -- 172.21.15.22:0/1878377216 wait complete. 2024-09-11T22:28:37.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.876+0000 7f1f98383740 20 client.14952 trim_cache size 0 max 16384 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.893+0000 7f1f98383740 1 Processor -- start 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.893+0000 7f1f98383740 1 -- start start 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a73fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a726030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56518a73dd90 con 0x56518a729bb0 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56518a73e460 con 0x56518a71f2f0 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f98383740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56518a73eb30 con 0x56518a71e9d0 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43314/0 (socket says 172.21.15.22:43314) 2024-09-11T22:28:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 -- 172.21.15.22:0/1977864691 learned_addr learned my addr 172.21.15.22:0/1977864691 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a726030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 -- 172.21.15.22:0/1977864691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 msgr2=0x56518a73fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a73fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 -- 172.21.15.22:0/1977864691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 msgr2=0x56518a726030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a726030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 -- 172.21.15.22:0/1977864691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518a729040 con 0x56518a729bb0 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a726030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f8effd640 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f840053e0 tx=0x7f1f84032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0738a4ea1392a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f757fa640 1 -- 172.21.15.22:0/1977864691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84035070 con 0x56518a729bb0 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f757fa640 1 -- 172.21.15.22:0/1977864691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f84053070 con 0x56518a729bb0 2024-09-11T22:28:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.894+0000 7f1f757fa640 1 -- 172.21.15.22:0/1977864691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84031de0 con 0x56518a729bb0 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- 172.21.15.22:0/1977864691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 msgr2=0x56518a729420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f840053e0 tx=0x7f1f84032f10 comp rx=0 tx=0).stop 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- 172.21.15.22:0/1977864691 shutdown_connections 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a729420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71f2f0 0x56518a726030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 --2- 172.21.15.22:0/1977864691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71e9d0 0x56518a73fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- 172.21.15.22:0/1977864691 >> 172.21.15.22:0/1977864691 conn(0x56518a71af60 msgr2=0x56518a71b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- 172.21.15.22:0/1977864691 shutdown_connections 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- 172.21.15.22:0/1977864691 wait complete. 2024-09-11T22:28:37.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.895+0000 7f1f98383740 1 -- start start 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 Processor -- start 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a747f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a7484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56518a73f8d0 con 0x56518a729bb0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56518a73f200 con 0x56518a71e9d0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56518a73ffa0 con 0x56518a71f2f0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f98383740 10 client.0 _ll_register_callbacks cb 0x7f1f840315e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43328/0 (socket says 172.21.15.22:43328) 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 -- 172.21.15.22:0/3794936477 learned_addr learned my addr 172.21.15.22:0/3794936477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a7484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a747f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 -- 172.21.15.22:0/3794936477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 msgr2=0x56518a7484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a7484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 -- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 msgr2=0x56518a747f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a747f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 -- 172.21.15.22:0/3794936477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518a741ad0 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f8effd640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a9a0 tx=0x7f1f84031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1501bf75f77bd65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.896+0000 7f1f6effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84035040 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1f8405aa80 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f84053070 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1f8405aca0 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 10 client.14958 fetch_fsmap learned FSMap version 20 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56518a7465b0 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f84053070 con 0x56518a729bb0 2024-09-11T22:28:37.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1f84004a40 con 0x56518a729bb0 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 10 client.14958 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 10 client.14958 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 20 client.14958 populate_metadata read hostname 'smithi022' 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a7ace80 0x56518a7abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 4 client.14958 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.897+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "status"}) -- 0x56518a68cb10 con 0x56518a7ace80 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a7ace80 0x56518a7abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f8f7fe640 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a7ace80 0x56518a7abb90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d297f17ca12b6e server_cookie=88cfc4185d699076 in_seq=0 out_seq=0 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f6effd640 10 client.14958 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f6effd640 1 -- 172.21.15.22:0/3794936477 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56518a68cb10 con 0x56518a7ace80 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f6effd640 10 client.14958 handle_command_reply: tid=0 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 client.14958 shutdown 2024-09-11T22:28:37.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 msgr2=0x56518a7412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402a9a0 tx=0x7f1f84031690 comp rx=0 tx=0).stop 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 shutdown_connections 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56518a7ace80 0x56518a7abb90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56518a729bb0 0x56518a7412a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56518a71f2f0 0x56518a7484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 --2- 172.21.15.22:0/3794936477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56518a71e9d0 0x56518a747f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.898+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 >> 172.21.15.22:0/3794936477 conn(0x56518a71af60 msgr2=0x56518a721de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f6effd640 0 client.14958 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 shutdown_connections 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f98383740 1 -- 172.21.15.22:0/3794936477 wait complete. 2024-09-11T22:28:37.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f98383740 20 client.14958 trim_cache size 0 max 16384 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24497, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 73.093875159999996, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 20, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 82, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 80, 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 83.825884694999999 2024-09-11T22:28:37.906 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 msgr2=0x7f1f780a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 0x7f1f780a5220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f880cd1b0 tx=0x7f1f8800feb0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 msgr2=0x7f1f9019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c970 tx=0x7f1f8800ce30 comp rx=0 tx=0).stop 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 shutdown_connections 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f90102ef0 0x7f1f9019cd90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1f780a2d60 0x7f1f780a5220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f90102570 0x7f1f90198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 --2- 172.21.15.22:0/3353381014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f90100e20 0x7f1f901984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 >> 172.21.15.22:0/3353381014 conn(0x7f1f900fc7d0 msgr2=0x7f1f9006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 shutdown_connections 2024-09-11T22:28:37.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:37.899+0000 7f1f95faa640 1 -- 172.21.15.22:0/3353381014 wait complete. 2024-09-11T22:28:38.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:38 smithi022 ceph-mon[30966]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-11T22:28:38.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:38 smithi169 ceph-mon[35628]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-11T22:28:38.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:38 smithi045 ceph-mon[35556]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 60 B/s, 0 objects/s recovering 2024-09-11T22:28:38.562 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T22:28:38.562 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:28:38.572 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:28:38.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T22:28:38.830 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:39.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.313+0000 7fb8fe2db640 1 -- 172.21.15.22:0/595715808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 msgr2=0x7fb8f8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.313+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/595715808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f8108f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009ca0 tx=0x7fb8f002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 -- 172.21.15.22:0/595715808 shutdown_connections 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/595715808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f8108f40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/595715808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/595715808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 0x7fb8f8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 -- 172.21.15.22:0/595715808 >> 172.21.15.22:0/595715808 conn(0x7fb8f80fc2a0 msgr2=0x7fb8f80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 -- 172.21.15.22:0/595715808 shutdown_connections 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 -- 172.21.15.22:0/595715808 wait complete. 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 Processor -- start 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.314+0000 7fb8fe2db640 1 -- start start 2024-09-11T22:28:39.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 0x7fb8f810b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f810d9c0 con 0x7fb8f81026b0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f810d840 con 0x7fb8f8101cf0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fe2db640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f810db40 con 0x7fb8f8100af0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43348/0 (socket says 172.21.15.22:43348) 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 -- 172.21.15.22:0/3236005797 learned_addr learned my addr 172.21.15.22:0/3236005797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8f7fff640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 0x7fb8f810b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8f77fe640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 -- 172.21.15.22:0/3236005797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 msgr2=0x7fb8f810b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 0x7fb8f810b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 -- 172.21.15.22:0/3236005797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 msgr2=0x7fb8f8109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 -- 172.21.15.22:0/3236005797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f810a8c0 con 0x7fb8f81026b0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8f77fe640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.315+0000 7fb8fc878640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0031a40 tx=0x7fb8f0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.316+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f002fbe0 con 0x7fb8f81026b0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.316+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8f002fd80 con 0x7fb8f81026b0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.316+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f81a20b0 con 0x7fb8f81026b0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.316+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0046980 con 0x7fb8f81026b0 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.316+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f81a25c0 con 0x7fb8f81026b0 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.317+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f8100ef0 con 0x7fb8f81026b0 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.318+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8f0030ce0 con 0x7fb8f81026b0 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.319+0000 7fb8f57fa640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 0x7fb8e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.319+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fb8f00f09a0 con 0x7fb8f81026b0 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.319+0000 7fb8f7fff640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 0x7fb8e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.319+0000 7fb8f7fff640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 0x7fb8e00a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8005fd0 tx=0x7fb8e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:39.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.322+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8f00821b0 con 0x7fb8f81026b0 2024-09-11T22:28:39.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.515+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb8f81a28b0 con 0x7fb8e00a2c10 2024-09-11T22:28:39.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.516+0000 7fb8f57fa640 1 -- 172.21.15.22:0/3236005797 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb8f81a28b0 con 0x7fb8e00a2c10 2024-09-11T22:28:39.517 INFO:teuthology.orchestra.run.smithi022.stdout:Backend: cephadm 2024-09-11T22:28:39.517 INFO:teuthology.orchestra.run.smithi022.stdout:Available: Yes 2024-09-11T22:28:39.517 INFO:teuthology.orchestra.run.smithi022.stdout:Paused: No 2024-09-11T22:28:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 msgr2=0x7fb8e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 0x7fb8e00a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8005fd0 tx=0x7fb8e800b390 comp rx=0 tx=0).stop 2024-09-11T22:28:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 msgr2=0x7fb8f810a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0031a40 tx=0x7fb8f0031ee0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 shutdown_connections 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8f81026b0 0x7fb8f810a000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8101cf0 0x7fb8f8109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fb8e00a2c10 0x7fb8e00a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 --2- 172.21.15.22:0/3236005797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb8f8100af0 0x7fb8f810b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 >> 172.21.15.22:0/3236005797 conn(0x7fb8f80fc2a0 msgr2=0x7fb8f80fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.518+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 shutdown_connections 2024-09-11T22:28:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:39.519+0000 7fb8fe2db640 1 -- 172.21.15.22:0/3236005797 wait complete. 2024-09-11T22:28:40.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T22:28:40.199 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:40 smithi022 ceph-mon[30966]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-11T22:28:40.199 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:40 smithi022 ceph-mon[30966]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:40.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:40 smithi169 ceph-mon[35628]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-11T22:28:40.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:40 smithi169 ceph-mon[35628]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:40 smithi045 ceph-mon[35556]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s; 54 B/s, 0 objects/s recovering 2024-09-11T22:28:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:40 smithi045 ceph-mon[35556]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:40.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 -- 172.21.15.22:0/2218700002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478102690 msgr2=0x7f7478108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 --2- 172.21.15.22:0/2218700002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478102690 0x7f7478108f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7470009ca0 tx=0x7f747002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 -- 172.21.15.22:0/2218700002 shutdown_connections 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 --2- 172.21.15.22:0/2218700002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478102690 0x7f7478108f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 --2- 172.21.15.22:0/2218700002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478101cd0 0x7f7478102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 --2- 172.21.15.22:0/2218700002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 -- 172.21.15.22:0/2218700002 >> 172.21.15.22:0/2218700002 conn(0x7f74780fc280 msgr2=0x7f74780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 -- 172.21.15.22:0/2218700002 shutdown_connections 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.878+0000 7f747cf56640 1 -- 172.21.15.22:0/2218700002 wait complete. 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 Processor -- start 2024-09-11T22:28:40.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 -- start start 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 0x7f747819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f747810c880 con 0x7f7478101cd0 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f747810c700 con 0x7f7478102690 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f747cf56640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f747810ca00 con 0x7f7478100ad0 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f7475d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f7475d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43364/0 (socket says 172.21.15.22:43364) 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.879+0000 7f7475d9b640 1 -- 172.21.15.22:0/243981241 learned_addr learned my addr 172.21.15.22:0/243981241 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f747659c640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:40.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 -- 172.21.15.22:0/243981241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 msgr2=0x7f7478197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 -- 172.21.15.22:0/243981241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 msgr2=0x7f747819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7476d9d640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 0x7f747819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 0x7f747819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 -- 172.21.15.22:0/243981241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747819fb90 con 0x7f7478101cd0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f747659c640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7476d9d640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 0x7f747819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f7475d9b640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f746800c890 tx=0x7f746800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004220 con 0x7f7478101cd0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74680043c0 con 0x7f7478101cd0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747819fe80 con 0x7f7478101cd0 2024-09-11T22:28:40.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004b10 con 0x7f7478101cd0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.880+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74781a0380 con 0x7f7478101cd0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.881+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74781a0610 con 0x7f7478101cd0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.882+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f74680051b0 con 0x7f7478101cd0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.883+0000 7f746f7fe640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 0x7f74640a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.883+0000 7f747659c640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 0x7f74640a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.883+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f74680ceec0 con 0x7f7478101cd0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.884+0000 7f747659c640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 0x7f74640a5180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7478101b30 tx=0x7f7460005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:40.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:40.887+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7468014030 con 0x7f7478101cd0 2024-09-11T22:28:41.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.073+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f74781a07e0 con 0x7f74640a2cc0 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.085+0000 7f746f7fe640 1 -- 172.21.15.22:0/243981241 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f74781a07e0 con 0x7f74640a2cc0 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stdout:mds.a smithi022 running (90s) 13s ago 89s 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 138a89153760 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stdout:mds.b smithi045 running (87s) 19s ago 86s 26.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 d4026cdd82b5 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stdout:mds.c smithi169 running (101s) 20s ago 100s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 883fa02f9d68 2024-09-11T22:28:41.087 INFO:teuthology.orchestra.run.smithi022.stdout:mds.d smithi022 running (108s) 13s ago 108s 14.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 9559ef3a84d0 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.e smithi045 running (105s) 19s ago 105s 16.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 8683002695a8 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.f smithi169 running (103s) 20s ago 103s 16.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 75b57df03c22 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.g smithi022 running (93s) 13s ago 92s 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 cf2691251d42 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.h smithi045 running (98s) 19s ago 98s 20.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 bb111e6fd645 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.i smithi169 running (95s) 20s ago 95s 14.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 e66ab1dcccfb 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.j smithi022 running (112s) 13s ago 111s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 f929a19eb09c 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.k smithi045 running (115s) 19s ago 115s 13.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 36414c2906b6 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mds.l smithi169 running (118s) 20s ago 117s 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 971d30a251df 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.x smithi022 *:9283,8765 running (8m) 13s ago 8m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 f9dbecf47ba2 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.y smithi045 *:8443,8765 running (7m) 19s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 d1ac30208fdf 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.z smithi169 *:8443,8765 running (7m) 20s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 12185625f144 2024-09-11T22:28:41.088 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a smithi022 running (9m) 13s ago 9m 51.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 dbb7de54a696 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b smithi045 running (7m) 19s ago 7m 41.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 8a8450ed3274 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c smithi169 running (7m) 20s ago 7m 41.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 6e1d4cb557d3 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 smithi022 running (6m) 13s ago 6m 56.3M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 4efdf1d747d5 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 smithi045 running (6m) 19s ago 6m 54.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 c798d1fb2205 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 smithi169 running (6m) 20s ago 6m 52.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 79aa3d139467 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 smithi022 running (5m) 13s ago 5m 48.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 20b0ce63cb6d 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 smithi045 running (5m) 19s ago 5m 45.6M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 f355e034f290 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 smithi169 running (4m) 20s ago 4m 54.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 816d00633a67 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 smithi022 running (4m) 13s ago 4m 44.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 d6a2bbf7a1d8 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 smithi045 running (3m) 19s ago 3m 47.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 c9a8bcb1f05d 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 smithi169 running (3m) 20s ago 3m 51.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 63e970c3cfc2 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 smithi022 running (3m) 13s ago 3m 50.2M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1a3a67bd68b9 2024-09-11T22:28:41.089 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 smithi045 running (2m) 19s ago 2m 53.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 163614b1d7f5 2024-09-11T22:28:41.090 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 smithi169 running (2m) 20s ago 2m 49.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e22f46a3fd6e 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.087+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 msgr2=0x7f74640a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.087+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 0x7f74640a5180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7478101b30 tx=0x7f7460005db0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.087+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 msgr2=0x7f74781984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.087+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f746800c890 tx=0x7f746800cd50 comp rx=0 tx=0).stop 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 shutdown_connections 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7478102690 0x7f747819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7478101cd0 0x7f74781984a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f74640a2cc0 0x7f74640a5180 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 --2- 172.21.15.22:0/243981241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7478100ad0 0x7f7478197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 >> 172.21.15.22:0/243981241 conn(0x7f74780fc280 msgr2=0x7f74780fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:41.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 shutdown_connections 2024-09-11T22:28:41.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:41.088+0000 7f747cf56640 1 -- 172.21.15.22:0/243981241 wait complete. 2024-09-11T22:28:41.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T22:28:42.088 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:42.330 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:42 smithi022 ceph-mon[30966]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:42.352 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:42 smithi022 ceph-mon[30966]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:42.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:42 smithi169 ceph-mon[35628]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:42.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:42 smithi169 ceph-mon[35628]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:42.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:42 smithi045 ceph-mon[35556]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:42.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:42 smithi045 ceph-mon[35556]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/152914013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18100ad0 msgr2=0x7ffa18100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/152914013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18100ad0 0x7ffa18100ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009900 tx=0x7ffa0c02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/152914013 shutdown_connections 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/152914013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18102690 0x7ffa18108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/152914013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18101cd0 0x7ffa18102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/152914013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18100ad0 0x7ffa18100ed0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/152914013 >> 172.21.15.22:0/152914013 conn(0x7ffa180fc280 msgr2=0x7ffa180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/152914013 shutdown_connections 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/152914013 wait complete. 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 Processor -- start 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.553+0000 7ffa1f0b3640 1 -- start start 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 0x7ffa1819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 0x7ffa1819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1810c970 con 0x7ffa18102690 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1810c7f0 con 0x7ffa18101cd0 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1810caf0 con 0x7ffa18100ad0 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43394/0 (socket says 172.21.15.22:43394) 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 -- 172.21.15.22:0/1132515379 learned_addr learned my addr 172.21.15.22:0/1132515379 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa17fff640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 0x7ffa1819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1ce4f640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 0x7ffa1819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 -- 172.21.15.22:0/1132515379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 msgr2=0x7ffa1819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 0x7ffa1819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 -- 172.21.15.22:0/1132515379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 msgr2=0x7ffa1819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 0x7ffa1819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 -- 172.21.15.22:0/1132515379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa181a2030 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1ce4f640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 0x7ffa1819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa17fff640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 0x7ffa1819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1d650640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000b970 tx=0x7ffa1000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10019070 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa181a2320 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa1000cb40 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.554+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10007700 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.555+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa181a2890 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.555+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa181a2b50 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.557+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa1001c070 con 0x7ffa18102690 2024-09-11T22:28:42.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.557+0000 7ffa15ffb640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 0x7ffa080a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.557+0000 7ffa1ce4f640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 0x7ffa080a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.557+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ffa100ce6a0 con 0x7ffa18102690 2024-09-11T22:28:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.558+0000 7ffa1ce4f640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 0x7ffa080a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0096c0 tx=0x7ffa0c005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.562+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa1009b5e0 con 0x7ffa18102690 2024-09-11T22:28:42.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.744+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ffa181a2d20 con 0x7ffa080a2c40 2024-09-11T22:28:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.750+0000 7ffa15ffb640 1 -- 172.21.15.22:0/1132515379 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ffa181a2d20 con 0x7ffa080a2c40 2024-09-11T22:28:42.752 INFO:teuthology.orchestra.run.smithi022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T22:28:42.752 INFO:teuthology.orchestra.run.smithi022.stdout:mds.all 12/12 21s ago 2m smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi045=b;smithi045=e;smithi045=h;smithi045=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-11T22:28:42.752 INFO:teuthology.orchestra.run.smithi022.stdout:mgr 3/3 21s ago 7m smithi022=x;smithi045=y;smithi169=z;count:3 2024-09-11T22:28:42.753 INFO:teuthology.orchestra.run.smithi022.stdout:mon 3/3 21s ago 7m smithi022:172.21.15.22=a;smithi045:172.21.15.45=b;smithi169:172.21.15.169=c;count:3 2024-09-11T22:28:42.753 INFO:teuthology.orchestra.run.smithi022.stdout:osd 12 21s ago - 2024-09-11T22:28:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 msgr2=0x7ffa080a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 0x7ffa080a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0096c0 tx=0x7ffa0c005be0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 msgr2=0x7ffa181a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000b970 tx=0x7ffa1000be30 comp rx=0 tx=0).stop 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 shutdown_connections 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa18102690 0x7ffa181a19c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa18101cd0 0x7ffa1819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7ffa080a2c40 0x7ffa080a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 --2- 172.21.15.22:0/1132515379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa18100ad0 0x7ffa1819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 >> 172.21.15.22:0/1132515379 conn(0x7ffa180fc280 msgr2=0x7ffa1806a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 shutdown_connections 2024-09-11T22:28:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:42.752+0000 7ffa1f0b3640 1 -- 172.21.15.22:0/1132515379 wait complete. 2024-09-11T22:28:43.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T22:28:43.702 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:44.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:44 smithi022 ceph-mon[30966]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:44.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:44 smithi022 ceph-mon[30966]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:44.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 -- 172.21.15.22:0/1075406755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 msgr2=0x7f16f010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:44.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 --2- 172.21.15.22:0/1075406755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f010a050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009ca0 tx=0x7f16e802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 -- 172.21.15.22:0/1075406755 shutdown_connections 2024-09-11T22:28:44.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 --2- 172.21.15.22:0/1075406755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f010a050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 --2- 172.21.15.22:0/1075406755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0102e00 0x7f16f0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 --2- 172.21.15.22:0/1075406755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0101c00 0x7f16f0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 -- 172.21.15.22:0/1075406755 >> 172.21.15.22:0/1075406755 conn(0x7f16f00fd390 msgr2=0x7f16f00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 -- 172.21.15.22:0/1075406755 shutdown_connections 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.152+0000 7f16f687f640 1 -- 172.21.15.22:0/1075406755 wait complete. 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 Processor -- start 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 -- start start 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0101c00 0x7f16f0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0102e00 0x7f16f0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010d9b0 con 0x7f16f01037c0 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010d830 con 0x7f16f0101c00 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f687f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010db30 con 0x7f16f0102e00 2024-09-11T22:28:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f4e1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f4e1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48450/0 (socket says 172.21.15.22:48450) 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.153+0000 7f16f4e1c640 1 -- 172.21.15.22:0/147871925 learned_addr learned my addr 172.21.15.22:0/147871925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16effff640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0101c00 0x7f16f0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16ef7fe640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0102e00 0x7f16f0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 -- 172.21.15.22:0/147871925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0102e00 msgr2=0x7f16f0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0102e00 0x7f16f0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 -- 172.21.15.22:0/147871925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0101c00 msgr2=0x7f16f0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0101c00 0x7f16f0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 -- 172.21.15.22:0/147871925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f019faf0 con 0x7f16f01037c0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f4e1c640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16e8031a40 tx=0x7f16e8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e802fbe0 con 0x7f16f01037c0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f019fd80 con 0x7f16f01037c0 2024-09-11T22:28:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16e802fd80 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8046980 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.154+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01a0240 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.155+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f0108ed0 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.156+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f16e8030ce0 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.157+0000 7f16ed7fa640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 0x7f16d80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.157+0000 7f16effff640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 0x7f16d80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.157+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f16e80f0660 con 0x7f16f01037c0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.158+0000 7f16effff640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 0x7f16d80a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16f0102c60 tx=0x7f16e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.161+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16e80bd630 con 0x7f16f01037c0 2024-09-11T22:28:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.343+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f16f0062630 con 0x7f16d80a2c40 2024-09-11T22:28:44.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.344+0000 7f16ed7fa640 1 -- 172.21.15.22:0/147871925 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f16f0062630 con 0x7f16d80a2c40 2024-09-11T22:28:44.346 INFO:teuthology.orchestra.run.smithi022.stdout:HOST ADDR LABELS STATUS 2024-09-11T22:28:44.346 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 172.21.15.22 2024-09-11T22:28:44.346 INFO:teuthology.orchestra.run.smithi022.stdout:smithi045 172.21.15.45 2024-09-11T22:28:44.346 INFO:teuthology.orchestra.run.smithi022.stdout:smithi169 172.21.15.169 2024-09-11T22:28:44.347 INFO:teuthology.orchestra.run.smithi022.stdout:3 hosts in cluster 2024-09-11T22:28:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.346+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 msgr2=0x7f16d80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.346+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 0x7f16d80a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16f0102c60 tx=0x7f16e0005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.346+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 msgr2=0x7f16f019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.346+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16e8031a40 tx=0x7f16e8031ee0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 shutdown_connections 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f01037c0 0x7f16f019f480 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f16d80a2c40 0x7f16d80a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f16f0102e00 0x7f16f0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 --2- 172.21.15.22:0/147871925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f0101c00 0x7f16f0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 >> 172.21.15.22:0/147871925 conn(0x7f16f00fd390 msgr2=0x7f16f01060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 shutdown_connections 2024-09-11T22:28:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:44.347+0000 7f16f687f640 1 -- 172.21.15.22:0/147871925 wait complete. 2024-09-11T22:28:44.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:44 smithi169 ceph-mon[35628]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:44.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:44 smithi169 ceph-mon[35628]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:44 smithi045 ceph-mon[35556]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-11T22:28:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:44 smithi045 ceph-mon[35556]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:45.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:45 smithi022 ceph-mon[30966]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:45.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T22:28:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:45.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:45 smithi169 ceph-mon[35628]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:45.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:45 smithi045 ceph-mon[35556]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:45.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 -- 172.21.15.22:0/3915516229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 msgr2=0x7fe18c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 --2- 172.21.15.22:0/3915516229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c1073c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe180009900 tx=0x7fe18002a410 comp rx=0 tx=0).stop 2024-09-11T22:28:45.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 -- 172.21.15.22:0/3915516229 shutdown_connections 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 --2- 172.21.15.22:0/3915516229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c107900 0x7fe18c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 --2- 172.21.15.22:0/3915516229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c1073c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 --2- 172.21.15.22:0/3915516229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c1026a0 0x7fe18c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 -- 172.21.15.22:0/3915516229 >> 172.21.15.22:0/3915516229 conn(0x7fe18c0fc2a0 msgr2=0x7fe18c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 -- 172.21.15.22:0/3915516229 shutdown_connections 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.810+0000 7fe192591640 1 -- 172.21.15.22:0/3915516229 wait complete. 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 Processor -- start 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 -- start start 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c1026a0 0x7fe18c102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c107900 0x7fe18c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10d9d0 con 0x7fe18c104fd0 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10d850 con 0x7fe18c1026a0 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.811+0000 7fe192591640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10db50 con 0x7fe18c107900 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48460/0 (socket says 172.21.15.22:48460) 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 -- 172.21.15.22:0/2653807893 learned_addr learned my addr 172.21.15.22:0/2653807893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18bfff640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c1026a0 0x7fe18c102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe190b2e640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c107900 0x7fe18c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 -- 172.21.15.22:0/2653807893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c107900 msgr2=0x7fe18c100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c107900 0x7fe18c100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 -- 172.21.15.22:0/2653807893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c1026a0 msgr2=0x7fe18c102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c1026a0 0x7fe18c102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 -- 172.21.15.22:0/2653807893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c101450 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe18b7fe640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe180005ab0 tx=0x7fe1800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18003f030 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c1a2100 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe180003d00 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180035070 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.812+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c1a2600 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.813+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c0fdd90 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.815+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe180042030 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.815+0000 7fe1897fa640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 0x7fe1740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.815+0000 7fe18bfff640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 0x7fe1740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.816+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe1800ef9e0 con 0x7fe18c104fd0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.816+0000 7fe18bfff640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 0x7fe1740a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005fd0 tx=0x7fe17c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:45.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:45.819+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1800bc810 con 0x7fe18c104fd0 2024-09-11T22:28:46.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.000+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 --> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fe18c062630 con 0x7fe1740a2c10 2024-09-11T22:28:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.002+0000 7fe1897fa640 1 -- 172.21.15.22:0/2653807893 <== mgr.14150 v2:172.21.15.22:6800/3117763107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fe18c062630 con 0x7fe1740a2c10 2024-09-11T22:28:46.003 INFO:teuthology.orchestra.run.smithi022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T22:28:46.003 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-11T22:28:46.003 INFO:teuthology.orchestra.run.smithi022.stdout:smithi045 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120098480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-11T22:28:46.004 INFO:teuthology.orchestra.run.smithi022.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T22:28:46.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 msgr2=0x7fe1740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 0x7fe1740a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe17c005fd0 tx=0x7fe17c00b390 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 msgr2=0x7fe18c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe180005ab0 tx=0x7fe1800042f0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 shutdown_connections 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fe1740a2c10 0x7fe1740a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe18c107900 0x7fe18c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe18c104fd0 0x7fe18c100650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 --2- 172.21.15.22:0/2653807893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe18c1026a0 0x7fe18c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 >> 172.21.15.22:0/2653807893 conn(0x7fe18c0fc2a0 msgr2=0x7fe18c102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 shutdown_connections 2024-09-11T22:28:46.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:46.004+0000 7fe192591640 1 -- 172.21.15.22:0/2653807893 wait complete. 2024-09-11T22:28:46.326 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:46 smithi045 ceph-mon[35556]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:46.373 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:46 smithi022 ceph-mon[30966]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:46.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:46 smithi169 ceph-mon[35628]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:46.685 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:28:46.694 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:28:46.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T22:28:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:47.393 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:47 smithi022 ceph-mon[30966]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:47.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- 172.21.15.22:0/1777958082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288102720 msgr2=0x7f3288104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- 172.21.15.22:0/1777958082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288102720 0x7f3288104b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3278009900 tx=0x7f327802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:47.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- 172.21.15.22:0/1777958082 shutdown_connections 2024-09-11T22:28:47.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- 172.21.15.22:0/1777958082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f3288109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- 172.21.15.22:0/1777958082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288105050 0x7f3288107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- 172.21.15.22:0/1777958082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288102720 0x7f3288104b10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- 172.21.15.22:0/1777958082 >> 172.21.15.22:0/1777958082 conn(0x7f32880fc280 msgr2=0x7f32880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- 172.21.15.22:0/1777958082 shutdown_connections 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- 172.21.15.22:0/1777958082 wait complete. 2024-09-11T22:28:47.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 Processor -- start 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 -- start start 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.400+0000 7f328f17f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288105050 0x7f3288198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328f17f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f328819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328f17f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f328810da20 con 0x7f3288105050 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328f17f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f328810d8a0 con 0x7f3288102720 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328f17f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f328810dba0 con 0x7f3288107980 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:42956/0 (socket says 172.21.15.22:42956) 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f3287fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288105050 0x7f3288198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 -- 172.21.15.22:0/283590987 learned_addr learned my addr 172.21.15.22:0/283590987 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328d71c640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f328819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 -- 172.21.15.22:0/283590987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 msgr2=0x7f328819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f328819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 -- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288105050 msgr2=0x7f3288198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288105050 0x7f3288198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 -- 172.21.15.22:0/283590987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328819fc30 con 0x7f3288102720 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328d71c640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f328819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328cf1b640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3278009a20 tx=0x7f3278004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327803f030 con 0x7f3288102720 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3278003d00 con 0x7f3288102720 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328819fec0 con 0x7f3288102720 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.401+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278035070 con 0x7f3288102720 2024-09-11T22:28:47.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.402+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32881a0340 con 0x7f3288102720 2024-09-11T22:28:47.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.403+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32880fdd70 con 0x7f3288102720 2024-09-11T22:28:47.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:47 smithi169 ceph-mon[35628]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.404+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3278042030 con 0x7f3288102720 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.404+0000 7f3285ffb640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 0x7f32740a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.405+0000 7f3287fff640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 0x7f32740a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.405+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f32780ef990 con 0x7f3288102720 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.405+0000 7f3287fff640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 0x7f32740a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3288199520 tx=0x7f3270009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.408+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32780bc760 con 0x7f3288102720 2024-09-11T22:28:47.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:47 smithi045 ceph-mon[35556]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:28:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.620+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f328802d7c0 con 0x7f3288102720 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.621+0000 7f3285ffb640 1 -- 172.21.15.22:0/283590987 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3038 (secure 0 0 0) 0x7f32780bc060 con 0x7f3288102720 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stdout:e20 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stdout:btime 2024-09-11T22:27:34:215280+0000 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:28:47.623 INFO:teuthology.orchestra.run.smithi022.stdout:legacy client fscid: 1 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem 'cephfs' (1) 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:fs_name cephfs 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 20 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-11T22:27:24.459196+0000 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-11T22:27:33.502987+0000 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:tableserver 0 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:root 0 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:session_timeout 300 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:session_autoclose 300 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:max_file_size 1099511627776 2024-09-11T22:28:47.624 INFO:teuthology.orchestra.run.smithi022.stdout:max_xattr_size 65536 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:required_client_features {} 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure 0 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure_osd_epoch 0 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:max_mds 1 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:in 0 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:up {0=24497} 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:failed 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:damaged 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:stopped 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:data_pools [3] 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:metadata_pool 2 2024-09-11T22:28:47.625 INFO:teuthology.orchestra.run.smithi022.stdout:inline_data disabled 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:balancer 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:bal_rank_mask -1 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:standby_count_wanted 0 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:qdb_cluster leader: 24497 members: 24497 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.h{0:24467} state up:standby-replay seq 1 addr [v2:172.21.15.45:6836/1224562712,v1:172.21.15.45:6837/1224562712] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:Standby daemons: 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.22:6834/3220963127,v1:172.21.15.22:6835/3220963127] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.22:6836/3026054305,v1:172.21.15.22:6837/3026054305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.626 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.g{-1:14586} state up:standby seq 1 addr [v2:172.21.15.22:6838/816349269,v1:172.21.15.22:6839/816349269] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a{-1:14598} state up:standby seq 1 addr [v2:172.21.15.22:6840/7353610,v1:172.21.15.22:6841/7353610] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.l{-1:24409} state up:standby seq 1 addr [v2:172.21.15.169:6832/1952933585,v1:172.21.15.169:6833/1952933585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.45:6832/2686078352,v1:172.21.15.45:6833/2686078352] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f{-1:24442} state up:standby seq 1 addr [v2:172.21.15.169:6834/1085000680,v1:172.21.15.169:6835/1085000680] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c{-1:24448} state up:standby seq 1 addr [v2:172.21.15.169:6836/857895339,v1:172.21.15.169:6837/857895339] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.627 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e{-1:24458} state up:standby seq 1 addr [v2:172.21.15.45:6834/3694766032,v1:172.21.15.45:6835/3694766032] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.628 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.i{-1:24466} state up:standby seq 1 addr [v2:172.21.15.169:6838/1397643648,v1:172.21.15.169:6839/1397643648] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.624+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 msgr2=0x7f32740a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.624+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 0x7f32740a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3288199520 tx=0x7f3270009500 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.624+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 msgr2=0x7f3288198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.624+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3278009a20 tx=0x7f3278004270 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 shutdown_connections 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f32740a2c40 0x7f32740a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3288107980 0x7f328819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3288105050 0x7f3288198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 --2- 172.21.15.22:0/283590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3288102720 0x7f3288198000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 >> 172.21.15.22:0/283590987 conn(0x7f32880fc280 msgr2=0x7f3288102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 shutdown_connections 2024-09-11T22:28:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:47.625+0000 7f328f17f640 1 -- 172.21.15.22:0/283590987 wait complete. 2024-09-11T22:28:48.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:48 smithi022 ceph-mon[30966]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:48.315 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:48 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/283590987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:28:48.352 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c727338c-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T22:28:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:48 smithi169 ceph-mon[35628]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:48 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/283590987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:28:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:48 smithi045 ceph-mon[35556]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:48 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/283590987' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:28:48.614 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 -- 172.21.15.22:0/1540170731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50101d10 msgr2=0x7faf50102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 --2- 172.21.15.22:0/1540170731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50101d10 0x7faf50102190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009900 tx=0x7faf3c02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 -- 172.21.15.22:0/1540170731 shutdown_connections 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 --2- 172.21.15.22:0/1540170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf501026d0 0x7faf50108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 --2- 172.21.15.22:0/1540170731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50101d10 0x7faf50102190 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 --2- 172.21.15.22:0/1540170731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf50100b10 0x7faf50100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 -- 172.21.15.22:0/1540170731 >> 172.21.15.22:0/1540170731 conn(0x7faf500fc2a0 msgr2=0x7faf500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 -- 172.21.15.22:0/1540170731 shutdown_connections 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.100+0000 7faf57120640 1 -- 172.21.15.22:0/1540170731 wait complete. 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 Processor -- start 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 -- start start 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 0x7faf501985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 0x7faf5019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf5010c930 con 0x7faf50100b10 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faf5010c7b0 con 0x7faf501026d0 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf57120640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf5010cab0 con 0x7faf50101d10 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48496/0 (socket says 172.21.15.22:48496) 2024-09-11T22:28:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 -- 172.21.15.22:0/2407235338 learned_addr learned my addr 172.21.15.22:0/2407235338 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf4ffff640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 0x7faf501985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf556bd640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 0x7faf5019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 -- 172.21.15.22:0/2407235338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 msgr2=0x7faf501985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 0x7faf501985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 -- 172.21.15.22:0/2407235338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 msgr2=0x7faf5019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 0x7faf5019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 -- 172.21.15.22:0/2407235338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5019fca0 con 0x7faf50100b10 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf4ffff640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 0x7faf501985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf556bd640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 0x7faf5019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.101+0000 7faf54ebc640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c970 tx=0x7faf4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.102+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44004220 con 0x7faf50100b10 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.102+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5019ff90 con 0x7faf50100b10 2024-09-11T22:28:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.102+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf440043c0 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.102+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4400f6b0 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.102+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf501a0470 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.103+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf501a0700 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.104+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faf440037a0 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.104+0000 7faf4dffb640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 0x7faf400a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.105+0000 7faf4ffff640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 0x7faf400a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.105+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7faf440cef70 con 0x7faf50100b10 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.105+0000 7faf4ffff640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 0x7faf400a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:49.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.109+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf44014030 con 0x7faf50100b10 2024-09-11T22:28:49.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.288+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7faf501a08d0 con 0x7faf50100b10 2024-09-11T22:28:49.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.290+0000 7faf4dffb640 1 -- 172.21.15.22:0/2407235338 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5246 (secure 0 0 0) 0x7faf44003e40 con 0x7faf50100b10 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 82 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:fsid c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-11T22:19:30.932173+0000 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-11T22:28:28.029994+0000 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 26 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-09-11T22:28:49.291 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client luminous 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6802/1086761455,v1:172.21.15.22:6803/1086761455] [v2:172.21.15.22:6804/1086761455,v1:172.21.15.22:6805/1086761455] exists,up 8ce2c7a9-daf0-4fe8-b457-6fd038545b3d 2024-09-11T22:28:49.292 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6800/1690638458,v1:172.21.15.45:6801/1690638458] [v2:172.21.15.45:6802/1690638458,v1:172.21.15.45:6803/1690638458] exists,up 068e27f1-5aa0-45db-b7b3-510f8a0ad96a 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/711069925,v1:172.21.15.169:6801/711069925] [v2:172.21.15.169:6802/711069925,v1:172.21.15.169:6803/711069925] exists,up ba0cdee8-b78e-4cff-8899-6108f3a3f633 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6810/3656884990,v1:172.21.15.22:6811/3656884990] [v2:172.21.15.22:6812/3656884990,v1:172.21.15.22:6813/3656884990] exists,up 22b6ed2c-e6fe-4acc-86b8-802ab9dc3732 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6808/2265581210,v1:172.21.15.45:6809/2265581210] [v2:172.21.15.45:6810/2265581210,v1:172.21.15.45:6811/2265581210] exists,up d411e693-5da4-47da-b529-f9d158ac5586 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/3288251566,v1:172.21.15.169:6809/3288251566] [v2:172.21.15.169:6810/3288251566,v1:172.21.15.169:6811/3288251566] exists,up 19566e6c-1e79-48d6-ba3b-2e61d38e21fc 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6818/3560259389,v1:172.21.15.22:6819/3560259389] [v2:172.21.15.22:6820/3560259389,v1:172.21.15.22:6821/3560259389] exists,up 231d0816-5eb1-4a2c-aced-20a92e18523b 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 48 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6816/1044507788,v1:172.21.15.45:6817/1044507788] [v2:172.21.15.45:6818/1044507788,v1:172.21.15.45:6819/1044507788] exists,up 65301ecd-9ff7-4221-bfb2-fffea68443e2 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 56 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/3945465196,v1:172.21.15.169:6817/3945465196] [v2:172.21.15.169:6818/3945465196,v1:172.21.15.169:6819/3945465196] exists,up 59a824e3-0c3e-4315-86e2-e3a1684c94b3 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 63 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6826/3132615329,v1:172.21.15.22:6827/3132615329] [v2:172.21.15.22:6828/3132615329,v1:172.21.15.22:6829/3132615329] exists,up ba20c169-e5d6-418a-82b3-ee96748875d4 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6824/963190759,v1:172.21.15.45:6825/963190759] [v2:172.21.15.45:6826/963190759,v1:172.21.15.45:6827/963190759] exists,up ed65f590-5c01-40d7-83dc-681d043f5203 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/1239026325,v1:172.21.15.169:6825/1239026325] [v2:172.21.15.169:6826/1239026325,v1:172.21.15.169:6827/1239026325] exists,up eb6aa919-e469-40a8-a10a-533d098108e8 2024-09-11T22:28:49.293 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.8 [2,11] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1b [2,4] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1c [8,11] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1f [8,1] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.3 [4,9] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.13 [4,9] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.33 [5,9] 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/4254056361 expires 2024-09-12T22:20:26.526826+0000 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/3544100501 expires 2024-09-12T22:20:26.526826+0000 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/3544100501 expires 2024-09-12T22:20:26.526826+0000 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1255471242 expires 2024-09-12T22:20:26.526826+0000 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/692024919 expires 2024-09-12T22:20:26.526826+0000 2024-09-11T22:28:49.294 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/3167992537 expires 2024-09-12T22:20:02.899009+0000 2024-09-11T22:28:49.295 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3254833025 expires 2024-09-12T22:20:02.899009+0000 2024-09-11T22:28:49.295 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1955487578 expires 2024-09-12T22:20:02.899009+0000 2024-09-11T22:28:49.295 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/3167992537 expires 2024-09-12T22:20:02.899009+0000 2024-09-11T22:28:49.295 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/751358539 expires 2024-09-12T22:20:02.899009+0000 2024-09-11T22:28:49.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 msgr2=0x7faf400a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 0x7faf400a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c031640 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 msgr2=0x7faf50198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c970 tx=0x7faf4400ce30 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 shutdown_connections 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf501026d0 0x7faf5019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7faf400a2c40 0x7faf400a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf50101d10 0x7faf501985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 --2- 172.21.15.22:0/2407235338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf50100b10 0x7faf50198070 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 >> 172.21.15.22:0/2407235338 conn(0x7faf500fc2a0 msgr2=0x7faf500fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 shutdown_connections 2024-09-11T22:28:49.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:49.293+0000 7faf57120640 1 -- 172.21.15.22:0/2407235338 wait complete. 2024-09-11T22:28:49.971 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T22:28:49.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:50.247 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:50.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:50 smithi022 ceph-mon[30966]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:50.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:50 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2407235338' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:28:50.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:50 smithi169 ceph-mon[35628]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:50.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:50 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2407235338' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:28:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:50 smithi045 ceph-mon[35556]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:50 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2407235338' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:28:50.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.723+0000 7f3b7b886640 1 -- 172.21.15.22:0/2991567396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 msgr2=0x7f3b74101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:50.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.723+0000 7f3b7b886640 1 --2- 172.21.15.22:0/2991567396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b74101200 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009900 tx=0x7f3b7002a480 comp rx=0 tx=0).stop 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 -- 172.21.15.22:0/2991567396 shutdown_connections 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 --2- 172.21.15.22:0/2991567396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 0x7f3b7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 --2- 172.21.15.22:0/2991567396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 0x7f3b741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 --2- 172.21.15.22:0/2991567396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b74101200 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 -- 172.21.15.22:0/2991567396 >> 172.21.15.22:0/2991567396 conn(0x7f3b740fc7d0 msgr2=0x7f3b740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 -- 172.21.15.22:0/2991567396 shutdown_connections 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 -- 172.21.15.22:0/2991567396 wait complete. 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 Processor -- start 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 -- start start 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.724+0000 7f3b7b886640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 0x7f3b741a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:50.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 0x7f3b7419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b741110e0 con 0x7f3b74100e20 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74110f60 con 0x7f3b74102570 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74111260 con 0x7f3b74102ef0 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48504/0 (socket says 172.21.15.22:48504) 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 -- 172.21.15.22:0/1313241896 learned_addr learned my addr 172.21.15.22:0/1313241896 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b78e21640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 0x7f3b741a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79e23640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 0x7f3b7419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 -- 172.21.15.22:0/1313241896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 msgr2=0x7f3b7419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 0x7f3b7419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 -- 172.21.15.22:0/1313241896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 msgr2=0x7f3b741a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 0x7f3b741a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 -- 172.21.15.22:0/1313241896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7419ad20 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b79622640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006010 tx=0x7f3b70004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003f030 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7419afb0 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b70005500 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70035070 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.725+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b741a7300 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.726+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b74101200 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.728+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3b70042030 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.728+0000 7f3b6a7fc640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 0x7f3b600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.728+0000 7f3b78e21640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 0x7f3b600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.728+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f3b700efe80 con 0x7f3b74100e20 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.729+0000 7f3b78e21640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 0x7f3b600a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b7410ddf0 tx=0x7f3b6400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:50.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.732+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b700bccb0 con 0x7f3b74100e20 2024-09-11T22:28:50.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.947+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b7419bb20 con 0x7f3b74100e20 2024-09-11T22:28:50.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.948+0000 7f3b6a7fc640 1 -- 172.21.15.22:0/1313241896 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f3b7419bb20 con 0x7f3b74100e20 2024-09-11T22:28:50.949 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:50.949 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:28:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 msgr2=0x7f3b600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 0x7f3b600a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3b7410ddf0 tx=0x7f3b6400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 msgr2=0x7f3b741a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b70006010 tx=0x7f3b70004c00 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 shutdown_connections 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f3b600a2c10 0x7f3b600a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b74102ef0 0x7f3b7419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b74102570 0x7f3b741a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 --2- 172.21.15.22:0/1313241896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b74100e20 0x7f3b741a0430 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 >> 172.21.15.22:0/1313241896 conn(0x7f3b740fc7d0 msgr2=0x7f3b7406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 shutdown_connections 2024-09-11T22:28:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:50.950+0000 7f3b7b886640 1 -- 172.21.15.22:0/1313241896 wait complete. 2024-09-11T22:28:51.305 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:51 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1313241896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:51.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:51 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1313241896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:51.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:51 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1313241896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:51.664 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:51.929 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:52.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:52 smithi022 ceph-mon[30966]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:52.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:52 smithi169 ceph-mon[35628]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:52 smithi045 ceph-mon[35556]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 -- 172.21.15.22:0/1373284894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c1082a0 msgr2=0x7f1c6c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/1373284894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c10ec40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009930 tx=0x7f1c6402a420 comp rx=0 tx=0).stop 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 -- 172.21.15.22:0/1373284894 shutdown_connections 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/1373284894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c10ec40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/1373284894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1036e0 0x7f1c6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/1373284894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c102d30 0x7f1c6c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 -- 172.21.15.22:0/1373284894 >> 172.21.15.22:0/1373284894 conn(0x7f1c6c0fc7d0 msgr2=0x7f1c6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 -- 172.21.15.22:0/1373284894 shutdown_connections 2024-09-11T22:28:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.402+0000 7f1c72d8a640 1 -- 172.21.15.22:0/1373284894 wait complete. 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 Processor -- start 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 -- start start 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c1036e0 0x7f1c6c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c1121c0 con 0x7f1c6c102d30 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c112040 con 0x7f1c6c1036e0 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c72d8a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c112340 con 0x7f1c6c1082a0 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c70b26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c70b26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48520/0 (socket says 172.21.15.22:48520) 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c70b26640 1 -- 172.21.15.22:0/3345654829 learned_addr learned my addr 172.21.15.22:0/3345654829 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.403+0000 7f1c71327640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:52.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c6bfff640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c1036e0 0x7f1c6c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 -- 172.21.15.22:0/3345654829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 msgr2=0x7f1c6c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 -- 172.21.15.22:0/3345654829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c1036e0 msgr2=0x7f1c6c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c1036e0 0x7f1c6c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 -- 172.21.15.22:0/3345654829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c1a6b00 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c71327640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c70b26640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e9f0 tx=0x7f1c5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400cd80 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c1a6df0 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c54010930 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54018b00 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.404+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c1a72a0 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.405+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c103110 con 0x7f1c6c102d30 2024-09-11T22:28:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.407+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1c54018ca0 con 0x7f1c6c102d30 2024-09-11T22:28:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.407+0000 7f1c69ffb640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 0x7f1c580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.408+0000 7f1c6bfff640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 0x7f1c580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.408+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1c540cf9b0 con 0x7f1c6c102d30 2024-09-11T22:28:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.408+0000 7f1c6bfff640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 0x7f1c580a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c102420 tx=0x7f1c5c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.415+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c5409c7e0 con 0x7f1c6c102d30 2024-09-11T22:28:52.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.630+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c6c10a2b0 con 0x7f1c6c102d30 2024-09-11T22:28:52.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.631+0000 7f1c69ffb640 1 -- 172.21.15.22:0/3345654829 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f1c5409c0e0 con 0x7f1c6c102d30 2024-09-11T22:28:52.632 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:52.632 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:28:52.632 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 msgr2=0x7f1c580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 0x7f1c580a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c102420 tx=0x7f1c5c009500 comp rx=0 tx=0).stop 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 msgr2=0x7f1c6c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e9f0 tx=0x7f1c5400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 shutdown_connections 2024-09-11T22:28:52.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f1c580a2c10 0x7f1c580a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c6c1082a0 0x7f1c6c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c6c1036e0 0x7f1c6c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 --2- 172.21.15.22:0/3345654829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c6c102d30 0x7f1c6c100990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 >> 172.21.15.22:0/3345654829 conn(0x7f1c6c0fc7d0 msgr2=0x7f1c6c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 shutdown_connections 2024-09-11T22:28:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:52.633+0000 7f1c72d8a640 1 -- 172.21.15.22:0/3345654829 wait complete. 2024-09-11T22:28:53.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:53 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3345654829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:53.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:28:53.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:53 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3345654829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:53.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:53 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3345654829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:53.567 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:54.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 -- 172.21.15.22:0/266772204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664102de0 msgr2=0x7f26641031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 --2- 172.21.15.22:0/266772204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664102de0 0x7f26641031c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2654009900 tx=0x7f265402a480 comp rx=0 tx=0).stop 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 -- 172.21.15.22:0/266772204 shutdown_connections 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 --2- 172.21.15.22:0/266772204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f266410c180 0x7f266410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 --2- 172.21.15.22:0/266772204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2664103700 0x7f266410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 --2- 172.21.15.22:0/266772204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664102de0 0x7f26641031c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 -- 172.21.15.22:0/266772204 >> 172.21.15.22:0/266772204 conn(0x7f26640fc7a0 msgr2=0x7f26640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 -- 172.21.15.22:0/266772204 shutdown_connections 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.049+0000 7f2669c05640 1 -- 172.21.15.22:0/266772204 wait complete. 2024-09-11T22:28:54.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.050+0000 7f2669c05640 1 Processor -- start 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.050+0000 7f2669c05640 1 -- start start 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.050+0000 7f2669c05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2664102de0 0x7f2664198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f266410c180 0x7f266419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2664112090 con 0x7f2664103700 2024-09-11T22:28:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2664111f10 con 0x7f2664102de0 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2664112210 con 0x7f266410c180 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48526/0 (socket says 172.21.15.22:48526) 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 -- 172.21.15.22:0/1240439431 learned_addr learned my addr 172.21.15.22:0/1240439431 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f26637fe640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2664102de0 0x7f2664198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2663fff640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f266410c180 0x7f266419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 -- 172.21.15.22:0/1240439431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f266410c180 msgr2=0x7f266419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f266410c180 0x7f266419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 -- 172.21.15.22:0/1240439431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2664102de0 msgr2=0x7f2664198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2664102de0 0x7f2664198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 -- 172.21.15.22:0/1240439431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266419d500 con 0x7f2664103700 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2662ffd640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f265800d770 tx=0x7f265800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2658005520 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266419d7f0 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.051+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658010460 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.052+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26641a50d0 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.053+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26641031c0 con 0x7f2664103700 2024-09-11T22:28:54.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.054+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2658004ea0 con 0x7f2664103700 2024-09-11T22:28:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.055+0000 7f2660ff9640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 0x7f264c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.055+0000 7f26637fe640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 0x7f264c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.055+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f26580cefc0 con 0x7f2664103700 2024-09-11T22:28:54.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.056+0000 7f26637fe640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 0x7f264c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2654009230 tx=0x7f26540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.059+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f265809b7c0 con 0x7f2664103700 2024-09-11T22:28:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.235+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f266402d7c0 con 0x7f2664103700 2024-09-11T22:28:54.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:54 smithi022 ceph-mon[30966]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:54.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.238+0000 7f2660ff9640 1 -- 172.21.15.22:0/1240439431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22642 (secure 0 0 0) 0x7f265809fac0 con 0x7f2664103700 2024-09-11T22:28:54.241 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:28:54.241 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":82,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:28:28.029994+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 msgr2=0x7f264c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 0x7f264c0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2654009230 tx=0x7f26540058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 msgr2=0x7f2664198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f265800d770 tx=0x7f265800dc30 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 shutdown_connections 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f264c0a2c90 0x7f264c0a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f266410c180 0x7f266419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2664103700 0x7f2664198a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 --2- 172.21.15.22:0/1240439431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2664102de0 0x7f2664198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 >> 172.21.15.22:0/1240439431 conn(0x7f26640fc7a0 msgr2=0x7f26640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 shutdown_connections 2024-09-11T22:28:54.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:54.240+0000 7f2669c05640 1 -- 172.21.15.22:0/1240439431 wait complete. 2024-09-11T22:28:54.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:54 smithi169 ceph-mon[35628]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:54.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:54 smithi045 ceph-mon[35556]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:28:54.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:27:24.459196+0000', 'modified': '2024-09-11T22:27:33.502987+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/1224562712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 1224562712}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 1224562712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6839/2293732037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 2293732037}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 2293732037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-11T22:28:54.895 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:28:54.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:28:55.158 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:55.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:55 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1240439431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:55.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:55 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1240439431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:55.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:55 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1240439431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:55.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- 172.21.15.22:0/156154573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 msgr2=0x7f07c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 --2- 172.21.15.22:0/156154573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c410ea90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009900 tx=0x7f07bc02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- 172.21.15.22:0/156154573 shutdown_connections 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 --2- 172.21.15.22:0/156154573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c410ea90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 --2- 172.21.15.22:0/156154573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4102790 0x7f07c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 --2- 172.21.15.22:0/156154573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4101de0 0x7f07c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- 172.21.15.22:0/156154573 >> 172.21.15.22:0/156154573 conn(0x7f07c40fd8c0 msgr2=0x7f07c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- 172.21.15.22:0/156154573 shutdown_connections 2024-09-11T22:28:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- 172.21.15.22:0/156154573 wait complete. 2024-09-11T22:28:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 Processor -- start 2024-09-11T22:28:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.657+0000 7f07ca243640 1 -- start start 2024-09-11T22:28:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4101de0 0x7f07c4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4102790 0x7f07c4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41120d0 con 0x7f07c4106f10 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4111f50 con 0x7f07c4102790 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07ca243640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4112250 con 0x7f07c4101de0 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51084/0 (socket says 172.21.15.22:51084) 2024-09-11T22:28:55.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 -- 172.21.15.22:0/4152631377 learned_addr learned my addr 172.21.15.22:0/4152631377 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4102790 0x7f07c4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c37fe640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4101de0 0x7f07c4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 -- 172.21.15.22:0/4152631377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4101de0 msgr2=0x7f07c4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4101de0 0x7f07c4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 -- 172.21.15.22:0/4152631377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4102790 msgr2=0x7f07c4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4102790 0x7f07c4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 -- 172.21.15.22:0/4152631377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c419d4b0 con 0x7f07c4106f10 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.658+0000 7f07c3fff640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07bc005ab0 tx=0x7f07bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.659+0000 7f07c0ff9640 1 -- 172.21.15.22:0/4152631377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc03f030 con 0x7f07c4106f10 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.659+0000 7f07c0ff9640 1 -- 172.21.15.22:0/4152631377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07bc003d00 con 0x7f07c4106f10 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.659+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c419d740 con 0x7f07c4106f10 2024-09-11T22:28:55.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.659+0000 7f07c0ff9640 1 -- 172.21.15.22:0/4152631377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc035070 con 0x7f07c4106f10 2024-09-11T22:28:55.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.659+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41a5080 con 0x7f07c4106f10 2024-09-11T22:28:55.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07c0ff9640 1 -- 172.21.15.22:0/4152631377 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f07bc042030 con 0x7f07c4106f10 2024-09-11T22:28:55.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 Processor -- start 2024-09-11T22:28:55.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 -- start start 2024-09-11T22:28:55.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b56ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b578670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b4d4090 con 0x55ee5b578bb0 2024-09-11T22:28:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.661+0000 7f07cc61c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b47ba70 con 0x55ee5b56e2f0 2024-09-11T22:28:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07cc61c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b4d0050 con 0x55ee5b56d9d0 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c0ff9640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 0x7f07ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51090/0 (socket says 172.21.15.22:51090) 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b578670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c2ffd640 1 -- 172.21.15.22:0/1872997358 learned_addr learned my addr 172.21.15.22:0/1872997358 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c3fff640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 0x7f07ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b56ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c0ff9640 1 -- 172.21.15.22:0/4152631377 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f07bc0ef9e0 con 0x7f07c4106f10 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 -- 172.21.15.22:0/1872997358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 msgr2=0x55ee5b56ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b56ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 -- 172.21.15.22:0/1872997358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 msgr2=0x55ee5b57afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 -- 172.21.15.22:0/1872997358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5b488130 con 0x55ee5b56e2f0 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c37fe640 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b578670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ec0 tx=0x7f07b4010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba19285e2af0d2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07c3fff640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 0x7f07ac0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0bc0a0 tx=0x7f07bc086ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.662+0000 7f07a9ffb640 1 -- 172.21.15.22:0/1872997358 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4016070 con 0x55ee5b56e2f0 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07a9ffb640 1 -- 172.21.15.22:0/1872997358 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07b401bb60 con 0x55ee5b56e2f0 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07a9ffb640 1 -- 172.21.15.22:0/1872997358 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4012dc0 con 0x55ee5b56e2f0 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 -- 172.21.15.22:0/1872997358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 msgr2=0x55ee5b578670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b578670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009ec0 tx=0x7f07b4010740 comp rx=0 tx=0).stop 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 -- 172.21.15.22:0/1872997358 shutdown_connections 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b57afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b578670 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 --2- 172.21.15.22:0/1872997358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b56ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 -- 172.21.15.22:0/1872997358 >> 172.21.15.22:0/1872997358 conn(0x55ee5b569f60 msgr2=0x55ee5b56a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 -- 172.21.15.22:0/1872997358 shutdown_connections 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.663+0000 7f07cc61c740 1 -- 172.21.15.22:0/1872997358 wait complete. 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 -- start start 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 Processor -- start 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b575780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b578bb0 0x55ee5b575cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b57b780 con 0x55ee5b56d9d0 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b48ef20 con 0x55ee5b56e2f0 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b57b900 con 0x55ee5b578bb0 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07cc61c740 10 client.0 _ll_register_callbacks cb 0x55ee5b458030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51098/0 (socket says 172.21.15.22:51098) 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07c2ffd640 1 -- 172.21.15.22:0/4021804684 learned_addr learned my addr 172.21.15.22:0/4021804684 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07c37fe640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b575780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.664+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b578bb0 0x55ee5b575cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 -- 172.21.15.22:0/4021804684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b578bb0 msgr2=0x55ee5b575cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b578bb0 0x55ee5b575cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 -- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 msgr2=0x55ee5b575780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b575780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 -- 172.21.15.22:0/4021804684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5b2452b0 con 0x55ee5b56d9d0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009990 tx=0x7f07b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f287ef66aad0720a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b801a0f0 con 0x55ee5b56d9d0 2024-09-11T22:28:55.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f07b8018450 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b401bb60 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f07b801a290 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07cc61c740 10 client.15030 fetch_fsmap learned FSMap version 20 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ee5b5870f0 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07b401bb60 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f07b80276c0 con 0x55ee5b56d9d0 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.665+0000 7f07cc61c740 10 client.15030 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07cc61c740 10 client.15030 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07cc61c740 20 client.15030 populate_metadata read hostname 'smithi022' 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b589700 0x55ee5b58ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07cc61c740 4 client.15030 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:28:55.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5b4e1600 con 0x55ee5b589700 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07c37fe640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b589700 0x55ee5b58ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07a2ffd640 10 client.15030 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.666+0000 7f07c37fe640 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b589700 0x55ee5b58ab70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3119e60bf2355922 server_cookie=a74430963e95861f in_seq=0 out_seq=0 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07a2ffd640 1 -- 172.21.15.22:0/4021804684 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee5b4e1600 con 0x55ee5b589700 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07a2ffd640 10 client.15030 handle_command_reply: tid=0 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 client.15030 shutdown 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 msgr2=0x55ee5b578430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009990 tx=0x7f07b80046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 shutdown_connections 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b589700 0x55ee5b58ab70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b578bb0 0x55ee5b575cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b575780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07a2ffd640 0 client.15030 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:55.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 --2- 172.21.15.22:0/4021804684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b56d9d0 0x55ee5b578430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 >> 172.21.15.22:0/4021804684 conn(0x55ee5b569f60 msgr2=0x55ee5b56fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 shutdown_connections 2024-09-11T22:28:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 1 -- 172.21.15.22:0/4021804684 wait complete. 2024-09-11T22:28:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.667+0000 7f07cc61c740 20 client.15030 trim_cache size 0 max 16384 2024-09-11T22:28:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 Processor -- start 2024-09-11T22:28:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 -- start start 2024-09-11T22:28:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b58ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b568ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b588eb0 con 0x55ee5b578bb0 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b589580 con 0x55ee5b56e2f0 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.686+0000 7f07cc61c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b589c50 con 0x55ee5b56d9d0 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51100/0 (socket says 172.21.15.22:51100) 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2967234876 learned_addr learned my addr 172.21.15.22:0/2967234876 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c37fe640 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b568ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b58ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2967234876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 msgr2=0x55ee5b58ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b58ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2967234876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 msgr2=0x55ee5b568ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b568ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2967234876 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5b56e120 con 0x55ee5b578bb0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f07b8015d10 tx=0x7f07b801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db7bda49d2aae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07a97fa640 1 -- 172.21.15.22:0/2967234876 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8036070 con 0x55ee5b578bb0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07a97fa640 1 -- 172.21.15.22:0/2967234876 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07b8020070 con 0x55ee5b578bb0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.687+0000 7f07a97fa640 1 -- 172.21.15.22:0/2967234876 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8017720 con 0x55ee5b578bb0 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- 172.21.15.22:0/2967234876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 msgr2=0x55ee5b5729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f07b8015d10 tx=0x7f07b801c040 comp rx=0 tx=0).stop 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- 172.21.15.22:0/2967234876 shutdown_connections 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b5729e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56e2f0 0x55ee5b568ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2967234876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56d9d0 0x55ee5b58ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- 172.21.15.22:0/2967234876 >> 172.21.15.22:0/2967234876 conn(0x55ee5b569f60 msgr2=0x55ee5b5687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- 172.21.15.22:0/2967234876 shutdown_connections 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- 172.21.15.22:0/2967234876 wait complete. 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.688+0000 7f07cc61c740 1 -- start start 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 Processor -- start 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56d9d0 0x55ee5b5934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56e2f0 0x55ee5b58e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b58a9f0 con 0x55ee5b578bb0 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b58a320 con 0x55ee5b56d9d0 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee5b58b0c0 con 0x55ee5b56e2f0 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07cc61c740 10 client.0 _ll_register_callbacks cb 0x7f07b801ac30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51112/0 (socket says 172.21.15.22:51112) 2024-09-11T22:28:55.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2666108472 learned_addr learned my addr 172.21.15.22:0/2666108472 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56d9d0 0x55ee5b5934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c37fe640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56e2f0 0x55ee5b58e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2666108472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56e2f0 msgr2=0x55ee5b58e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.689+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56e2f0 0x55ee5b58e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56d9d0 msgr2=0x55ee5b5934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56d9d0 0x55ee5b5934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07c2ffd640 1 -- 172.21.15.22:0/2666108472 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5b58f5a0 con 0x55ee5b578bb0 2024-09-11T22:28:55.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07c2ffd640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f07b8015da0 tx=0x7f07b8018a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffd2b112c3a8527 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:28:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8036040 con 0x55ee5b578bb0 2024-09-11T22:28:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b8020070 con 0x55ee5b578bb0 2024-09-11T22:28:55.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f07b8027870 con 0x55ee5b578bb0 2024-09-11T22:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f07b80174c0 con 0x55ee5b578bb0 2024-09-11T22:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07cc61c740 10 client.15036 fetch_fsmap learned FSMap version 20 2024-09-11T22:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ee5b5f3d50 con 0x55ee5b578bb0 2024-09-11T22:28:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07b8020070 con 0x55ee5b578bb0 2024-09-11T22:28:55.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.690+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f07b803c070 con 0x55ee5b578bb0 2024-09-11T22:28:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 10 client.15036 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:28:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 10 client.15036 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 20 client.15036 populate_metadata read hostname 'smithi022' 2024-09-11T22:28:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b5f86c0 0x55ee5b5f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 4 client.15036 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:28:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "status"}) -- 0x55ee5b4dbb10 con 0x55ee5b5f86c0 2024-09-11T22:28:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07c37fe640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b5f86c0 0x55ee5b5f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07a2ffd640 10 client.15036 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07c37fe640 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b5f86c0 0x55ee5b5f73d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=815171270e73fa77 server_cookie=15edd45a8a6a09ce in_seq=0 out_seq=0 2024-09-11T22:28:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07a2ffd640 1 -- 172.21.15.22:0/2666108472 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ee5b4dbb10 con 0x55ee5b5f86c0 2024-09-11T22:28:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07a2ffd640 10 client.15036 handle_command_reply: tid=0 2024-09-11T22:28:55.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.691+0000 7f07cc61c740 1 client.15036 shutdown 2024-09-11T22:28:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 msgr2=0x55ee5b58ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f07b8015da0 tx=0x7f07b8018a50 comp rx=0 tx=0).stop 2024-09-11T22:28:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 shutdown_connections 2024-09-11T22:28:55.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee5b5f86c0 0x55ee5b5f73d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07a2ffd640 0 client.15036 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:28:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee5b578bb0 0x55ee5b58ed70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee5b56e2f0 0x55ee5b58e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 --2- 172.21.15.22:0/2666108472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee5b56d9d0 0x55ee5b5934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 >> 172.21.15.22:0/2666108472 conn(0x55ee5b569f60 msgr2=0x55ee5b569000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 shutdown_connections 2024-09-11T22:28:55.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 1 -- 172.21.15.22:0/2666108472 wait complete. 2024-09-11T22:28:55.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07cc61c740 20 client.15036 trim_cache size 0 max 16384 2024-09-11T22:28:55.711 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:28:55.711 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:28:55.711 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-11T22:28:55.711 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24497, 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 90.887060309999995, 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 20, 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 82, 2024-09-11T22:28:55.712 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 80, 2024-09-11T22:28:55.713 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 101.619070028 2024-09-11T22:28:55.713 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:28:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 msgr2=0x7f07ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 0x7f07ac0a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0bc0a0 tx=0x7f07bc086ce0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 msgr2=0x7f07c419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.692+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07bc005ab0 tx=0x7f07bc0042f0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 shutdown_connections 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07c4106f10 0x7f07c419cdd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07c4102790 0x7f07c4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f07ac0a2c90 0x7f07ac0a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 --2- 172.21.15.22:0/4152631377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07c4101de0 0x7f07c4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 >> 172.21.15.22:0/4152631377 conn(0x7f07c40fd8c0 msgr2=0x7f07c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 shutdown_connections 2024-09-11T22:28:55.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:55.693+0000 7f07ca243640 1 -- 172.21.15.22:0/4152631377 wait complete. 2024-09-11T22:28:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:56 smithi022 ceph-mon[30966]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:56.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:56 smithi169 ceph-mon[35628]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:56 smithi045 ceph-mon[35556]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:28:56.466 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T22:28:56.476 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T22:28:56.476 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T22:28:56.476 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T22:28:56.477 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-11T22:28:56.477 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:28:56.477 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:28:56.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 -- 172.21.15.22:0/30940368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 msgr2=0x7fda1c110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 --2- 172.21.15.22:0/30940368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c110520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda14009ca0 tx=0x7fda1402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 -- 172.21.15.22:0/30940368 shutdown_connections 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 --2- 172.21.15.22:0/30940368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c110520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 --2- 172.21.15.22:0/30940368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c074c50 0x7fda1c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 --2- 172.21.15.22:0/30940368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda1c076230 0x7fda1c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.600+0000 7fda247cf640 1 -- 172.21.15.22:0/30940368 >> 172.21.15.22:0/30940368 conn(0x7fda1c0fd2c0 msgr2=0x7fda1c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.604+0000 7fda247cf640 1 -- 172.21.15.22:0/30940368 shutdown_connections 2024-09-11T22:28:56.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.605+0000 7fda247cf640 1 -- 172.21.15.22:0/30940368 wait complete. 2024-09-11T22:28:56.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.606+0000 7fda247cf640 1 Processor -- start 2024-09-11T22:28:56.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.607+0000 7fda247cf640 1 -- start start 2024-09-11T22:28:56.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c074c50 0x7fda1c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:56.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda1c076230 0x7fda1c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:56.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c113f90 con 0x7fda1c10e130 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c113e10 con 0x7fda1c074c50 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda247cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c114110 con 0x7fda1c076230 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda22d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda22d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51132/0 (socket says 172.21.15.22:51132) 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.608+0000 7fda22d6c640 1 -- 172.21.15.22:0/4098695257 learned_addr learned my addr 172.21.15.22:0/4098695257 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 -- 172.21.15.22:0/4098695257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda1c076230 msgr2=0x7fda1c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda1c076230 0x7fda1c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 -- 172.21.15.22:0/4098695257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c074c50 msgr2=0x7fda1c19e510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:56.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c074c50 0x7fda1c19e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:56.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 -- 172.21.15.22:0/4098695257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c06bd40 con 0x7fda1c10e130 2024-09-11T22:28:56.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.609+0000 7fda22d6c640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda14003ba0 tx=0x7fda14003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:56.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.612+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14031800 con 0x7fda1c10e130 2024-09-11T22:28:56.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.612+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda14004540 con 0x7fda1c10e130 2024-09-11T22:28:56.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.612+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14030d30 con 0x7fda1c10e130 2024-09-11T22:28:56.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.612+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c06bfd0 con 0x7fda1c10e130 2024-09-11T22:28:56.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.612+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c06c550 con 0x7fda1c10e130 2024-09-11T22:28:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.615+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda000052c0 con 0x7fda1c10e130 2024-09-11T22:28:56.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.618+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fda140046f0 con 0x7fda1c10e130 2024-09-11T22:28:56.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.619+0000 7fda137fe640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 0x7fda080a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:56.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.619+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fda140f0520 con 0x7fda1c10e130 2024-09-11T22:28:56.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.619+0000 7fda2256b640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 0x7fda080a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:56.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.621+0000 7fda2256b640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 0x7fda080a54c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009670 tx=0x7fda0c006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:56.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.626+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda140bd460 con 0x7fda1c10e130 2024-09-11T22:28:56.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:56.853+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fda00005880 con 0x7fda1c10e130 2024-09-11T22:28:57.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.109+0000 7fda137fe640 1 -- 172.21.15.22:0/4098695257 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7fda140bcd60 con 0x7fda1c10e130 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 msgr2=0x7fda080a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 0x7fda080a54c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009670 tx=0x7fda0c006bd0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 msgr2=0x7fda1c1a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda14003ba0 tx=0x7fda14003bd0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 shutdown_connections 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda1c10e130 0x7fda1c1a5ac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7fda080a3000 0x7fda080a54c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda1c076230 0x7fda1c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 --2- 172.21.15.22:0/4098695257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c074c50 0x7fda1c19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 >> 172.21.15.22:0/4098695257 conn(0x7fda1c0fd2c0 msgr2=0x7fda1c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 shutdown_connections 2024-09-11T22:28:57.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:57.112+0000 7fda247cf640 1 -- 172.21.15.22:0/4098695257 wait complete. 2024-09-11T22:28:57.130 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T22:28:57.157 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T22:28:57.158 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T22:28:57.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:57.158 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-11T22:28:57.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:57.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-11T22:28:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-09-11T22:28:57.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:28:57.250 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-11T22:28:57.250 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:28:57.250 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:28:57.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T22:28:57.326 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:28:57.326 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: ignoring --setuser ceph since I am not root 2024-09-11T22:28:57.326 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: ignoring --setgroup ceph since I am not root 2024-09-11T22:28:57.327 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-mgr[36959]: -- 172.21.15.45:0/2668445830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637d91d90e0 con 0x5637d91b7400 2024-09-11T22:28:57.327 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.266+0000 7f4fcdd74040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:28:57.327 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.325+0000 7f4fcdd74040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:28:57.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:28:57.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setuser ceph since I am not root 2024-09-11T22:28:57.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ignoring --setgroup ceph since I am not root 2024-09-11T22:28:57.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.267+0000 7f6a2342b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:28:57.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.327+0000 7f6a2342b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: ignoring --setuser ceph since I am not root 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: ignoring --setgroup ceph since I am not root 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-mgr[37372]: -- 172.21.15.169:0/3594086280 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dacdd150e0 con 0x55dacdcf3400 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.265+0000 7f374a0a2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:28:57.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.322+0000 7f374a0a2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:28:57.567 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:57.644 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.479+0000 7f4fcdd74040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:28:57.644 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.548+0000 7f4fcdd74040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:28:57.828 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.470+0000 7f374a0a2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:28:57.828 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.537+0000 7f374a0a2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:28:57.828 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.684+0000 7f374a0a2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:28:57.828 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:57.827+0000 7f374a0a2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:28:57.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.493+0000 7f6a2342b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:28:57.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.577+0000 7f6a2342b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:28:57.850 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.733+0000 7f6a2342b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:28:57.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.704+0000 7f4fcdd74040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:28:57.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:57.852+0000 7f4fcdd74040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:28:58.111 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:57.884+0000 7f6a2342b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 -- 172.21.15.22:0/2256330513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784102570 msgr2=0x7f27841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 --2- 172.21.15.22:0/2256330513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784102570 0x7f27841029b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2774009900 tx=0x7f277402a480 comp rx=0 tx=0).stop 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 -- 172.21.15.22:0/2256330513 shutdown_connections 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 --2- 172.21.15.22:0/2256330513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 --2- 172.21.15.22:0/2256330513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784102570 0x7f27841029b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 --2- 172.21.15.22:0/2256330513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784100e20 0x7f2784101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.073+0000 7f278b825640 1 -- 172.21.15.22:0/2256330513 >> 172.21.15.22:0/2256330513 conn(0x7f27840fc7d0 msgr2=0x7f27840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.074+0000 7f278b825640 1 -- 172.21.15.22:0/2256330513 shutdown_connections 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.074+0000 7f278b825640 1 -- 172.21.15.22:0/2256330513 wait complete. 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.074+0000 7f278b825640 1 Processor -- start 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.074+0000 7f278b825640 1 -- start start 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 0x7f2784197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27841110f0 con 0x7f2784100e20 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2784110f70 con 0x7f2784102570 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f278b825640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2784111270 con 0x7f2784102ef0 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:58.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51170/0 (socket says 172.21.15.22:51170) 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 -- 172.21.15.22:0/4267122254 learned_addr learned my addr 172.21.15.22:0/4267122254 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f2788dc0640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 0x7f2784197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f2789dc2640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 msgr2=0x7f278419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 msgr2=0x7f2784197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 0x7f2784197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 -- 172.21.15.22:0/4267122254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278419c480 con 0x7f2784100e20 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f2788dc0640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 0x7f2784197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f2789dc2640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.075+0000 7f27895c1640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2780009900 tx=0x7f2780009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.076+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278000d030 con 0x7f2784100e20 2024-09-11T22:28:58.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.076+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278419c770 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.076+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278000d1d0 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.076+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780005310 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.076+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2784069f70 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.077+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27841021b0 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.078+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137850+0+0 (secure 0 0 0) 0x7f27800054b0 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.079+0000 7f277a7fc640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 0x7f27700a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.079+0000 7f2788dc0640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 msgr2=0x7f27700a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.079+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f27800d0760 con 0x7f2784100e20 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.079+0000 7f2788dc0640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 0x7f27700a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:58.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.083+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f278009d0a0 con 0x7f2784100e20 2024-09-11T22:28:58.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.280+0000 7f2788dc0640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 msgr2=0x7f27700a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:28:58.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.280+0000 7f2788dc0640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 0x7f27700a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:28:58.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.298+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2784101200 con 0x7f2784100e20 2024-09-11T22:28:58.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.298+0000 7f277a7fc640 1 -- 172.21.15.22:0/4267122254 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f2784101200 con 0x7f2784100e20 2024-09-11T22:28:58.299 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T22:28:58.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 msgr2=0x7f27700a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:58.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 0x7f27700a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 msgr2=0x7f27841974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2780009900 tx=0x7f2780009dc0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 shutdown_connections 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f27700a2bd0 0x7f27700a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2784102ef0 0x7f278419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2784102570 0x7f2784197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 --2- 172.21.15.22:0/4267122254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2784100e20 0x7f27841974d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.300+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 >> 172.21.15.22:0/4267122254 conn(0x7f27840fc7d0 msgr2=0x7f2784106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.301+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 shutdown_connections 2024-09-11T22:28:58.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:58.301+0000 7f278b825640 1 -- 172.21.15.22:0/4267122254 wait complete. 2024-09-11T22:28:58.386 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:58 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:28:58.387 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:58 smithi169 ceph-mon[35628]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:28:58.387 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:58.140+0000 7f374a0a2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:28:58.387 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:58.201+0000 7f374a0a2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:28:58.387 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:58.385+0000 7f374a0a2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:28:58.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:58.222+0000 7f6a2342b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:28:58.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:58.286+0000 7f6a2342b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:28:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:28:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:58 smithi022 ceph-mon[30966]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:28:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:58 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4098695257' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T22:28:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:58 smithi045 ceph-mon[35556]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T22:28:58.412 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:58.181+0000 7f4fcdd74040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:28:58.412 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:58.244+0000 7f4fcdd74040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:28:58.901 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:58.484+0000 7f6a2342b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:28:58.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:58.437+0000 7f4fcdd74040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:28:58.982 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:28:58.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:28:58.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:28:58.983 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:28:58.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:58.984 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-09-11T22:28:59.001 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:28:59.001 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:28:59.001 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:59.002 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42214sec preferred_lft 42214sec 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:59.003 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-09-11T22:28:59.004 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:28:59.004 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-11T22:28:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:59.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:28:59 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4267122254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:59.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:59.219 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:28:59.246 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-09-11T22:28:59.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:59.248 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-09-11T22:28:59.318 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-09-11T22:28:59.318 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:28:59.318 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:28:59.318 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:28:59.318 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:28:59.318 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:59.319 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-11T22:28:59.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:28:59.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:28:59.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:28:59.319 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-11T22:28:59.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:28:59 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4267122254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:59.402 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:59.273+0000 7f374a0a2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:28:59.403 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:28:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:28:59.340+0000 7f374a0a2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:28:59.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:59.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:28:59 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4267122254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:59.411 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:59.357+0000 7f4fcdd74040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:28:59.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:59.431+0000 7f6a2342b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:28:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:59.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:59.638 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-11T22:28:59.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:59.654 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-09-11T22:28:59.712 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:59.712 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-11T22:28:59.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:28:59.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T22:28:59.712 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-11T22:28:59.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:59.812 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:28:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:28:59.504+0000 7f6a2342b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:28:59.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:59.837 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T22:28:59.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:59.837 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T22:28:59.838 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-11T22:28:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:59.911 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:28:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:28:59.427+0000 7f4fcdd74040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:28:59.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:59.984 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:59.984 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-11T22:28:59.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-09-11T22:28:59.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:28:59.984 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-11T22:29:00.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:29:00.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:29:00.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:29:00.065 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:00.094 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:29:00.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:29:00.095 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:00.150 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T22:29:00.150 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T22:29:00.151 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/a72c9781-b3e7-4bab-8e68-9383a1ea180f 2024-09-11T22:29:00.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:29:00.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/a72c9781-b3e7-4bab-8e68-9383a1ea180f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-11T22:29:00.249 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-11T22:29:00.249 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-11T22:29:00.304 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.051+0000 7f374a0a2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:29:00.304 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.167+0000 7f374a0a2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:29:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-11T22:29:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-11T22:29:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.45:3300,172.21.15.169:3300" 2024-09-11T22:29:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@c727338c-708b-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/a72c9781-b3e7-4bab-8e68-9383a1ea180f 2024-09-11T22:29:00.377 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.22:3300/172.21.15.45:3300/172.21.15.169:3300" will pass to kernel 2024-09-11T22:29:00.378 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:29:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:29:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:29:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:29:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:29:00.380 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:29:00.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:29:00.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:00.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:29:00.441 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.170+0000 7f4fcdd74040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:29:00.441 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.290+0000 7f4fcdd74040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:29:00.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:29:00.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:29:00.513 INFO:teuthology.orchestra.run.smithi022.stdout:client15069 2024-09-11T22:29:00.513 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:29:00.513 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:29:00.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:29:00.560 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.277+0000 7f6a2342b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:29:00.560 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.402+0000 7f6a2342b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:29:00.586 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.309+0000 7f374a0a2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:29:00.586 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.370+0000 7f374a0a2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:29:00.586 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.518+0000 7f374a0a2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:29:00.586 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.585+0000 7f374a0a2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:29:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:29:00.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:29:00.619 INFO:teuthology.orchestra.run.smithi022.stdout:client15069 2024-09-11T22:29:00.619 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:29:00.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:29:00.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:29:00.679 INFO:teuthology.orchestra.run.smithi022.stdout:client15069 2024-09-11T22:29:00.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c727338c-708b-11ef-bcea-c7b262605968.client15069/status') 2024-09-11T22:29:00.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:29:00.731 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.441+0000 7f4fcdd74040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:29:00.731 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.504+0000 7f4fcdd74040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:29:00.731 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.660+0000 7f4fcdd74040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:29:00.731 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.730+0000 7f4fcdd74040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:29:00.740 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.15069 (3)192.168.0.1:0/1616309032 2024-09-11T22:29:00.740 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-09-11T22:29:00.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-09-11T22:29:00.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-09-11T22:29:00.741 INFO:teuthology.orchestra.run.smithi022.stderr:70 bytes copied, 2.5006e-05 s, 2.8 MB/s 2024-09-11T22:29:00.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:29:00.748 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T22:29:00.762 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-11T22:29:00.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:29:00.862 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.557+0000 7f6a2342b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:29:00.863 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.625+0000 7f6a2342b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:29:00.863 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.788+0000 7f6a2342b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:29:00.863 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.862+0000 7f6a2342b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:29:00.867 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.645+0000 7f374a0a2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:29:00.867 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.801+0000 7f374a0a2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 -- 172.21.15.22:0/4262834012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89881025c0 msgr2=0x7f8988108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 --2- 172.21.15.22:0/4262834012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89881025c0 0x7f8988108e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8980009ca0 tx=0x7f898002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 -- 172.21.15.22:0/4262834012 shutdown_connections 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 --2- 172.21.15.22:0/4262834012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89881025c0 0x7f8988108e50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 --2- 172.21.15.22:0/4262834012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988101c00 0x7f8988102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 --2- 172.21.15.22:0/4262834012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8988100a10 0x7f8988100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 -- 172.21.15.22:0/4262834012 >> 172.21.15.22:0/4262834012 conn(0x7f89880fc170 msgr2=0x7f89880fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:00.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 -- 172.21.15.22:0/4262834012 shutdown_connections 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.878+0000 7f898cb4b640 1 -- 172.21.15.22:0/4262834012 wait complete. 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 Processor -- start 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 -- start start 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 0x7f8988069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89881025c0 0x7f898819f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f898810c7f0 con 0x7f8988101c00 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f898810c670 con 0x7f8988100a10 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898cb4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f898810c970 con 0x7f89881025c0 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f8985d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f8985d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51186/0 (socket says 172.21.15.22:51186) 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f8985d9b640 1 -- 172.21.15.22:0/3794874851 learned_addr learned my addr 172.21.15.22:0/3794874851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:00.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f898659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 0x7f8988069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.879+0000 7f8986d9d640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89881025c0 0x7f898819f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 -- 172.21.15.22:0/3794874851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89881025c0 msgr2=0x7f898819f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89881025c0 0x7f898819f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 -- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 msgr2=0x7f898819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 -- 172.21.15.22:0/3794874851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898819fb20 con 0x7f8988100a10 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f8985d9b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898659c640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 0x7f8988069ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f897800e9c0 tx=0x7f897800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897800cd80 con 0x7f8988100a10 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8978010930 con 0x7f8988100a10 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898819fdb0 con 0x7f8988100a10 2024-09-11T22:29:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978018a30 con 0x7f8988100a10 2024-09-11T22:29:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.880+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89881a0270 con 0x7f8988100a10 2024-09-11T22:29:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.881+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8988107db0 con 0x7f8988100a10 2024-09-11T22:29:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.882+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 137850+0+0 (secure 0 0 0) 0x7f897801f020 con 0x7f8988100a10 2024-09-11T22:29:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.883+0000 7f89777fe640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 0x7f89700a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.883+0000 7f8985d9b640 1 -- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 msgr2=0x7f89700a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:29:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.883+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f89780cefb0 con 0x7f8988100a10 2024-09-11T22:29:00.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.883+0000 7f8985d9b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 0x7f89700a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:00.887+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f897809bfe0 con 0x7f8988100a10 2024-09-11T22:29:01.027 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.792+0000 7f4fcdd74040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:29:01.027 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:00.958+0000 7f4fcdd74040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:29:01.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.067+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f898802d9d0 con 0x7f8988100a10 2024-09-11T22:29:01.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.068+0000 7f89777fe640 1 -- 172.21.15.22:0/3794874851 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22642 (secure 0 0 0) 0x7f8978084e20 con 0x7f8988100a10 2024-09-11T22:29:01.069 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:01.070 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":82,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:28:28.029994+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 msgr2=0x7f89700a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 0x7f89700a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 msgr2=0x7f8988069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 0x7f8988069ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f897800e9c0 tx=0x7f897800ee80 comp rx=0 tx=0).stop 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 shutdown_connections 2024-09-11T22:29:01.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f89700a2be0 0x7f89700a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89881025c0 0x7f898819f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8988101c00 0x7f898819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 --2- 172.21.15.22:0/3794874851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988100a10 0x7f8988069ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 >> 172.21.15.22:0/3794874851 conn(0x7f89880fc170 msgr2=0x7f8988104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 shutdown_connections 2024-09-11T22:29:01.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.071+0000 7f898cb4b640 1 -- 172.21.15.22:0/3794874851 wait complete. 2024-09-11T22:29:01.083 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:22:47.028188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:27:20.730565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:27:22.755310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:29:01.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:29:01.121 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.866+0000 7f374a0a2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:29:01.121 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:00.934+0000 7f374a0a2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:29:01.121 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:01.016+0000 7f374a0a2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:29:01.121 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:01.075+0000 7f374a0a2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:29:01.122 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:00.926+0000 7f6a2342b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:29:01.122 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.095+0000 7f6a2342b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:29:01.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3794874851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- 172.21.15.22:0/507157276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c102640 msgr2=0x7f4b3c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 --2- 172.21.15.22:0/507157276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c102640 0x7f4b3c104a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009860 tx=0x7f4b3802a340 comp rx=0 tx=0).stop 2024-09-11T22:29:01.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- 172.21.15.22:0/507157276 shutdown_connections 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 --2- 172.21.15.22:0/507157276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 --2- 172.21.15.22:0/507157276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c104f70 0x7f4b3c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 --2- 172.21.15.22:0/507157276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c102640 0x7f4b3c104a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- 172.21.15.22:0/507157276 >> 172.21.15.22:0/507157276 conn(0x7f4b3c0fc140 msgr2=0x7f4b3c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- 172.21.15.22:0/507157276 shutdown_connections 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- 172.21.15.22:0/507157276 wait complete. 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 Processor -- start 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.192+0000 7f4b432f1640 1 -- start start 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 0x7f4b3c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 0x7f4b3c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10d8e0 con 0x7f4b3c1078a0 2024-09-11T22:29:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10d760 con 0x7f4b3c104f70 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b432f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c10da60 con 0x7f4b3c102640 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4108d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 0x7f4b3c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4188e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 0x7f4b3c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4108d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 0x7f4b3c197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:42614/0 (socket says 172.21.15.22:42614) 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4108d640 1 -- 172.21.15.22:0/3058714116 learned_addr learned my addr 172.21.15.22:0/3058714116 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4188e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c19f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51202/0 (socket says 172.21.15.22:51202) 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 -- 172.21.15.22:0/3058714116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 msgr2=0x7f4b3c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 0x7f4b3c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 -- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 msgr2=0x7f4b3c19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c19f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 -- 172.21.15.22:0/3058714116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c19fba0 con 0x7f4b3c104f70 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.193+0000 7f4b4088c640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 0x7f4b3c1984c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c069e20 tx=0x7f4b2c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.194+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00ccd0 con 0x7f4b3c104f70 2024-09-11T22:29:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.194+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4b2c0035f0 con 0x7f4b3c104f70 2024-09-11T22:29:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.194+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c19fe90 con 0x7f4b3c104f70 2024-09-11T22:29:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.194+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c010690 con 0x7f4b3c104f70 2024-09-11T22:29:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.194+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1a03a0 con 0x7f4b3c104f70 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.195+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c0fdc30 con 0x7f4b3c104f70 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.196+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 137850+0+0 (secure 0 0 0) 0x7f4b2c0037a0 con 0x7f4b3c104f70 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.197+0000 7f4b327fc640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 0x7f4b280a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.197+0000 7f4b4108d640 1 -- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 msgr2=0x7f4b280a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.197+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f4b2c0cf170 con 0x7f4b3c104f70 2024-09-11T22:29:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.197+0000 7f4b4108d640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 0x7f4b280a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:01.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.201+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b2c09c100 con 0x7f4b3c104f70 2024-09-11T22:29:01.307 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3794874851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:01.307 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:01.026+0000 7f4fcdd74040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:29:01.307 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:01.096+0000 7f4fcdd74040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:29:01.308 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:01.182+0000 7f4fcdd74040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:29:01.308 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:01.245+0000 7f4fcdd74040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:29:01.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.378+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b3c062e90 con 0x7f4b3c104f70 2024-09-11T22:29:01.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.379+0000 7f4b327fc640 1 -- 172.21.15.22:0/3058714116 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f4b2c009510 con 0x7f4b3c104f70 2024-09-11T22:29:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 msgr2=0x7f4b280a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 0x7f4b280a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 msgr2=0x7f4b3c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 0x7f4b3c1984c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c069e20 tx=0x7f4b2c00ee50 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 shutdown_connections 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b3c1078a0 0x7f4b3c19f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3c104f70 0x7f4b3c1984c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f4b280a2c60 0x7f4b280a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 --2- 172.21.15.22:0/3058714116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b3c102640 0x7f4b3c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 >> 172.21.15.22:0/3058714116 conn(0x7f4b3c0fc140 msgr2=0x7f4b3c102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 shutdown_connections 2024-09-11T22:29:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.381+0000 7f4b432f1640 1 -- 172.21.15.22:0/3058714116 wait complete. 2024-09-11T22:29:01.390 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.166+0000 7f6a2342b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:29:01.390 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.239+0000 7f6a2342b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:29:01.391 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.326+0000 7f6a2342b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:29:01.391 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.390+0000 7f6a2342b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:29:01.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:29:01.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:01 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3794874851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:01.402 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:01.136+0000 7f374a0a2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:29:01.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 -- 172.21.15.22:0/1584465940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c1025b0 msgr2=0x7f6e2c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1584465940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c108e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009ca0 tx=0x7f6e2402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 -- 172.21.15.22:0/1584465940 shutdown_connections 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1584465940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c108e40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1584465940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1584465940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 0x7f6e2c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 -- 172.21.15.22:0/1584465940 >> 172.21.15.22:0/1584465940 conn(0x7f6e2c0fc140 msgr2=0x7f6e2c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 -- 172.21.15.22:0/1584465940 shutdown_connections 2024-09-11T22:29:01.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.542+0000 7f6e3403c640 1 -- 172.21.15.22:0/1584465940 wait complete. 2024-09-11T22:29:01.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 Processor -- start 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 -- start start 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 0x7f6e2c104990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c10c7e0 con 0x7f6e2c101bf0 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c10c660 con 0x7f6e2c1025b0 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e3403c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c10c960 con 0x7f6e2c100a00 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51220/0 (socket says 172.21.15.22:51220) 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 -- 172.21.15.22:0/1217890063 learned_addr learned my addr 172.21.15.22:0/1217890063 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e325d9640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e31dd8640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 0x7f6e2c104990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 -- 172.21.15.22:0/1217890063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 msgr2=0x7f6e2c104990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 0x7f6e2c104990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 -- 172.21.15.22:0/1217890063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c1025b0 msgr2=0x7f6e2c103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 -- 172.21.15.22:0/1217890063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c103da0 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.543+0000 7f6e315d7640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d950 tx=0x7f6e1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.544+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c017070 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.544+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e1c009c30 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.544+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c1a1fe0 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.544+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00f740 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.544+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c1a2450 con 0x7f6e2c101bf0 2024-09-11T22:29:01.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.545+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c1a2770 con 0x7f6e2c101bf0 2024-09-11T22:29:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.546+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137850+0+0 (secure 0 0 0) 0x7f6e1c010a80 con 0x7f6e2c101bf0 2024-09-11T22:29:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.547+0000 7f6e22ffd640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 0x7f6e180a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.547+0000 7f6e31dd8640 1 -- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 msgr2=0x7f6e180a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:29:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.547+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6e1c0cea60 con 0x7f6e2c101bf0 2024-09-11T22:29:01.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.547+0000 7f6e31dd8640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 0x7f6e180a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:01.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.550+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e1c009de0 con 0x7f6e2c101bf0 2024-09-11T22:29:01.652 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:01.454+0000 7f6a2342b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:29:01.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.729+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e2c1a2940 con 0x7f6e2c101bf0 2024-09-11T22:29:01.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.729+0000 7f6e22ffd640 1 -- 172.21.15.22:0/1217890063 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f6e1c09b420 con 0x7f6e2c101bf0 2024-09-11T22:29:01.730 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 msgr2=0x7f6e180a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 0x7f6e180a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 msgr2=0x7f6e2c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d950 tx=0x7f6e1c00de10 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 shutdown_connections 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e2c1025b0 0x7f6e2c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e2c101bf0 0x7f6e2c102fd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f6e180a2c60 0x7f6e180a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 --2- 172.21.15.22:0/1217890063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e2c100a00 0x7f6e2c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 >> 172.21.15.22:0/1217890063 conn(0x7f6e2c0fc140 msgr2=0x7f6e2c0fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 shutdown_connections 2024-09-11T22:29:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.731+0000 7f6e3403c640 1 -- 172.21.15.22:0/1217890063 wait complete. 2024-09-11T22:29:01.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:29:01.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3075494012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0104f10 msgr2=0x7f5ce0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3075494012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0104f10 0x7f5ce0107300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd002a410 comp rx=0 tx=0).stop 2024-09-11T22:29:01.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3075494012 shutdown_connections 2024-09-11T22:29:01.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3075494012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0107840 0x7f5ce0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3075494012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0104f10 0x7f5ce0107300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3075494012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce01025e0 0x7f5ce01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3075494012 >> 172.21.15.22:0/3075494012 conn(0x7f5ce00fc140 msgr2=0x7f5ce00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3075494012 shutdown_connections 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.849+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3075494012 wait complete. 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 Processor -- start 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 -- start start 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce0104f10 0x7f5ce01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0107840 0x7f5ce019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce010d8f0 con 0x7f5ce0107840 2024-09-11T22:29:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce010d770 con 0x7f5ce01025e0 2024-09-11T22:29:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce87b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce010da70 con 0x7f5ce0104f10 2024-09-11T22:29:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce6553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce6d54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0107840 0x7f5ce019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce6553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:60556/0 (socket says 172.21.15.22:60556) 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce6553640 1 -- 172.21.15.22:0/3391605585 learned_addr learned my addr 172.21.15.22:0/3391605585 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.850+0000 7f5ce5d52640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce0104f10 0x7f5ce01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 -- 172.21.15.22:0/3391605585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce0104f10 msgr2=0x7f5ce01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce0104f10 0x7f5ce01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 -- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0107840 msgr2=0x7f5ce019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0107840 0x7f5ce019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 -- 172.21.15.22:0/3391605585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce019fbd0 con 0x7f5ce01025e0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce6553640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9f0 tx=0x7f5cdc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00ccc0 con 0x7f5ce01025e0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cdc00ce60 con 0x7f5ce01025e0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce019fec0 con 0x7f5ce01025e0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc010690 con 0x7f5ce01025e0 2024-09-11T22:29:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.851+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce01a02d0 con 0x7f5ce01025e0 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.852+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce00fdc30 con 0x7f5ce01025e0 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.853+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 137850+0+0 (secure 0 0 0) 0x7f5cdc0046c0 con 0x7f5ce01025e0 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.854+0000 7f5cd77fe640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 0x7f5ccc0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.854+0000 7f5ce5d52640 1 -- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 msgr2=0x7f5ccc0a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3117763107 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.854+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f5cdc0cf4c0 con 0x7f5ce01025e0 2024-09-11T22:29:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.854+0000 7f5ce5d52640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 0x7f5ccc0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:01.857+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cdc09c3f0 con 0x7f5ce01025e0 2024-09-11T22:29:02.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.033+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ce002da10 con 0x7f5ce01025e0 2024-09-11T22:29:02.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.034+0000 7f5cd77fe640 1 -- 172.21.15.22:0/3391605585 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f5cdc09bcf0 con 0x7f5ce01025e0 2024-09-11T22:29:02.037 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-09-11T22:29:02.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 msgr2=0x7f5ccc0a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:02.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 0x7f5ccc0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 msgr2=0x7f5ce0197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9f0 tx=0x7f5cdc00edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 shutdown_connections 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce0107840 0x7f5ce019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.22:6800/3117763107,v1:172.21.15.22:6801/3117763107] conn(0x7f5ccc0a2be0 0x7f5ccc0a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ce0104f10 0x7f5ce01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 --2- 172.21.15.22:0/3391605585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce01025e0 0x7f5ce0197fb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 >> 172.21.15.22:0/3391605585 conn(0x7f5ce00fc140 msgr2=0x7f5ce0102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 shutdown_connections 2024-09-11T22:29:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.036+0000 7f5ce87b7640 1 -- 172.21.15.22:0/3391605585 wait complete. 2024-09-11T22:29:02.047 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-11T22:29:02.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:02.317 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:02.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3058714116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1217890063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: Standby manager daemon z restarted 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: Standby manager daemon z started 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:02.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3391605585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.402 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:29:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z[37330]: 2024-09-11T22:29:01.923+0000 7f374a0a2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3058714116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1217890063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: Standby manager daemon z restarted 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: Standby manager daemon z started 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:02 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3391605585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.411 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:01.306+0000 7f4fcdd74040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:29:02.411 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y[36955]: 2024-09-11T22:29:02.135+0000 7f4fcdd74040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3058714116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1217890063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: Standby manager daemon z restarted 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: Standby manager daemon z started 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.169:0/50193677' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:02.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:02 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3391605585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:29:02.623 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.317+0000 7f6a2342b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:29:02.877 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.622+0000 7f698c200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.877 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.622+0000 7f698c200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.622+0000 7f698c200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.622+0000 7f698c200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.622+0000 7f698c200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.624+0000 7f698a9fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.624+0000 7f698a9fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.624+0000 7f698a9fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.624+0000 7f698a9fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.878 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:02.624+0000 7f698a9fd640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 -- 172.21.15.22:0/3614203741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408101de0 msgr2=0x7f64081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 --2- 172.21.15.22:0/3614203741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408101de0 0x7f64081021c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6404009900 tx=0x7f640402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 -- 172.21.15.22:0/3614203741 shutdown_connections 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 --2- 172.21.15.22:0/3614203741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408106f10 0x7f640810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 --2- 172.21.15.22:0/3614203741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408102790 0x7f64081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 --2- 172.21.15.22:0/3614203741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408101de0 0x7f64081021c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.913+0000 7f6410170640 1 -- 172.21.15.22:0/3614203741 >> 172.21.15.22:0/3614203741 conn(0x7f64080fd8e0 msgr2=0x7f64080ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.914+0000 7f6410170640 1 -- 172.21.15.22:0/3614203741 shutdown_connections 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.914+0000 7f6410170640 1 -- 172.21.15.22:0/3614203741 wait complete. 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.914+0000 7f6410170640 1 Processor -- start 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 -- start start 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408101de0 0x7f6408198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408102790 0x7f6408198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6408112090 con 0x7f6408102790 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6408111f10 con 0x7f6408101de0 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f6410170640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6408112210 con 0x7f6408106f10 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640d70b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408102790 0x7f6408198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:02.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:42776/0 (socket says 172.21.15.22:42776) 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 -- 172.21.15.22:0/374474203 learned_addr learned my addr 172.21.15.22:0/374474203 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640df0c640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408101de0 0x7f6408198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 -- 172.21.15.22:0/374474203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408101de0 msgr2=0x7f6408198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408101de0 0x7f6408198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 -- 172.21.15.22:0/374474203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408102790 msgr2=0x7f6408198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.915+0000 7f640e70d640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408102790 0x7f6408198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f640e70d640 1 -- 172.21.15.22:0/374474203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640819d5e0 con 0x7f6408106f10 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f640e70d640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f640000eaa0 tx=0x7f640000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640000cdb0 con 0x7f6408106f10 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640819d8d0 con 0x7f6408106f10 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64081a51b0 con 0x7f6408106f10 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6400004b20 con 0x7f6408106f10 2024-09-11T22:29:02.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.916+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640001f060 con 0x7f6408106f10 2024-09-11T22:29:02.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.917+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec005290 con 0x7f6408106f10 2024-09-11T22:29:02.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.919+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f64000116d0 con 0x7f6408106f10 2024-09-11T22:29:02.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.920+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f64000ceb50 con 0x7f6408106f10 2024-09-11T22:29:02.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:02.925+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6400016030 con 0x7f6408106f10 2024-09-11T22:29:03.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.187+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63ec005580 con 0x7f6408106f10 2024-09-11T22:29:03.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.188+0000 7f63feffd640 1 -- 172.21.15.22:0/374474203 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f640009b730 con 0x7f6408106f10 2024-09-11T22:29:03.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:03.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:03.189 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 msgr2=0x7f640819cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f640000eaa0 tx=0x7f640000ef60 comp rx=0 tx=0).stop 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 shutdown_connections 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6408106f10 0x7f640819cf00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6408102790 0x7f6408198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 --2- 172.21.15.22:0/374474203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6408101de0 0x7f6408198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 >> 172.21.15.22:0/374474203 conn(0x7f64080fd8e0 msgr2=0x7f64080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 shutdown_connections 2024-09-11T22:29:03.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:03.191+0000 7f6410170640 1 -- 172.21.15.22:0/374474203 wait complete. 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: Standby manager daemon y restarted 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: Standby manager daemon y started 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:03.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: Active manager daemon x restarted 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: Activating manager daemon x 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: mgrmap e20: x(active, starting, since 0.0144536s), standbys: z, y 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:29:03.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:29:03.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: Manager daemon x is now available 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:29:03.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:03 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: Standby manager daemon y restarted 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: Standby manager daemon y started 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:29:03.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: Active manager daemon x restarted 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: Activating manager daemon x 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: mgrmap e20: x(active, starting, since 0.0144536s), standbys: z, y 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:29:03.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:29:03.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: Manager daemon x is now available 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:03.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:29:03.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:03 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: Standby manager daemon y restarted 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: Standby manager daemon y started 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.? 172.21.15.45:0/4225364073' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: Active manager daemon x restarted 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: Activating manager daemon x 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:29:03.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: mgrmap e20: x(active, starting, since 0.0144536s), standbys: z, y 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:29:03.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:29:03.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: Manager daemon x is now available 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:29:03.415 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:03 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:29:04.015 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-11T22:29:04.016 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-11T22:29:04.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- 172.21.15.22:0/3741834257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c107890 msgr2=0x7f083c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 --2- 172.21.15.22:0/3741834257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c107890 0x7f083c109c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0834009ca0 tx=0x7f083402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- 172.21.15.22:0/3741834257 shutdown_connections 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 --2- 172.21.15.22:0/3741834257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c107890 0x7f083c109c80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 --2- 172.21.15.22:0/3741834257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 0x7f083c107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 --2- 172.21.15.22:0/3741834257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c102630 0x7f083c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- 172.21.15.22:0/3741834257 >> 172.21.15.22:0/3741834257 conn(0x7f083c0fc170 msgr2=0x7f083c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- 172.21.15.22:0/3741834257 shutdown_connections 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- 172.21.15.22:0/3741834257 wait complete. 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 Processor -- start 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.128+0000 7f084411f640 1 -- start start 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 0x7f083c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c107890 0x7f083c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f083c10d900 con 0x7f083c102630 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f083c10d780 con 0x7f083c104f60 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f083c10da80 con 0x7f083c107890 2024-09-11T22:29:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55848/0 (socket says 172.21.15.22:55848) 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 -- 172.21.15.22:0/1728390507 learned_addr learned my addr 172.21.15.22:0/1728390507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f08426bc640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c107890 0x7f083c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f08416ba640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 0x7f083c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 -- 172.21.15.22:0/1728390507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c107890 msgr2=0x7f083c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c107890 0x7f083c19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 -- 172.21.15.22:0/1728390507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 msgr2=0x7f083c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 0x7f083c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 -- 172.21.15.22:0/1728390507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c19fb80 con 0x7f083c102630 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0841ebb640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f083800e9f0 tx=0x7f083800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083800cd80 con 0x7f083c102630 2024-09-11T22:29:04.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0838005520 con 0x7f083c102630 2024-09-11T22:29:04.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c19fe70 con 0x7f083c102630 2024-09-11T22:29:04.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.129+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838010690 con 0x7f083c102630 2024-09-11T22:29:04.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.130+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c1a0280 con 0x7f083c102630 2024-09-11T22:29:04.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.131+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c0fdc60 con 0x7f083c102630 2024-09-11T22:29:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.132+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f08380046c0 con 0x7f083c102630 2024-09-11T22:29:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.133+0000 7f0832ffd640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 0x7f08280a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.133+0000 7f08416ba640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 0x7f08280a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.133+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f08380cf320 con 0x7f083c102630 2024-09-11T22:29:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.134+0000 7f08416ba640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 0x7f08280a4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f082c0095f0 tx=0x7f082c005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.137+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08380541b0 con 0x7f083c102630 2024-09-11T22:29:04.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.313+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f083c062630 con 0x7f08280a2990 2024-09-11T22:29:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.320+0000 7f0832ffd640 1 -- 172.21.15.22:0/1728390507 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257749 (secure 0 0 0) 0x7f083c062630 con 0x7f08280a2990 2024-09-11T22:29:04.324 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 msgr2=0x7f08280a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 0x7f08280a4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f082c0095f0 tx=0x7f082c005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 msgr2=0x7f083c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f083800e9f0 tx=0x7f083800edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 shutdown_connections 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f08280a2990 0x7f08280a4e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f083c107890 0x7f083c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f083c104f60 0x7f083c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 --2- 172.21.15.22:0/1728390507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f083c102630 0x7f083c197f60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 >> 172.21.15.22:0/1728390507 conn(0x7f083c0fc170 msgr2=0x7f083c102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 shutdown_connections 2024-09-11T22:29:04.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.323+0000 7f084411f640 1 -- 172.21.15.22:0/1728390507 wait complete. 2024-09-11T22:29:04.335 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/374474203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:04.335 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-mon[30966]: mgrmap e21: x(active, since 1.01972s), standbys: z, y 2024-09-11T22:29:04.337 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2024-09-11T22:29:03.346537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":370,"num_write":387,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396840,"kb_used_data":14108,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544984,"statfs":{"total":1151940427776,"available":1151534063616,"internally_reserved":0,"allocated":14446592,"data_stored":8834328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":253,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:03.089165+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:03.089165+0000","last_peered":"2024-09-11T22:29:03.089165+0000","last_clean":"2024-09-11T22:29:03.089165+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:03.089165+0000","last_undegraded":"2024-09-11T22:29:03.089165+0000","last_fullsized":"2024-09-11T22:29:03.089165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.564707+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:02.564707+0000","last_peered":"2024-09-11T22:29:02.564707+0000","last_clean":"2024-09-11T22:29:02.564707+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:02.564707+0000","last_undegraded":"2024-09-11T22:29:02.564707+0000","last_fullsized":"2024-09-11T22:29:02.564707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578582+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:02.578582+0000","last_peered":"2024-09-11T22:29:02.578582+0000","last_clean":"2024-09-11T22:29:02.578582+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:02.578582+0000","last_undegraded":"2024-09-11T22:29:02.578582+0000","last_fullsized":"2024-09-11T22:29:02.578582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'47","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.570828+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:02.570828+0000","last_peered":"2024-09-11T22:29:02.570828+0000","last_clean":"2024-09-11T22:29:02.570828+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:02.570828+0000","last_undegraded":"2024-09-11T22:29:02.570828+0000","last_fullsized":"2024-09-11T22:29:02.570828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325913+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325913+0000","last_peered":"2024-09-11T22:29:02.325913+0000","last_clean":"2024-09-11T22:29:02.325913+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325913+0000","last_undegraded":"2024-09-11T22:29:02.325913+0000","last_fullsized":"2024-09-11T22:29:02.325913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":294,"num_read_kb":251,"num_write":204,"num_write_kb":1406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1880064,"data_stored":1785447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703964,"statfs":{"total":95995035648,"available":95952859136,"internally_reserved":0,"allocated":1724416,"data_stored":1234308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939691,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704376,"statfs":{"total":95995035648,"available":95953281024,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168624,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1024663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32972,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712180,"statfs":{"total":95995035648,"available":95961272320,"internally_reserved":0,"allocated":1646592,"data_stored":1164761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":433618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":967648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":201329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:04.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:29:04.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:04 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/374474203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:04.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:04 smithi169 ceph-mon[35628]: mgrmap e21: x(active, since 1.01972s), standbys: z, y 2024-09-11T22:29:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:04 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/374474203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:04 smithi045 ceph-mon[35556]: mgrmap e21: x(active, since 1.01972s), standbys: z, y 2024-09-11T22:29:04.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 -- 172.21.15.22:0/2769002921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 msgr2=0x7fdba8102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 --2- 172.21.15.22:0/2769002921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8102080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009900 tx=0x7fdb9c02a410 comp rx=0 tx=0).stop 2024-09-11T22:29:04.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 -- 172.21.15.22:0/2769002921 shutdown_connections 2024-09-11T22:29:04.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 --2- 172.21.15.22:0/2769002921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 --2- 172.21.15.22:0/2769002921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8102080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 --2- 172.21.15.22:0/2769002921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 0x7fdba8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 -- 172.21.15.22:0/2769002921 >> 172.21.15.22:0/2769002921 conn(0x7fdba80fc170 msgr2=0x7fdba80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 -- 172.21.15.22:0/2769002921 shutdown_connections 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.494+0000 7fdbafb11640 1 -- 172.21.15.22:0/2769002921 wait complete. 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 Processor -- start 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 -- start start 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 0x7fdba8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810c7f0 con 0x7fdba81025c0 2024-09-11T22:29:04.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810c670 con 0x7fdba8101c00 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbafb11640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810c970 con 0x7fdba8100a10 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbad0ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55886/0 (socket says 172.21.15.22:55886) 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 -- 172.21.15.22:0/3801008471 learned_addr learned my addr 172.21.15.22:0/3801008471 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbad8ad640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 0x7fdba8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 -- 172.21.15.22:0/3801008471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 msgr2=0x7fdba8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 0x7fdba8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 -- 172.21.15.22:0/3801008471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 msgr2=0x7fdba8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbae0ae640 1 -- 172.21.15.22:0/3801008471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba819fb60 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.495+0000 7fdbad0ac640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdbae0ae640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdba000e970 tx=0x7fdba000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba000ccc0 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba819fe50 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdba000ce60 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0010690 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.496+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba81a02c0 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.497+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba81a0550 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.498+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fdba00046c0 con 0x7fdba81025c0 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.499+0000 7fdba6ffd640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 0x7fdb900a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.499+0000 7fdbad8ad640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 0x7fdb900a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.499+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdba00cf0a0 con 0x7fdba81025c0 2024-09-11T22:29:04.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.500+0000 7fdbad8ad640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 0x7fdb900a4e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdba8101a60 tx=0x7fdb98009500 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.503+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdba009c2b0 con 0x7fdba81025c0 2024-09-11T22:29:04.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.696+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdba81a0720 con 0x7fdb900a2990 2024-09-11T22:29:04.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.703+0000 7fdba6ffd640 1 -- 172.21.15.22:0/3801008471 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257749 (secure 0 0 0) 0x7fdba81a0720 con 0x7fdb900a2990 2024-09-11T22:29:04.710 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:04.711 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 msgr2=0x7fdb900a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 0x7fdb900a4e50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdba8101a60 tx=0x7fdb98009500 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 msgr2=0x7fdba819f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdba000e970 tx=0x7fdba000ed70 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 shutdown_connections 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdb900a2990 0x7fdb900a4e50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdba81025c0 0x7fdba819f4f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba8101c00 0x7fdba8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 --2- 172.21.15.22:0/3801008471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdba8100a10 0x7fdba8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 >> 172.21.15.22:0/3801008471 conn(0x7fdba80fc170 msgr2=0x7fdba80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 shutdown_connections 2024-09-11T22:29:04.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.706+0000 7fdbafb11640 1 -- 172.21.15.22:0/3801008471 wait complete. 2024-09-11T22:29:04.719 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-11T22:29:04.340246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":370,"num_write":387,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396840,"kb_used_data":14108,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544984,"statfs":{"total":1151940427776,"available":1151534063616,"internally_reserved":0,"allocated":14446592,"data_stored":8834328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.993708"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":253,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:03.089165+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:03.089165+0000","last_peered":"2024-09-11T22:29:03.089165+0000","last_clean":"2024-09-11T22:29:03.089165+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:03.089165+0000","last_undegraded":"2024-09-11T22:29:03.089165+0000","last_fullsized":"2024-09-11T22:29:03.089165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.564707+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:02.564707+0000","last_peered":"2024-09-11T22:29:02.564707+0000","last_clean":"2024-09-11T22:29:02.564707+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:02.564707+0000","last_undegraded":"2024-09-11T22:29:02.564707+0000","last_fullsized":"2024-09-11T22:29:02.564707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578582+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:02.578582+0000","last_peered":"2024-09-11T22:29:02.578582+0000","last_clean":"2024-09-11T22:29:02.578582+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:02.578582+0000","last_undegraded":"2024-09-11T22:29:02.578582+0000","last_fullsized":"2024-09-11T22:29:02.578582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'47","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.570828+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:02.570828+0000","last_peered":"2024-09-11T22:29:02.570828+0000","last_clean":"2024-09-11T22:29:02.570828+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:02.570828+0000","last_undegraded":"2024-09-11T22:29:02.570828+0000","last_fullsized":"2024-09-11T22:29:02.570828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325913+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325913+0000","last_peered":"2024-09-11T22:29:02.325913+0000","last_clean":"2024-09-11T22:29:02.325913+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325913+0000","last_undegraded":"2024-09-11T22:29:02.325913+0000","last_fullsized":"2024-09-11T22:29:02.325913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":294,"num_read_kb":251,"num_write":204,"num_write_kb":1406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1880064,"data_stored":1785447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703964,"statfs":{"total":95995035648,"available":95952859136,"internally_reserved":0,"allocated":1724416,"data_stored":1234308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939691,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704376,"statfs":{"total":95995035648,"available":95953281024,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168624,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1024663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32972,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712180,"statfs":{"total":95995035648,"available":95961272320,"internally_reserved":0,"allocated":1646592,"data_stored":1164761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":433618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":967648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":201329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:04.723 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-11T22:29:04.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:29:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 -- 172.21.15.22:0/2226558050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 msgr2=0x7fa4741072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 --2- 172.21.15.22:0/2226558050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa4741072b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa468009900 tx=0x7fa46802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 -- 172.21.15.22:0/2226558050 shutdown_connections 2024-09-11T22:29:04.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 --2- 172.21.15.22:0/2226558050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 0x7fa474109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 --2- 172.21.15.22:0/2226558050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa4741072b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 --2- 172.21.15.22:0/2226558050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 -- 172.21.15.22:0/2226558050 >> 172.21.15.22:0/2226558050 conn(0x7fa4740fc170 msgr2=0x7fa4740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 -- 172.21.15.22:0/2226558050 shutdown_connections 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.870+0000 7fa4789f6640 1 -- 172.21.15.22:0/2226558050 wait complete. 2024-09-11T22:29:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 Processor -- start 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 -- start start 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 0x7fa474100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410d900 con 0x7fa474104ec0 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410d780 con 0x7fa4741077f0 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa4789f6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa47410da80 con 0x7fa474102590 2024-09-11T22:29:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa471d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa471d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55906/0 (socket says 172.21.15.22:55906) 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa471d9b640 1 -- 172.21.15.22:0/1050933271 learned_addr learned my addr 172.21.15.22:0/1050933271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa472d9d640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 0x7fa474100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.871+0000 7fa47259c640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 -- 172.21.15.22:0/1050933271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 msgr2=0x7fa474101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 -- 172.21.15.22:0/1050933271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 msgr2=0x7fa474100a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 0x7fa474100a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 -- 172.21.15.22:0/1050933271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa474101310 con 0x7fa474104ec0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa47259c640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa471d9b640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa468009230 tx=0x7fa4680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46803f030 con 0x7fa474104ec0 2024-09-11T22:29:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa468003d00 con 0x7fa474104ec0 2024-09-11T22:29:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4741a2050 con 0x7fa474104ec0 2024-09-11T22:29:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468035070 con 0x7fa474104ec0 2024-09-11T22:29:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.872+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4741a25a0 con 0x7fa474104ec0 2024-09-11T22:29:04.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.873+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4740fdc60 con 0x7fa474104ec0 2024-09-11T22:29:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.874+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fa468042030 con 0x7fa474104ec0 2024-09-11T22:29:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.875+0000 7fa4637fe640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 0x7fa45c0a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.875+0000 7fa47259c640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 0x7fa45c0a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.875+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa4680ef200 con 0x7fa474104ec0 2024-09-11T22:29:04.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.876+0000 7fa47259c640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 0x7fa45c0a4e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa464009c20 tx=0x7fa464005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:04.880+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4680bc380 con 0x7fa474104ec0 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:04.810+0000 7f696d403640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:29:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: Traceback (most recent call last): 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._connections.run(self.expiration_interval) 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:29:04.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._run(expiration_interval) 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: s = self.context.wrap_socket( 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: return self.sslsocket_class._create( 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self.do_handshake() 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: self._sslobj.do_handshake() 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:29:04.903 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:29:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:29:05.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.071+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa474062630 con 0x7fa45c0a2990 2024-09-11T22:29:05.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.077+0000 7fa4637fe640 1 -- 172.21.15.22:0/1050933271 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257749 (secure 0 0 0) 0x7fa474062630 con 0x7fa45c0a2990 2024-09-11T22:29:05.083 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:05.085 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:05.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 msgr2=0x7fa45c0a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 0x7fa45c0a4e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa464009c20 tx=0x7fa464005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:05.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 msgr2=0x7fa474100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa468009230 tx=0x7fa4680042f0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 shutdown_connections 2024-09-11T22:29:05.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa45c0a2990 0x7fa45c0a4e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4741077f0 0x7fa474100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.080+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa474104ec0 0x7fa474100540 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.081+0000 7fa4789f6640 1 --2- 172.21.15.22:0/1050933271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa474102590 0x7fa474101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.081+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 >> 172.21.15.22:0/1050933271 conn(0x7fa4740fc170 msgr2=0x7fa474102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:05.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.081+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 shutdown_connections 2024-09-11T22:29:05.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:05.081+0000 7fa4789f6640 1 -- 172.21.15.22:0/1050933271 wait complete. 2024-09-11T22:29:05.095 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-11T22:29:04.340246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":370,"num_write":387,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396840,"kb_used_data":14108,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544984,"statfs":{"total":1151940427776,"available":1151534063616,"internally_reserved":0,"allocated":14446592,"data_stored":8834328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.993708"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":253,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:03.089165+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:03.089165+0000","last_peered":"2024-09-11T22:29:03.089165+0000","last_clean":"2024-09-11T22:29:03.089165+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:03.089165+0000","last_undegraded":"2024-09-11T22:29:03.089165+0000","last_fullsized":"2024-09-11T22:29:03.089165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.564707+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:02.564707+0000","last_peered":"2024-09-11T22:29:02.564707+0000","last_clean":"2024-09-11T22:29:02.564707+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:02.564707+0000","last_undegraded":"2024-09-11T22:29:02.564707+0000","last_fullsized":"2024-09-11T22:29:02.564707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578582+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:02.578582+0000","last_peered":"2024-09-11T22:29:02.578582+0000","last_clean":"2024-09-11T22:29:02.578582+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:02.578582+0000","last_undegraded":"2024-09-11T22:29:02.578582+0000","last_fullsized":"2024-09-11T22:29:02.578582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'47","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.570828+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:02.570828+0000","last_peered":"2024-09-11T22:29:02.570828+0000","last_clean":"2024-09-11T22:29:02.570828+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:02.570828+0000","last_undegraded":"2024-09-11T22:29:02.570828+0000","last_fullsized":"2024-09-11T22:29:02.570828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325913+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325913+0000","last_peered":"2024-09-11T22:29:02.325913+0000","last_clean":"2024-09-11T22:29:02.325913+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325913+0000","last_undegraded":"2024-09-11T22:29:02.325913+0000","last_fullsized":"2024-09-11T22:29:02.325913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":294,"num_read_kb":251,"num_write":204,"num_write_kb":1406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1880064,"data_stored":1785447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703964,"statfs":{"total":95995035648,"available":95952859136,"internally_reserved":0,"allocated":1724416,"data_stored":1234308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939691,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704376,"statfs":{"total":95995035648,"available":95953281024,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168624,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1024663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32972,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712180,"statfs":{"total":95995035648,"available":95961272320,"internally_reserved":0,"allocated":1646592,"data_stored":1164761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":433618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":967648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":201329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:05.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:05 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:05 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.410 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:05.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:05 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 -- 172.21.15.22:0/784704832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 msgr2=0x7f0088074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 --2- 172.21.15.22:0/784704832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f0088074a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0078009900 tx=0x7f007802a480 comp rx=0 tx=0).stop 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 -- 172.21.15.22:0/784704832 shutdown_connections 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 --2- 172.21.15.22:0/784704832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f008810e3c0 0x7f0088110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 --2- 172.21.15.22:0/784704832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0088074f40 0x7f008810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 --2- 172.21.15.22:0/784704832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f0088074a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 -- 172.21.15.22:0/784704832 >> 172.21.15.22:0/784704832 conn(0x7f00880fd8c0 msgr2=0x7f00880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 -- 172.21.15.22:0/784704832 shutdown_connections 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.064+0000 7f008d143640 1 -- 172.21.15.22:0/784704832 wait complete. 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 Processor -- start 2024-09-11T22:29:06.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 -- start start 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0088074f40 0x7f00881a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008810e3c0 0x7f008819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114290 con 0x7f0088074620 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114110 con 0x7f008810e3c0 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.065+0000 7f008d143640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114410 con 0x7f0088074f40 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55924/0 (socket says 172.21.15.22:55924) 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 -- 172.21.15.22:0/1788606731 learned_addr learned my addr 172.21.15.22:0/1788606731 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f008659c640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0088074f40 0x7f00881a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f008759e640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008810e3c0 0x7f008819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:06.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 -- 172.21.15.22:0/1788606731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0088074f40 msgr2=0x7f00881a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0088074f40 0x7f00881a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 -- 172.21.15.22:0/1788606731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008810e3c0 msgr2=0x7f008819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008810e3c0 0x7f008819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 -- 172.21.15.22:0/1788606731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008819ad10 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.066+0000 7f0086d9d640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0078006010 tx=0x7f00780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.067+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007803f030 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.067+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008819afa0 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.067+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0078003d00 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.067+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078035070 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.067+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00881a72f0 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.068+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0088074a00 con 0x7f0088074620 2024-09-11T22:29:06.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.070+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f0078042030 con 0x7f0088074620 2024-09-11T22:29:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.071+0000 7f006ffff640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 0x7f00700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.071+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f00780efc50 con 0x7f0088074620 2024-09-11T22:29:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.071+0000 7f008659c640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 0x7f00700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.071+0000 7f008659c640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 0x7f00700a51b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f008810f840 tx=0x7f007c00b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.074+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00780bc2d0 con 0x7f0088074620 2024-09-11T22:29:06.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.298+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f008819bb10 con 0x7f0088074620 2024-09-11T22:29:06.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.299+0000 7f006ffff640 1 -- 172.21.15.22:0/1788606731 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f00780c05d0 con 0x7f0088074620 2024-09-11T22:29:06.300 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:06.300 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:06.300 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:06.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 msgr2=0x7f00700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:06.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 0x7f00700a51b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f008810f840 tx=0x7f007c00b390 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 msgr2=0x7f00881a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0078006010 tx=0x7f00780042f0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 shutdown_connections 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f00700a2cf0 0x7f00700a51b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008810e3c0 0x7f008819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0088074f40 0x7f00881a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 --2- 172.21.15.22:0/1788606731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0088074620 0x7f00881a0420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 >> 172.21.15.22:0/1788606731 conn(0x7f00880fd8c0 msgr2=0x7f00880fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 shutdown_connections 2024-09-11T22:29:06.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:06.303+0000 7f008d143640 1 -- 172.21.15.22:0/1788606731 wait complete. 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:29:04] ENGINE Bus STARTING 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:29:04] ENGINE Serving on http://172.21.15.22:8765 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:29:04] ENGINE Serving on https://172.21.15.22:7150 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:29:04] ENGINE Bus STARTED 2024-09-11T22:29:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: [11/Sep/2024:22:29:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:29:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:29:06.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:06 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: [11/Sep/2024:22:29:04] ENGINE Bus STARTING 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: [11/Sep/2024:22:29:04] ENGINE Serving on http://172.21.15.22:8765 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: [11/Sep/2024:22:29:04] ENGINE Serving on https://172.21.15.22:7150 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: [11/Sep/2024:22:29:04] ENGINE Bus STARTED 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: [11/Sep/2024:22:29:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:29:06.405 INFO:journalctl@ceph.mon.c.smithi169.stdout: Traceback (most recent call last): 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: self._run(expiration_interval) 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:29:06.406 INFO:journalctl@ceph.mon.c.smithi169.stdout: s = self.context.wrap_socket( 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: return self.sslsocket_class._create( 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: self.do_handshake() 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: self._sslobj.do_handshake() 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:29:06.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:29:06.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T22:29:06.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.408 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:06 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: [11/Sep/2024:22:29:04] ENGINE Bus STARTING 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: [11/Sep/2024:22:29:04] ENGINE Serving on http://172.21.15.22:8765 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: [11/Sep/2024:22:29:04] ENGINE Serving on https://172.21.15.22:7150 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: [11/Sep/2024:22:29:04] ENGINE Bus STARTED 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: [11/Sep/2024:22:29:04] ENGINE Error in HTTPServer.serve 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: Traceback (most recent call last): 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: self._run(expiration_interval) 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:29:06.412 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: s = self.context.wrap_socket( 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: return self.sslsocket_class._create( 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: self.do_handshake() 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: self._sslobj.do_handshake() 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:29:06.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:06.414 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:06 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1788606731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:07 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1788606731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:07.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:07 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1788606731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:29:07.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:07.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:07 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:07.416 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 -- 172.21.15.22:0/3090974881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8108290 msgr2=0x7f03d810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 --2- 172.21.15.22:0/3090974881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8108290 0x7f03d810ec30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009cd0 tx=0x7f03d002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 -- 172.21.15.22:0/3090974881 shutdown_connections 2024-09-11T22:29:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 --2- 172.21.15.22:0/3090974881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8108290 0x7f03d810ec30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 --2- 172.21.15.22:0/3090974881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8103740 0x7f03d8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 --2- 172.21.15.22:0/3090974881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8102d90 0x7f03d8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 -- 172.21.15.22:0/3090974881 >> 172.21.15.22:0/3090974881 conn(0x7f03d80fc7d0 msgr2=0x7f03d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 -- 172.21.15.22:0/3090974881 shutdown_connections 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.857+0000 7f03dd540640 1 -- 172.21.15.22:0/3090974881 wait complete. 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 Processor -- start 2024-09-11T22:29:07.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 -- start start 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8103740 0x7f03d8198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8108290 0x7f03d819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03d81121b0 con 0x7f03d8102d90 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8112030 con 0x7f03d8103740 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03dd540640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8112330 con 0x7f03d8108290 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55948/0 (socket says 172.21.15.22:55948) 2024-09-11T22:29:07.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 -- 172.21.15.22:0/2144564379 learned_addr learned my addr 172.21.15.22:0/2144564379 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d67fc640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8103740 0x7f03d8198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d77fe640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8108290 0x7f03d819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 -- 172.21.15.22:0/2144564379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8108290 msgr2=0x7f03d819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8108290 0x7f03d819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 -- 172.21.15.22:0/2144564379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8103740 msgr2=0x7f03d8198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8103740 0x7f03d8198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.858+0000 7f03d6ffd640 1 -- 172.21.15.22:0/2144564379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d819d600 con 0x7f03d8102d90 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03d6ffd640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8017070 con 0x7f03d8102d90 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d819d8f0 con 0x7f03d8102d90 2024-09-11T22:29:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03c8009c30 con 0x7f03d8102d90 2024-09-11T22:29:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c800f740 con 0x7f03d8102d90 2024-09-11T22:29:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.859+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d8100920 con 0x7f03d8102d90 2024-09-11T22:29:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.860+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d8103170 con 0x7f03d8102d90 2024-09-11T22:29:07.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.861+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f03c8010a80 con 0x7f03d8102d90 2024-09-11T22:29:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.862+0000 7f03bffff640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.862+0000 7f03d67fc640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.862+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f03c80cf1f0 con 0x7f03d8102d90 2024-09-11T22:29:07.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.863+0000 7f03d67fc640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 0x7f03c00a5240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03d80fee30 tx=0x7f03cc00b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:07.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:07.866+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03c8009de0 con 0x7f03d8102d90 2024-09-11T22:29:08.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.041+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03d81999b0 con 0x7f03d8102d90 2024-09-11T22:29:08.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.043+0000 7f03bffff640 1 -- 172.21.15.22:0/2144564379 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23020 (secure 0 0 0) 0x7f03c809bcf0 con 0x7f03d8102d90 2024-09-11T22:29:08.044 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:08.044 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:29:02.319828+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/1813461442":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/1692369784":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4017592669":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1661302101":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3117763107":"2024-09-12T22:29:02.319778+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3117763107":"2024-09-12T22:29:02.319778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 msgr2=0x7f03c00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 0x7f03c00a5240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03d80fee30 tx=0x7f03cc00b390 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 msgr2=0x7f03d8198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d950 tx=0x7f03c800de10 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 shutdown_connections 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03d8108290 0x7f03d819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d8103740 0x7f03d8198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 --2- 172.21.15.22:0/2144564379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d8102d90 0x7f03d8198650 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 >> 172.21.15.22:0/2144564379 conn(0x7f03d80fc7d0 msgr2=0x7f03d8105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 shutdown_connections 2024-09-11T22:29:08.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.045+0000 7f03dd540640 1 -- 172.21.15.22:0/2144564379 wait complete. 2024-09-11T22:29:08.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:29:08.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:08.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:08 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2144564379' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-11T22:29:08.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.406 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.407 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:08 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2144564379' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:29:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: Updating smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:08.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:08 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2144564379' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.785 DEBUG:tasks.fwd_scrub:Yielding 2024-09-11T22:29:08.785 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T22:29:08.800 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:29:08.801 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:29:08.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-11T22:29:08.802 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-11T22:29:08.802 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:29:08.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 -- 172.21.15.22:0/3823521189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb064101350 msgr2=0x7fb06410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 --2- 172.21.15.22:0/3823521189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb064101350 0x7fb06410d880 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009cd0 tx=0x7fb05c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 -- 172.21.15.22:0/3823521189 shutdown_connections 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 --2- 172.21.15.22:0/3823521189 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb064101350 0x7fb06410d880 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 --2- 172.21.15.22:0/3823521189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641009b0 0x7fb064100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 --2- 172.21.15.22:0/3823521189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0641069c0 0x7fb064106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 -- 172.21.15.22:0/3823521189 >> 172.21.15.22:0/3823521189 conn(0x7fb064077990 msgr2=0x7fb0640fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 -- 172.21.15.22:0/3823521189 shutdown_connections 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.918+0000 7fb06ace4640 1 -- 172.21.15.22:0/3823521189 wait complete. 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 Processor -- start 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 -- start start 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb064101350 0x7fb0640fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 0x7fb0640fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb064110f20 con 0x7fb0641009b0 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb064110da0 con 0x7fb0641069c0 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb06ace4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641110a0 con 0x7fb064101350 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb068a80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb068a80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55970/0 (socket says 172.21.15.22:55970) 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb068a80640 1 -- 172.21.15.22:0/1288064348 learned_addr learned my addr 172.21.15.22:0/1288064348 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:08.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.919+0000 7fb069281640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 0x7fb0640fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 -- 172.21.15.22:0/1288064348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb064101350 msgr2=0x7fb0640fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb064101350 0x7fb0640fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 -- 172.21.15.22:0/1288064348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 msgr2=0x7fb0640fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 0x7fb0640fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 -- 172.21.15.22:0/1288064348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0641a6840 con 0x7fb0641009b0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb069281640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 0x7fb0640fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb068a80640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d950 tx=0x7fb04c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c017070 con 0x7fb0641009b0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0641a6b30 con 0x7fb0641009b0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb04c009c30 con 0x7fb0641009b0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00f740 con 0x7fb0641009b0 2024-09-11T22:29:08.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.920+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641a70d0 con 0x7fb0641009b0 2024-09-11T22:29:08.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.922+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb064100e10 con 0x7fb0641009b0 2024-09-11T22:29:08.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.923+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fb04c010a80 con 0x7fb0641009b0 2024-09-11T22:29:08.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.923+0000 7fb061ffb640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 0x7fb0500a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:08.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.923+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb04c0cf240 con 0x7fb0641009b0 2024-09-11T22:29:08.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.923+0000 7fb063fff640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 0x7fb0500a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:08.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.924+0000 7fb063fff640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 0x7fb0500a5300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb054005fd0 tx=0x7fb054005850 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:08.928+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb04c009de0 con 0x7fb0641009b0 2024-09-11T22:29:09.075 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:09.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.112+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fb0640fe310 con 0x7fb0641009b0 2024-09-11T22:29:09.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.116+0000 7fb061ffb640 1 -- 172.21.15.22:0/1288064348 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7fb04c097030 con 0x7fb0641009b0 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 msgr2=0x7fb0500a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 0x7fb0500a5300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb054005fd0 tx=0x7fb054005850 comp rx=0 tx=0).stop 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 msgr2=0x7fb0640fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d950 tx=0x7fb04c00de10 comp rx=0 tx=0).stop 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 shutdown_connections 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb0500a2e40 0x7fb0500a5300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0641069c0 0x7fb0640fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb064101350 0x7fb0640fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 --2- 172.21.15.22:0/1288064348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0641009b0 0x7fb0640fcde0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 >> 172.21.15.22:0/1288064348 conn(0x7fb064077990 msgr2=0x7fb064069960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 shutdown_connections 2024-09-11T22:29:09.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.118+0000 7fb06ace4640 1 -- 172.21.15.22:0/1288064348 wait complete. 2024-09-11T22:29:09.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 -- 172.21.15.22:0/3222805438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4106a00 msgr2=0x7f88b4106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 --2- 172.21.15.22:0/3222805438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4106a00 0x7f88b4106de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009930 tx=0x7f88a402a420 comp rx=0 tx=0).stop 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 -- 172.21.15.22:0/3222805438 shutdown_connections 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 --2- 172.21.15.22:0/3222805438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 0x7f88b410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 --2- 172.21.15.22:0/3222805438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b41009f0 0x7f88b4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 --2- 172.21.15.22:0/3222805438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b4106a00 0x7f88b4106de0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 -- 172.21.15.22:0/3222805438 >> 172.21.15.22:0/3222805438 conn(0x7f88b40fc6b0 msgr2=0x7f88b40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 -- 172.21.15.22:0/3222805438 shutdown_connections 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.238+0000 7f88b9a53640 1 -- 172.21.15.22:0/3222805438 wait complete. 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 Processor -- start 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 -- start start 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 0x7f88b41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 0x7f88b41a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4110f60 con 0x7f88b41009f0 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f88b4110de0 con 0x7f88b4101390 2024-09-11T22:29:09.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b9a53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88b41110e0 con 0x7f88b4106a00 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55982/0 (socket says 172.21.15.22:55982) 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 -- 172.21.15.22:0/2233891182 learned_addr learned my addr 172.21.15.22:0/2233891182 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b37fe640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 0x7f88b41a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b27fc640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 0x7f88b41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 -- 172.21.15.22:0/2233891182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 msgr2=0x7f88b41a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 0x7f88b41a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 -- 172.21.15.22:0/2233891182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 msgr2=0x7f88b41997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 0x7f88b41997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b2ffd640 1 -- 172.21.15.22:0/2233891182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b41a4870 con 0x7f88b41009f0 2024-09-11T22:29:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.239+0000 7f88b37fe640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 0x7f88b41a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b2ffd640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009230 tx=0x7f88a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a403f030 con 0x7f88b41009f0 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88a4003af0 con 0x7f88b41009f0 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b41a4a40 con 0x7f88b41009f0 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4035070 con 0x7f88b41009f0 2024-09-11T22:29:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.240+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b41a4ea0 con 0x7f88b41009f0 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.241+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b4100e50 con 0x7f88b41009f0 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.242+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f88a4042030 con 0x7f88b41009f0 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.243+0000 7f88b8a51640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 0x7f88a00a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.243+0000 7f88b27fc640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 0x7f88a00a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.243+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f88a40efde0 con 0x7f88b41009f0 2024-09-11T22:29:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.243+0000 7f88b27fc640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 0x7f88a00a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889c005fd0 tx=0x7f889c005850 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.247+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88a40bc9a0 con 0x7f88b41009f0 2024-09-11T22:29:09.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.431+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f88b41a51b0 con 0x7f88b41009f0 2024-09-11T22:29:09.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.434+0000 7f88b8a51640 1 -- 172.21.15.22:0/2233891182 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7f88a40dae20 con 0x7f88b41009f0 2024-09-11T22:29:09.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 msgr2=0x7f88a00a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 0x7f88a00a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889c005fd0 tx=0x7f889c005850 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 msgr2=0x7f88b41992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009230 tx=0x7f88a4004270 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 shutdown_connections 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88a00a2e40 0x7f88a00a5300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88b4106a00 0x7f88b41a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4101390 0x7f88b41997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 --2- 172.21.15.22:0/2233891182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88b41009f0 0x7f88b41992b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 >> 172.21.15.22:0/2233891182 conn(0x7f88b40fc6b0 msgr2=0x7f88b40fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 shutdown_connections 2024-09-11T22:29:09.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.437+0000 7f88b9a53640 1 -- 172.21.15.22:0/2233891182 wait complete. 2024-09-11T22:29:09.449 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 -- 172.21.15.22:0/1160594127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c101350 msgr2=0x7fdc2c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 --2- 172.21.15.22:0/1160594127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c101350 0x7fdc2c10d880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009930 tx=0x7fdc2402a420 comp rx=0 tx=0).stop 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 -- 172.21.15.22:0/1160594127 shutdown_connections 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 --2- 172.21.15.22:0/1160594127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c101350 0x7fdc2c10d880 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 --2- 172.21.15.22:0/1160594127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 --2- 172.21.15.22:0/1160594127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c1069c0 0x7fdc2c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 -- 172.21.15.22:0/1160594127 >> 172.21.15.22:0/1160594127 conn(0x7fdc2c077990 msgr2=0x7fdc2c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 -- 172.21.15.22:0/1160594127 shutdown_connections 2024-09-11T22:29:09.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 -- 172.21.15.22:0/1160594127 wait complete. 2024-09-11T22:29:09.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.562+0000 7fdc34123640 1 Processor -- start 2024-09-11T22:29:09.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 -- start start 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c101350 0x7fdc2c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1069c0 0x7fdc2c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c110f20 con 0x7fdc2c1009b0 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c110da0 con 0x7fdc2c101350 2024-09-11T22:29:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc34123640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1110a0 con 0x7fdc2c1069c0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56006/0 (socket says 172.21.15.22:56006) 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 -- 172.21.15.22:0/3106612390 learned_addr learned my addr 172.21.15.22:0/3106612390 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc326c0640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1069c0 0x7fdc2c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc316be640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c101350 0x7fdc2c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 -- 172.21.15.22:0/3106612390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1069c0 msgr2=0x7fdc2c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1069c0 0x7fdc2c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 -- 172.21.15.22:0/3106612390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c101350 msgr2=0x7fdc2c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c101350 0x7fdc2c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.563+0000 7fdc31ebf640 1 -- 172.21.15.22:0/3106612390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c19d390 con 0x7fdc2c1009b0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc31ebf640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00eab0 tx=0x7fdc1c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00ce40 con 0x7fdc2c1009b0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc1c011970 con 0x7fdc2c1009b0 2024-09-11T22:29:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c19d680 con 0x7fdc2c1009b0 2024-09-11T22:29:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c010bb0 con 0x7fdc2c1009b0 2024-09-11T22:29:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.564+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c1a4f10 con 0x7fdc2c1009b0 2024-09-11T22:29:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.565+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c100e10 con 0x7fdc2c1009b0 2024-09-11T22:29:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.566+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fdc1c010d50 con 0x7fdc2c1009b0 2024-09-11T22:29:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.567+0000 7fdc2affd640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 0x7fdc140a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.567+0000 7fdc316be640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 0x7fdc140a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.567+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdc1c0cfae0 con 0x7fdc2c1009b0 2024-09-11T22:29:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.568+0000 7fdc316be640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 0x7fdc140a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0ffeb0 tx=0x7fdc2000b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.572+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc1c016030 con 0x7fdc2c1009b0 2024-09-11T22:29:09.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/4150919364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec100b30 msgr2=0x7fe0ec100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/4150919364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec100b30 0x7fe0ec100f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009900 tx=0x7fe0dc02a470 comp rx=0 tx=0).stop 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/4150919364 shutdown_connections 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/4150919364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec105f40 0x7fe0ec1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/4150919364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec101450 0x7fe0ec105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/4150919364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec100b30 0x7fe0ec100f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/4150919364 >> 172.21.15.22:0/4150919364 conn(0x7fe0ec0fc7a0 msgr2=0x7fe0ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/4150919364 shutdown_connections 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/4150919364 wait complete. 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.581+0000 7fe0f1ca3640 1 Processor -- start 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 -- start start 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 0x7fe0ec1a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec105f40 0x7fe0ec19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1186a0 con 0x7fe0ec100b30 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec118520 con 0x7fe0ec105f40 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0f1ca3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec118820 con 0x7fe0ec101450 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56024/0 (socket says 172.21.15.22:56024) 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3045993210 learned_addr learned my addr 172.21.15.22:0/3045993210 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 0x7fe0ec1a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec105f40 0x7fe0ec19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3045993210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 msgr2=0x7fe0ec1a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 0x7fe0ec1a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3045993210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec105f40 msgr2=0x7fe0ec19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec105f40 0x7fe0ec19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3045993210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19f080 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.582+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 0x7fe0ec1a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.583+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.583+0000 7fe0e8ff9640 1 -- 172.21.15.22:0/3045993210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc03f030 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.583+0000 7fe0e8ff9640 1 -- 172.21.15.22:0/3045993210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0dc0044c0 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.583+0000 7fe0e8ff9640 1 -- 172.21.15.22:0/3045993210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc035070 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.583+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19f310 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.584+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec19f770 con 0x7fe0ec100b30 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 Processor -- start 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 -- start start 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 0x56356fdc3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56356fd1b280 con 0x56356fdb6480 2024-09-11T22:29:09.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56356fcc2b10 con 0x56356fdc0d40 2024-09-11T22:29:09.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.586+0000 7fe0f407c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56356fd17240 con 0x56356fdb5b60 2024-09-11T22:29:09.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 0x56356fdc3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:56350/0 (socket says 172.21.15.22:56350) 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0ebfff640 1 -- 172.21.15.22:0/3547823985 learned_addr learned my addr 172.21.15.22:0/3547823985 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 -- 172.21.15.22:0/3547823985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 msgr2=0x56356fdb5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 -- 172.21.15.22:0/3547823985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 msgr2=0x56356fdc0800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc0800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 -- 172.21.15.22:0/3547823985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fccf1f0 con 0x56356fdc0d40 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0e8ff9640 1 -- 172.21.15.22:0/3045993210 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fe0dc042030 con 0x7fe0ec100b30 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 0x56356fdc3130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec1a0140 tx=0x7fe0e0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a7f2b24bc04285 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.587+0000 7fe0d1ffb640 1 -- 172.21.15.22:0/3547823985 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e001e070 con 0x56356fdc0d40 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0d1ffb640 1 -- 172.21.15.22:0/3547823985 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e00035f0 con 0x56356fdc0d40 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0d1ffb640 1 -- 172.21.15.22:0/3547823985 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000f7a0 con 0x56356fdc0d40 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0e8ff9640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 0x7fe0d40a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0e8ff9640 1 -- 172.21.15.22:0/3045993210 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe0dc0efb70 con 0x7fe0ec100b30 2024-09-11T22:29:09.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 0x7fe0d40a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 -- 172.21.15.22:0/3547823985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 msgr2=0x56356fdc3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 0x56356fdc3130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec1a0140 tx=0x7fe0e0009f90 comp rx=0 tx=0).stop 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 -- 172.21.15.22:0/3547823985 shutdown_connections 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdc0d40 0x56356fdc3130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3547823985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdb5b60 0x56356fdb5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.588+0000 7fe0f407c740 1 -- 172.21.15.22:0/3547823985 >> 172.21.15.22:0/3547823985 conn(0x56356fdb20f0 msgr2=0x56356fdb24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 0x7fe0d40a5120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40117b0 tx=0x7fe0e4009500 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 -- 172.21.15.22:0/3547823985 shutdown_connections 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 -- 172.21.15.22:0/3547823985 wait complete. 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 -- start start 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 Processor -- start 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdbdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.589+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdbe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0f407c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56356fdc3910 con 0x56356fdb5b60 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0f407c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56356fcd5f10 con 0x56356fdb6480 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0f407c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56356fdc3a90 con 0x56356fdc0d40 2024-09-11T22:29:09.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0f407c740 10 client.0 _ll_register_callbacks cb 0x56356fc9ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdbdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:60940/0 (socket says 172.21.15.22:60940) 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 -- 172.21.15.22:0/2550150967 learned_addr learned my addr 172.21.15.22:0/2550150967 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdbe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 -- 172.21.15.22:0/2550150967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 msgr2=0x56356fdbe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdbe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 -- 172.21.15.22:0/2550150967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 msgr2=0x56356fdbdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdbdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 -- 172.21.15.22:0/2550150967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356fa8c6a0 con 0x56356fdb6480 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdbe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdbdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0e001c040 tx=0x7fe0e0004230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d124830423b1596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.590+0000 7fe0caffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e001e040 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e00035f0 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe0e0005040 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe0e0032050 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 10 client.24923 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56356fdcf570 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e00035f0 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe0e0021030 con 0x56356fdb6480 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 10 client.24923 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 10 client.24923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 20 client.24923 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:09.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fdd0980 0x56356fdd2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 4 client.24923 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.591+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56356fd287f0 con 0x56356fdd0980 2024-09-11T22:29:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.592+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fdd0980 0x56356fdd2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.592+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fdd0980 0x56356fdd2d70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb40c3e4e4fa302c server_cookie=2acc081ac722e54 in_seq=0 out_seq=0 2024-09-11T22:29:09.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.592+0000 7fe0caffd640 10 client.24923 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0caffd640 1 -- 172.21.15.22:0/2550150967 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56356fd287f0 con 0x56356fdd0980 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0caffd640 10 client.24923 handle_command_reply: tid=0 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 client.24923 shutdown 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 msgr2=0x56356fdbe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0e001c040 tx=0x7fe0e0004230 comp rx=0 tx=0).stop 2024-09-11T22:29:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 shutdown_connections 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fdd0980 0x56356fdd2d70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdbe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdbe1c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 --2- 172.21.15.22:0/2550150967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdbdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 >> 172.21.15.22:0/2550150967 conn(0x56356fdb20f0 msgr2=0x56356fdb7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0caffd640 0 client.24923 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 shutdown_connections 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 1 -- 172.21.15.22:0/2550150967 wait complete. 2024-09-11T22:29:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.593+0000 7fe0f407c740 20 client.24923 trim_cache size 0 max 16384 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 Processor -- start 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 -- start start 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdd8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdb0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b1b50 con 0x56356fdb5b60 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b43d0 con 0x56356fdb6480 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0f407c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b21c0 con 0x56356fdc0d40 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56052/0 (socket says 172.21.15.22:56052) 2024-09-11T22:29:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3194459323 learned_addr learned my addr 172.21.15.22:0/3194459323 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.611+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdb0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdd8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3194459323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 msgr2=0x56356fdb0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdb0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3194459323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 msgr2=0x56356fdd8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdd8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 -- 172.21.15.22:0/3194459323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356fdb1b90 con 0x56356fdb5b60 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0bbc70 tx=0x7fe0dc02a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6b6019d3386b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0d17fa640 1 -- 172.21.15.22:0/3194459323 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0d6020 con 0x56356fdb5b60 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0d17fa640 1 -- 172.21.15.22:0/3194459323 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0dc0bbf70 con 0x56356fdb5b60 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.612+0000 7fe0d17fa640 1 -- 172.21.15.22:0/3194459323 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0c4750 con 0x56356fdb5b60 2024-09-11T22:29:09.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- 172.21.15.22:0/3194459323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 msgr2=0x56356fdd84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0bbc70 tx=0x7fe0dc02a470 comp rx=0 tx=0).stop 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- 172.21.15.22:0/3194459323 shutdown_connections 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdb0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb6480 0x56356fdd8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 --2- 172.21.15.22:0/3194459323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb5b60 0x56356fdd84e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- 172.21.15.22:0/3194459323 >> 172.21.15.22:0/3194459323 conn(0x56356fdb20f0 msgr2=0x56356fdbc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- 172.21.15.22:0/3194459323 shutdown_connections 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- 172.21.15.22:0/3194459323 wait complete. 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.613+0000 7fe0f407c740 1 -- start start 2024-09-11T22:29:09.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 Processor -- start 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b2890 con 0x56356fdb6480 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b3d00 con 0x56356fdb5b60 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b2f60 con 0x56356fdc0d40 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0f407c740 10 client.0 _ll_register_callbacks cb 0x7fe0e001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56068/0 (socket says 172.21.15.22:56068) 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:60954/0 (socket says 172.21.15.22:60954) 2024-09-11T22:29:09.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eaffd640 1 -- 172.21.15.22:0/1466053112 learned_addr learned my addr 172.21.15.22:0/1466053112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0eaffd640 1 -- 172.21.15.22:0/1466053112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 msgr2=0x56356fdc8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.614+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdc8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eaffd640 1 -- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 msgr2=0x56356fdc4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eaffd640 1 -- 172.21.15.22:0/1466053112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356fdc91f0 con 0x56356fdb6480 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0ebfff640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdc8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0eaffd640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0011d60 tx=0x7fe0e0003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1353642e425f166b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0caffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e003b060 con 0x56356fdb6480 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe0e0003c90 con 0x56356fdb6480 2024-09-11T22:29:09.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0dc0bbf70 con 0x56356fdb6480 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe0e001e040 con 0x56356fdb6480 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0f407c740 10 client.15204 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56356fe3b090 con 0x56356fdb6480 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.615+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0dc0bbf70 con 0x56356fdb6480 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe0e0021070 con 0x56356fdb6480 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 10 client.15204 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 10 client.15204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 20 client.15204 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fe3b780 0x56356fe3dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 4 client.15204 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56356fd22d00 con 0x56356fe3b780 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fe3b780 0x56356fe3dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0eb7fe640 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fe3b780 0x56356fe3dba0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d56904026d7c86d server_cookie=bba5803aee780fb9 in_seq=0 out_seq=0 2024-09-11T22:29:09.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.616+0000 7fe0caffd640 10 client.15204 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.617+0000 7fe0caffd640 1 -- 172.21.15.22:0/1466053112 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56356fd22d00 con 0x56356fe3b780 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.617+0000 7fe0caffd640 10 client.15204 handle_command_reply: tid=0 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.617+0000 7fe0f407c740 1 client.15204 shutdown 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 msgr2=0x56356fdc49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0011d60 tx=0x7fe0e0003700 comp rx=0 tx=0).stop 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 shutdown_connections 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56356fe3b780 0x56356fe3dba0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56356fdc0d40 0x56356fdc8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56356fdb6480 0x56356fdc49c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 --2- 172.21.15.22:0/1466053112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56356fdb5b60 0x56356fdc4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 >> 172.21.15.22:0/1466053112 conn(0x56356fdb20f0 msgr2=0x56356fdb7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0caffd640 0 client.15204 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:09.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 shutdown_connections 2024-09-11T22:29:09.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 1 -- 172.21.15.22:0/1466053112 wait complete. 2024-09-11T22:29:09.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.618+0000 7fe0f407c740 20 client.15204 trim_cache size 0 max 16384 2024-09-11T22:29:09.623 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:09.623 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:29:09.623 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "009f23ef-b6a6-4ba1-8b04-b1dc93d72deb", 2024-09-11T22:29:09.624 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:29:09.624 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 msgr2=0x7fe0d40a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 0x7fe0d40a5120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40117b0 tx=0x7fe0e4009500 comp rx=0 tx=0).stop 2024-09-11T22:29:09.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 msgr2=0x7fe0ec1a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc0040c0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 shutdown_connections 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe0d40a2c60 0x7fe0d40a5120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec105f40 0x7fe0ec19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0ec101450 0x7fe0ec1a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 --2- 172.21.15.22:0/3045993210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0ec100b30 0x7fe0ec1a4790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 >> 172.21.15.22:0/3045993210 conn(0x7fe0ec0fc7a0 msgr2=0x7fe0ec1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 shutdown_connections 2024-09-11T22:29:09.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.619+0000 7fe0f1ca3640 1 -- 172.21.15.22:0/3045993210 wait complete. 2024-09-11T22:29:09.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.758+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fdc2c1a5260 con 0x7fdc2c1009b0 2024-09-11T22:29:09.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.762+0000 7fdc2affd640 1 -- 172.21.15.22:0/3106612390 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7fdc1c09c580 con 0x7fdc2c1009b0 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 msgr2=0x7fdc140a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 0x7fdc140a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0ffeb0 tx=0x7fdc2000b390 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 msgr2=0x7fdc2c1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00eab0 tx=0x7fdc1c00ef70 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 shutdown_connections 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdc140a2e40 0x7fdc140a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc2c1069c0 0x7fdc2c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c101350 0x7fdc2c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 --2- 172.21.15.22:0/3106612390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c1009b0 0x7fdc2c1983a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 >> 172.21.15.22:0/3106612390 conn(0x7fdc2c077990 msgr2=0x7fdc2c069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 shutdown_connections 2024-09-11T22:29:09.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.765+0000 7fdc34123640 1 -- 172.21.15.22:0/3106612390 wait complete. 2024-09-11T22:29:09.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-11T22:29:09.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 -- 172.21.15.22:0/3985227116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa76010c0b0 msgr2=0x7fa76010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 --2- 172.21.15.22:0/3985227116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa76010c0b0 0x7fa76010e570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ca0 tx=0x7fa75802a950 comp rx=0 tx=0).stop 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 -- 172.21.15.22:0/3985227116 shutdown_connections 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 --2- 172.21.15.22:0/3985227116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa76010c0b0 0x7fa76010e570 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 --2- 172.21.15.22:0/3985227116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa760103640 0x7fa76010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 --2- 172.21.15.22:0/3985227116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760102d20 0x7fa760103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.887+0000 7fa766923640 1 -- 172.21.15.22:0/3985227116 >> 172.21.15.22:0/3985227116 conn(0x7fa7600fc6f0 msgr2=0x7fa7600feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 -- 172.21.15.22:0/3985227116 shutdown_connections 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 -- 172.21.15.22:0/3985227116 wait complete. 2024-09-11T22:29:09.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 Processor -- start 2024-09-11T22:29:09.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 -- start start 2024-09-11T22:29:09.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760103640 0x7fa7601989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76010c0b0 0x7fa76019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111ff0 con 0x7fa760102d20 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.888+0000 7fa766923640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111e70 con 0x7fa760103640 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa766923640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112170 con 0x7fa76010c0b0 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56096/0 (socket says 172.21.15.22:56096) 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 -- 172.21.15.22:0/3733930955 learned_addr learned my addr 172.21.15.22:0/3733930955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75f7fe640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760103640 0x7fa7601989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa764ec0640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76010c0b0 0x7fa76019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 -- 172.21.15.22:0/3733930955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76010c0b0 msgr2=0x7fa76019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76010c0b0 0x7fa76019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 -- 172.21.15.22:0/3733930955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760103640 msgr2=0x7fa7601989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760103640 0x7fa7601989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 -- 172.21.15.22:0/3733930955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76019d490 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75ffff640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750017070 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa750009c30 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76019d780 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75000f740 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.889+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a5010 con 0x7fa760102d20 2024-09-11T22:29:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.890+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76006ab60 con 0x7fa760102d20 2024-09-11T22:29:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.892+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fa750010a80 con 0x7fa760102d20 2024-09-11T22:29:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.892+0000 7fa75d7fa640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 0x7fa7480a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.892+0000 7fa75f7fe640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 0x7fa7480a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.892+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7500cf100 con 0x7fa760102d20 2024-09-11T22:29:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.893+0000 7fa75f7fe640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 0x7fa7480a5380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa76010e920 tx=0x7fa754005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:09.898+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa750009de0 con 0x7fa760102d20 2024-09-11T22:29:10.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.098+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa7600fea10 con 0x7fa7480a2ec0 2024-09-11T22:29:10.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.166+0000 7fa75d7fa640 1 -- 172.21.15.22:0/3733930955 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa7600fea10 con 0x7fa7480a2ec0 2024-09-11T22:29:10.167 INFO:teuthology.orchestra.run.smithi022.stdout:Schedule set for path / 2024-09-11T22:29:10.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.168+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 msgr2=0x7fa7480a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.168+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 0x7fa7480a5380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa76010e920 tx=0x7fa754005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:10.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.168+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 msgr2=0x7fa7601984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.168+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000de10 comp rx=0 tx=0).stop 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 shutdown_connections 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7480a2ec0 0x7fa7480a5380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa76010c0b0 0x7fa76019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760103640 0x7fa7601989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 --2- 172.21.15.22:0/3733930955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa760102d20 0x7fa7601984a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 >> 172.21.15.22:0/3733930955 conn(0x7fa7600fc6f0 msgr2=0x7fa7600fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 shutdown_connections 2024-09-11T22:29:10.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.169+0000 7fa766923640 1 -- 172.21.15.22:0/3733930955 wait complete. 2024-09-11T22:29:10.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-11T22:29:10.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- 172.21.15.22:0/3869221037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281009b0 msgr2=0x7f6828100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 --2- 172.21.15.22:0/3869221037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281009b0 0x7f6828100e10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6810009930 tx=0x7f681002a420 comp rx=0 tx=0).stop 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- 172.21.15.22:0/3869221037 shutdown_connections 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 --2- 172.21.15.22:0/3869221037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f682810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 --2- 172.21.15.22:0/3869221037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281009b0 0x7f6828100e10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 --2- 172.21.15.22:0/3869221037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281069c0 0x7f6828106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- 172.21.15.22:0/3869221037 >> 172.21.15.22:0/3869221037 conn(0x7f6828077990 msgr2=0x7f68280fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- 172.21.15.22:0/3869221037 shutdown_connections 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- 172.21.15.22:0/3869221037 wait complete. 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 Processor -- start 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.287+0000 7f682cc45640 1 -- start start 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281009b0 0x7f6828199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f6828199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6828110ee0 con 0x7f68281069c0 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6828110d60 con 0x7f6828101350 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682cc45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6828111060 con 0x7f68281009b0 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56112/0 (socket says 172.21.15.22:56112) 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 -- 172.21.15.22:0/36396262 learned_addr learned my addr 172.21.15.22:0/36396262 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f682659c640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281009b0 0x7f6828199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6825d9b640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f6828199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 -- 172.21.15.22:0/36396262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281009b0 msgr2=0x7f6828199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281009b0 0x7f6828199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 -- 172.21.15.22:0/36396262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 msgr2=0x7f6828199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f6828199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 -- 172.21.15.22:0/36396262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68281a47f0 con 0x7f68281069c0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6825d9b640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f6828199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f6826d9d640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f682000d750 tx=0x7f682000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.288+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820017070 con 0x7f68281069c0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.289+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6820005520 con 0x7f68281069c0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.289+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820004e00 con 0x7f68281069c0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.289+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68281a49c0 con 0x7f68281069c0 2024-09-11T22:29:10.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.289+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281a4e90 con 0x7f68281069c0 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.290+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6828100e10 con 0x7f68281069c0 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.291+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f6820004fa0 con 0x7f68281069c0 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.291+0000 7f681f7fe640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 0x7f68140a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.292+0000 7f682659c640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 0x7f68140a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.292+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f68200cf420 con 0x7f68281069c0 2024-09-11T22:29:10.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.292+0000 7f682659c640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 0x7f68140a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6818007d50 tx=0x7f6818007730 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:10.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.295+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f682009bf20 con 0x7f68281069c0 2024-09-11T22:29:10.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1288064348' entity='client.admin' 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2233891182' entity='client.admin' 2024-09-11T22:29:10.387 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3106612390' entity='client.admin' 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1288064348' entity='client.admin' 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2233891182' entity='client.admin' 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3106612390' entity='client.admin' 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1288064348' entity='client.admin' 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2233891182' entity='client.admin' 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:29:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3106612390' entity='client.admin' 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:10.413 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:29:10.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.494+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f6828103e40 con 0x7f68140a2e40 2024-09-11T22:29:10.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.557+0000 7f681f7fe640 1 -- 172.21.15.22:0/36396262 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f6828103e40 con 0x7f68140a2e40 2024-09-11T22:29:10.558 INFO:teuthology.orchestra.run.smithi022.stdout:Retention added to path / 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 msgr2=0x7f68140a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 0x7f68140a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6818007d50 tx=0x7f6818007730 comp rx=0 tx=0).stop 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 msgr2=0x7f68281a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f682000d750 tx=0x7f682000dc10 comp rx=0 tx=0).stop 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 shutdown_connections 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f68140a2e40 0x7f68140a5300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68281069c0 0x7f68281a42b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6828101350 0x7f6828199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 --2- 172.21.15.22:0/36396262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68281009b0 0x7f6828199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 >> 172.21.15.22:0/36396262 conn(0x7f6828077990 msgr2=0x7f6828103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 shutdown_connections 2024-09-11T22:29:10.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.559+0000 7f682cc45640 1 -- 172.21.15.22:0/36396262 wait complete. 2024-09-11T22:29:10.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T22:29:10.637 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:10.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.720+0000 7f8a068a4640 1 -- 172.21.15.22:0/1165246988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 msgr2=0x7f8a0010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.720+0000 7f8a068a4640 1 --2- 172.21.15.22:0/1165246988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a0010d8c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009cd0 tx=0x7f89f802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 -- 172.21.15.22:0/1165246988 shutdown_connections 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 --2- 172.21.15.22:0/1165246988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a0010d8c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 --2- 172.21.15.22:0/1165246988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 0x7f8a00100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 --2- 172.21.15.22:0/1165246988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 0x7f8a00106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 -- 172.21.15.22:0/1165246988 >> 172.21.15.22:0/1165246988 conn(0x7f8a000fc6b0 msgr2=0x7f8a000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 -- 172.21.15.22:0/1165246988 shutdown_connections 2024-09-11T22:29:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 -- 172.21.15.22:0/1165246988 wait complete. 2024-09-11T22:29:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 Processor -- start 2024-09-11T22:29:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.721+0000 7f8a068a4640 1 -- start start 2024-09-11T22:29:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 0x7f8a00198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 0x7f8a0019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00112070 con 0x7f8a00101390 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00111ef0 con 0x7f8a001009f0 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8a001121f0 con 0x7f8a00106a00 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56132/0 (socket says 172.21.15.22:56132) 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 -- 172.21.15.22:0/533604154 learned_addr learned my addr 172.21.15.22:0/533604154 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89fffff640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 0x7f8a00198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a04e41640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 0x7f8a0019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 -- 172.21.15.22:0/533604154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 msgr2=0x7f8a0019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 0x7f8a0019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 -- 172.21.15.22:0/533604154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 msgr2=0x7f8a00198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 0x7f8a00198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 -- 172.21.15.22:0/533604154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0019d230 con 0x7f8a00101390 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89ff7fe640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89f400e9f0 tx=0x7f89f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400cd80 con 0x7f8a00101390 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0019d520 con 0x7f8a00101390 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f89f4010930 con 0x7f8a00101390 2024-09-11T22:29:10.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4018b00 con 0x7f8a00101390 2024-09-11T22:29:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.722+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a001a4db0 con 0x7f8a00101390 2024-09-11T22:29:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.723+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a00199590 con 0x7f8a00101390 2024-09-11T22:29:10.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.724+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f89f4018ca0 con 0x7f8a00101390 2024-09-11T22:29:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.725+0000 7f89fd7fa640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 0x7f89e80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.725+0000 7f89fffff640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 0x7f89e80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.725+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f89f40cfa80 con 0x7f8a00101390 2024-09-11T22:29:10.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.726+0000 7f89fffff640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 0x7f89e80a5300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009890 tx=0x7f89f0008040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:10.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.729+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89f409c580 con 0x7f8a00101390 2024-09-11T22:29:10.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.927+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8a001a4f80 con 0x7f89e80a2e40 2024-09-11T22:29:10.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.934+0000 7f89fd7fa640 1 -- 172.21.15.22:0/533604154 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f8a001a4f80 con 0x7f89e80a2e40 2024-09-11T22:29:10.935 INFO:teuthology.orchestra.run.smithi022.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T22:29:10", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 msgr2=0x7f89e80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 0x7f89e80a5300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009890 tx=0x7f89f0008040 comp rx=0 tx=0).stop 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 msgr2=0x7f8a00198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89f400e9f0 tx=0x7f89f400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 shutdown_connections 2024-09-11T22:29:10.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f89e80a2e40 0x7f89e80a5300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8a00106a00 0x7f8a0019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a00101390 0x7f8a00198780 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 --2- 172.21.15.22:0/533604154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a001009f0 0x7f8a00198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 >> 172.21.15.22:0/533604154 conn(0x7f8a000fc6b0 msgr2=0x7f8a000fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.936+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 shutdown_connections 2024-09-11T22:29:10.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:10.937+0000 7f8a068a4640 1 -- 172.21.15.22:0/533604154 wait complete. 2024-09-11T22:29:10.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 -- 172.21.15.22:0/616814154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 msgr2=0x7f7aec106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 --2- 172.21.15.22:0/616814154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec106da0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009930 tx=0x7f7adc02a420 comp rx=0 tx=0).stop 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 -- 172.21.15.22:0/616814154 shutdown_connections 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 --2- 172.21.15.22:0/616814154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 0x7f7aec10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 --2- 172.21.15.22:0/616814154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 0x7f7aec100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 --2- 172.21.15.22:0/616814154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec106da0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 -- 172.21.15.22:0/616814154 >> 172.21.15.22:0/616814154 conn(0x7f7aec077990 msgr2=0x7f7aec0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 -- 172.21.15.22:0/616814154 shutdown_connections 2024-09-11T22:29:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.096+0000 7f7af20e4640 1 -- 172.21.15.22:0/616814154 wait complete. 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 Processor -- start 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 -- start start 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 0x7f7aec1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 0x7f7aec197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec110f30 con 0x7f7aec1069c0 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec110db0 con 0x7f7aec1009b0 2024-09-11T22:29:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.097+0000 7f7af20e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec1110b0 con 0x7f7aec101350 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56144/0 (socket says 172.21.15.22:56144) 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 -- 172.21.15.22:0/3746838538 learned_addr learned my addr 172.21.15.22:0/3746838538 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aeb7fe640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 0x7f7aec1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aeaffd640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 0x7f7aec197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 -- 172.21.15.22:0/3746838538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 msgr2=0x7f7aec197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 0x7f7aec197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 -- 172.21.15.22:0/3746838538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 msgr2=0x7f7aec1972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 0x7f7aec1972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 -- 172.21.15.22:0/3746838538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec19c2c0 con 0x7f7aec1069c0 2024-09-11T22:29:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7aebfff640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400cce0 tx=0x7f7ae400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400f450 con 0x7f7aec1069c0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ae400faf0 con 0x7f7aec1069c0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec19c5b0 con 0x7f7aec1069c0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4018cc0 con 0x7f7aec1069c0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.098+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1a3e40 con 0x7f7aec1069c0 2024-09-11T22:29:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.100+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec100e10 con 0x7f7aec1069c0 2024-09-11T22:29:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.101+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f7ae400f5f0 con 0x7f7aec1069c0 2024-09-11T22:29:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.102+0000 7f7ae8ff9640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 0x7f7ad80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.102+0000 7f7aeb7fe640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 0x7f7ad80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.102+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7ae40cf9d0 con 0x7f7aec1069c0 2024-09-11T22:29:11.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.103+0000 7f7aeb7fe640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 0x7f7ad80a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006010 tx=0x7f7adc005e80 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.106+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ae4014030 con 0x7f7aec1069c0 2024-09-11T22:29:11.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 -- 172.21.15.22:0/3164462270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34100e20 msgr2=0x7fca34101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 --2- 172.21.15.22:0/3164462270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34100e20 0x7fca34101200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca24009900 tx=0x7fca2402a480 comp rx=0 tx=0).stop 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 -- 172.21.15.22:0/3164462270 shutdown_connections 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 --2- 172.21.15.22:0/3164462270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34102ef0 0x7fca3410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 --2- 172.21.15.22:0/3164462270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102570 0x7fca341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 --2- 172.21.15.22:0/3164462270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34100e20 0x7fca34101200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 -- 172.21.15.22:0/3164462270 >> 172.21.15.22:0/3164462270 conn(0x7fca340fc7d0 msgr2=0x7fca340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 -- 172.21.15.22:0/3164462270 shutdown_connections 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.120+0000 7fca3a411640 1 -- 172.21.15.22:0/3164462270 wait complete. 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca3a411640 1 Processor -- start 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca3a411640 1 -- start start 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca3a411640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34100e20 0x7fca341993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca3a411640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca3a411640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102ef0 0x7fca341a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56166/0 (socket says 172.21.15.22:56166) 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.121+0000 7fca2bfff640 1 -- 172.21.15.22:0/2308448165 learned_addr learned my addr 172.21.15.22:0/2308448165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca341110f0 con 0x7fca34102570 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fca34110f70 con 0x7fca34102ef0 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca34111270 con 0x7fca34100e20 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca33fff640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34100e20 0x7fca341993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca389ae640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102ef0 0x7fca341a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 -- 172.21.15.22:0/2308448165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34100e20 msgr2=0x7fca341993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34100e20 0x7fca341993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 -- 172.21.15.22:0/2308448165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102ef0 msgr2=0x7fca341a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102ef0 0x7fca341a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca341a49b0 con 0x7fca34102570 2024-09-11T22:29:11.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.122+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e9f0 tx=0x7fca1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.123+0000 7fca31ffb640 1 -- 172.21.15.22:0/2308448165 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00cd80 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.123+0000 7fca31ffb640 1 -- 172.21.15.22:0/2308448165 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca1c010930 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.123+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca341a4b80 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.123+0000 7fca31ffb640 1 -- 172.21.15.22:0/2308448165 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c018b00 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.124+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca341a50c0 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.126+0000 7fca31ffb640 1 -- 172.21.15.22:0/2308448165 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fca1c018ca0 con 0x7fca34102570 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.126+0000 7fca3c7ea740 1 Processor -- start 2024-09-11T22:29:11.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.126+0000 7fca3c7ea740 1 -- start start 2024-09-11T22:29:11.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c6898494a0 0x55c689849880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c6897af2e0 con 0x55c689854680 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c689756ce0 con 0x55c6898494a0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c6897ab2a0 con 0x55c689849dc0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca31ffb640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 0x7fca200a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:56474/0 (socket says 172.21.15.22:56474) 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56180/0 (socket says 172.21.15.22:56180) 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 -- 172.21.15.22:0/1183338969 learned_addr learned my addr 172.21.15.22:0/1183338969 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca389ae640 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c6898494a0 0x55c689849880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca389ae640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 0x7fca200a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca31ffb640 1 -- 172.21.15.22:0/2308448165 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fca1c0cf920 con 0x7fca34102570 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 -- 172.21.15.22:0/1183338969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c6898494a0 msgr2=0x55c689849880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c6898494a0 0x55c689849880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 -- 172.21.15.22:0/1183338969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 msgr2=0x55c689856a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca33fff640 1 -- 172.21.15.22:0/1183338969 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68973b440 con 0x55c689849dc0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.127+0000 7fca2bfff640 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.128+0000 7fca389ae640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 0x7fca200a52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005fd0 tx=0x7fca2c009500 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.128+0000 7fca33fff640 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca24009900 tx=0x7fca24031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04a6fc2ecb78754 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.128+0000 7fca2a7fc640 1 -- 172.21.15.22:0/1183338969 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24035040 con 0x55c689849dc0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.128+0000 7fca2a7fc640 1 -- 172.21.15.22:0/1183338969 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca24005540 con 0x55c689849dc0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.128+0000 7fca2a7fc640 1 -- 172.21.15.22:0/1183338969 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca240315e0 con 0x55c689849dc0 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1183338969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 msgr2=0x55c689854140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca24009900 tx=0x7fca24031490 comp rx=0 tx=0).stop 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1183338969 shutdown_connections 2024-09-11T22:29:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689854680 0x55c689856a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c689854140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1183338969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c6898494a0 0x55c689849880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1183338969 >> 172.21.15.22:0/1183338969 conn(0x55c689845a30 msgr2=0x55c689845e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1183338969 shutdown_connections 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1183338969 wait complete. 2024-09-11T22:29:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 -- start start 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.129+0000 7fca3c7ea740 1 Processor -- start 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689851220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689854680 0x55c689851760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c689857250 con 0x55c6898494a0 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c68976a050 con 0x55c689849dc0 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c6898573d0 con 0x55c689854680 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca3c7ea740 10 client.0 _ll_register_callbacks cb 0x55c6897aa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56184/0 (socket says 172.21.15.22:56184) 2024-09-11T22:29:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 -- 172.21.15.22:0/1343304490 learned_addr learned my addr 172.21.15.22:0/1343304490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca2bfff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689851220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca389ae640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689854680 0x55c689851760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 -- 172.21.15.22:0/1343304490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689854680 msgr2=0x55c689851760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689854680 0x55c689851760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 -- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 msgr2=0x55c689851220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689851220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 -- 172.21.15.22:0/1343304490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6895203c0 con 0x55c6898494a0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca2bfff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689851220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca33fff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca2402a9a0 tx=0x7fca240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551639fb7819d313 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.130+0000 7fca137fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24053060 con 0x55c6898494a0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca24005540 con 0x55c6898494a0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fca24004390 con 0x55c6898494a0 2024-09-11T22:29:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca24035050 con 0x55c6898494a0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 10 client.15240 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c689862bc0 con 0x55c6898494a0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca24005540 con 0x55c6898494a0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca240318e0 con 0x55c6898494a0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 10 client.15240 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 10 client.15240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 20 client.15240 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c6898640c0 0x55c689866530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 4 client.15240 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.131+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6897bc850 con 0x55c6898640c0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.132+0000 7fca2bfff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c6898640c0 0x55c689866530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.132+0000 7fca2bfff640 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c6898640c0 0x55c689866530 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845095eefc06f75a server_cookie=9c466d9436711645 in_seq=0 out_seq=0 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.132+0000 7fca137fe640 10 client.15240 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca137fe640 1 -- 172.21.15.22:0/1343304490 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6897bc850 con 0x55c6898640c0 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca137fe640 10 client.15240 handle_command_reply: tid=0 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 client.15240 shutdown 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 msgr2=0x55c689853f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca2402a9a0 tx=0x7fca240048f0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 shutdown_connections 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c6898640c0 0x55c689866530 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689854680 0x55c689851760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689851220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/1343304490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c689853f70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 >> 172.21.15.22:0/1343304490 conn(0x55c689845a30 msgr2=0x55c68984b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca137fe640 0 client.15240 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 shutdown_connections 2024-09-11T22:29:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 1 -- 172.21.15.22:0/1343304490 wait complete. 2024-09-11T22:29:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.133+0000 7fca3c7ea740 20 client.15240 trim_cache size 0 max 16384 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 Processor -- start 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 -- start start 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689845a30 0x55c689844a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c68986c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca341a96f0 con 0x55c6898494a0 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fca341abf70 con 0x55c689845a30 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca341a9d60 con 0x55c689849dc0 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56188/0 (socket says 172.21.15.22:56188) 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 -- 172.21.15.22:0/2993614284 learned_addr learned my addr 172.21.15.22:0/2993614284 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca33fff640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689845a30 0x55c689844a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca389ae640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c68986c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 -- 172.21.15.22:0/2993614284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 msgr2=0x55c68986c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c68986c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 -- 172.21.15.22:0/2993614284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689845a30 msgr2=0x55c689844a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689845a30 0x55c689844a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca2bfff640 1 -- 172.21.15.22:0/2993614284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c689845860 con 0x55c6898494a0 2024-09-11T22:29:11.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.151+0000 7fca389ae640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c68986c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:11.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:11 smithi022 ceph-mon[30966]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.152+0000 7fca2bfff640 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c6a0 tx=0x7fca1c018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54d5d295f0ca631 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.152+0000 7fca29ffb640 1 -- 172.21.15.22:0/2993614284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c010ae0 con 0x55c6898494a0 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.152+0000 7fca29ffb640 1 -- 172.21.15.22:0/2993614284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca1c010c80 con 0x55c6898494a0 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.152+0000 7fca29ffb640 1 -- 172.21.15.22:0/2993614284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c097ac0 con 0x55c6898494a0 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- 172.21.15.22:0/2993614284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 msgr2=0x55c68986bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c6a0 tx=0x7fca1c018f90 comp rx=0 tx=0).stop 2024-09-11T22:29:11.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- 172.21.15.22:0/2993614284 shutdown_connections 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c689849dc0 0x55c68986c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c6898494a0 0x55c68986bda0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/2993614284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689845a30 0x55c689844a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- 172.21.15.22:0/2993614284 >> 172.21.15.22:0/2993614284 conn(0x55c6898518c0 msgr2=0x55c689844350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- 172.21.15.22:0/2993614284 shutdown_connections 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- 172.21.15.22:0/2993614284 wait complete. 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.153+0000 7fca3c7ea740 1 -- start start 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 Processor -- start 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c6898494a0 0x55c689859a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689859f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca341aa430 con 0x55c689845a30 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fca341ab8a0 con 0x55c689849dc0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca341aab00 con 0x55c6898494a0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca3c7ea740 10 client.0 _ll_register_callbacks cb 0x7fca2c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56194/0 (socket says 172.21.15.22:56194) 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca33fff640 1 -- 172.21.15.22:0/119919289 learned_addr learned my addr 172.21.15.22:0/119919289 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca389ae640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689859f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.154+0000 7fca33fff640 1 -- 172.21.15.22:0/119919289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c6898494a0 msgr2=0x55c689859a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca2bfff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c6898494a0 0x55c689859a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca33fff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c6898494a0 0x55c689859a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca33fff640 1 -- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 msgr2=0x55c689859f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:11.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca33fff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689859f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca33fff640 1 -- 172.21.15.22:0/119919289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6898cced0 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca33fff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca24005c40 tx=0x7fca240058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6707501f861ef988 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca137fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24053070 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c010c80 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fca24004390 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca24066050 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca3c7ea740 10 client.15246 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.155+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c6898ce110 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca24009520 con 0x55c689845a30 2024-09-11T22:29:11.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fca2405f060 con 0x55c689845a30 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 10 client.15246 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 10 client.15246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 20 client.15246 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c689854680 0x55c6898d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 4 client.15246 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fca1c010c80 con 0x55c689854680 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.156+0000 7fca2bfff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c689854680 0x55c6898d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca2bfff640 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c689854680 0x55c6898d08c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52afca8bdb778be2 server_cookie=171217c26d63bf0a in_seq=0 out_seq=0 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca137fe640 10 client.15246 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca137fe640 1 -- 172.21.15.22:0/119919289 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fca1c010c80 con 0x55c689854680 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca137fe640 10 client.15246 handle_command_reply: tid=0 2024-09-11T22:29:11.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 client.15246 shutdown 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 msgr2=0x55c6898594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca24005c40 tx=0x7fca240058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 shutdown_connections 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55c689854680 0x55c6898d08c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c689849dc0 0x55c689859f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c6898494a0 0x55c689859a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 --2- 172.21.15.22:0/119919289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c689845a30 0x55c6898594e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 >> 172.21.15.22:0/119919289 conn(0x55c6898518c0 msgr2=0x55c689844350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca137fe640 0 client.15246 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 shutdown_connections 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.157+0000 7fca3c7ea740 1 -- 172.21.15.22:0/119919289 wait complete. 2024-09-11T22:29:11.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3c7ea740 20 client.15246 trim_cache size 0 max 16384 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "009f23ef-b6a6-4ba1-8b04-b1dc93d72deb": { 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "009f23ef-b6a6-4ba1-8b04-b1dc93d72deb", 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:11.165 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 msgr2=0x7fca200a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 0x7fca200a52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005fd0 tx=0x7fca2c009500 comp rx=0 tx=0).stop 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 msgr2=0x7fca34199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e9f0 tx=0x7fca1c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 shutdown_connections 2024-09-11T22:29:11.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca200a2e00 0x7fca200a52c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca34102ef0 0x7fca341a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca34102570 0x7fca34199930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 --2- 172.21.15.22:0/2308448165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca34100e20 0x7fca341993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 >> 172.21.15.22:0/2308448165 conn(0x7fca340fc7d0 msgr2=0x7fca340fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.158+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 shutdown_connections 2024-09-11T22:29:11.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.159+0000 7fca3a411640 1 -- 172.21.15.22:0/2308448165 wait complete. 2024-09-11T22:29:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.315+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7aec103d90 con 0x7f7ad80a2ec0 2024-09-11T22:29:11.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.322+0000 7f7ae8ff9640 1 -- 172.21.15.22:0/3746838538 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7aec103d90 con 0x7f7ad80a2ec0 2024-09-11T22:29:11.323 INFO:teuthology.orchestra.run.smithi022.stdout:/ 1m 6m3h 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 msgr2=0x7f7ad80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 0x7f7ad80a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006010 tx=0x7f7adc005e80 comp rx=0 tx=0).stop 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 msgr2=0x7f7aec19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400cce0 tx=0x7f7ae400a620 comp rx=0 tx=0).stop 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 shutdown_connections 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7ad80a2ec0 0x7f7ad80a5380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7aec1069c0 0x7f7aec19bb90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aec101350 0x7f7aec197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 --2- 172.21.15.22:0/3746838538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aec1009b0 0x7f7aec1972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:11.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 >> 172.21.15.22:0/3746838538 conn(0x7f7aec077990 msgr2=0x7f7aec103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:11.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 shutdown_connections 2024-09-11T22:29:11.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:11.324+0000 7f7af20e4640 1 -- 172.21.15.22:0/3746838538 wait complete. 2024-09-11T22:29:11.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-11T22:29:11.364 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-11T22:29:11.379 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-11T22:29:11.392 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:29:11.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-11T22:29:11.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:11 smithi169 ceph-mon[35628]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:11.406 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-11T22:29:11.422 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:29:11.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:29:11.423 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:11 smithi045 ceph-mon[35556]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:11.915 INFO:tasks.cephfs.filesystem:scrub status for tag:009f23ef-b6a6-4ba1-8b04-b1dc93d72deb - {'path': '/', 'tag': '009f23ef-b6a6-4ba1-8b04-b1dc93d72deb', 'options': 'recursive,force'} 2024-09-11T22:29:12.010 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:12.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:12 smithi022 ceph-mon[30966]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-11T22:29:12.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:12 smithi022 ceph-mon[30966]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:12 smithi022 ceph-mon[30966]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:12 smithi169 ceph-mon[35628]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-11T22:29:12.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:12 smithi169 ceph-mon[35628]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:12 smithi169 ceph-mon[35628]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:12 smithi045 ceph-mon[35556]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-11T22:29:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:12 smithi045 ceph-mon[35556]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:12 smithi045 ceph-mon[35556]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:12.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 -- 172.21.15.22:0/2148560244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 msgr2=0x7f4594106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2148560244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f4594106e60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4584009930 tx=0x7f458402a420 comp rx=0 tx=0).stop 2024-09-11T22:29:12.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 -- 172.21.15.22:0/2148560244 shutdown_connections 2024-09-11T22:29:12.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2148560244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594101420 0x7f459410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2148560244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594100a80 0x7f4594100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2148560244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f4594106e60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 -- 172.21.15.22:0/2148560244 >> 172.21.15.22:0/2148560244 conn(0x7f45940fc7a0 msgr2=0x7f45940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 -- 172.21.15.22:0/2148560244 shutdown_connections 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 -- 172.21.15.22:0/2148560244 wait complete. 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.481+0000 7f459a5ea640 1 Processor -- start 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 -- start start 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594100a80 0x7f45941985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 0x7f4594198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4594110fa0 con 0x7f4594106a80 2024-09-11T22:29:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4594110e20 con 0x7f4594100a80 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f459a5ea640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4594111120 con 0x7f4594101420 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56210/0 (socket says 172.21.15.22:56210) 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 -- 172.21.15.22:0/2338565406 learned_addr learned my addr 172.21.15.22:0/2338565406 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4593fff640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594100a80 0x7f45941985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f45937fe640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 0x7f4594198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 -- 172.21.15.22:0/2338565406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 msgr2=0x7f4594198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 0x7f4594198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 -- 172.21.15.22:0/2338565406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594100a80 msgr2=0x7f45941985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594100a80 0x7f45941985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f4598b87640 1 -- 172.21.15.22:0/2338565406 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459419d560 con 0x7f4594106a80 2024-09-11T22:29:12.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.482+0000 7f45937fe640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 0x7f4594198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f4598b87640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f458c00eaa0 tx=0x7f458c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c00cdb0 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f458c004b20 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459419d850 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c011760 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.483+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45941a5130 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.484+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4594100ee0 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.485+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f458c004cd0 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.486+0000 7f45917fa640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 0x7f457c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.486+0000 7f4593fff640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 0x7f457c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.486+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f458c0cf7b0 con 0x7f4594106a80 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.486+0000 7f4593fff640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 0x7f457c0a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4584009900 tx=0x7f45840058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:12.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.490+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f458c016030 con 0x7f4594106a80 2024-09-11T22:29:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.664+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4594062630 con 0x7f457c0a2d80 2024-09-11T22:29:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.671+0000 7f45917fa640 1 -- 172.21.15.22:0/2338565406 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257658 (secure 0 0 0) 0x7f4594062630 con 0x7f457c0a2d80 2024-09-11T22:29:12.674 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 msgr2=0x7f457c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 0x7f457c0a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4584009900 tx=0x7f45840058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 msgr2=0x7f459419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f458c00eaa0 tx=0x7f458c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 shutdown_connections 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f457c0a2d80 0x7f457c0a5240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4594106a80 0x7f459419ce80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4594101420 0x7f4594198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 --2- 172.21.15.22:0/2338565406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4594100a80 0x7f45941985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 >> 172.21.15.22:0/2338565406 conn(0x7f45940fc7a0 msgr2=0x7f459406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 shutdown_connections 2024-09-11T22:29:12.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:12.674+0000 7f459a5ea640 1 -- 172.21.15.22:0/2338565406 wait complete. 2024-09-11T22:29:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:13 smithi022 ceph-mon[30966]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:13.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:13 smithi169 ceph-mon[35628]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:13.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:13 smithi045 ceph-mon[35556]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:13.477 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-11T22:29:12.342103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185751,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":541,"num_read_kb":586,"num_write":407,"num_write_kb":4346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":800,"ondisk_log_size":800,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396724,"kb_used_data":14160,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545100,"statfs":{"total":1151940427776,"available":1151534182400,"internally_reserved":0,"allocated":14499840,"data_stored":8867181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":216,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.995566"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":263,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:08.095873+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:08.095873+0000","last_peered":"2024-09-11T22:29:08.095873+0000","last_clean":"2024-09-11T22:29:08.095873+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:08.095873+0000","last_undegraded":"2024-09-11T22:29:08.095873+0000","last_fullsized":"2024-09-11T22:29:08.095873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":206,"num_read_kb":171,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'39","reported_seq":71,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.564707+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:02.564707+0000","last_peered":"2024-09-11T22:29:02.564707+0000","last_clean":"2024-09-11T22:29:02.564707+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:02.564707+0000","last_undegraded":"2024-09-11T22:29:02.564707+0000","last_fullsized":"2024-09-11T22:29:02.564707+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":391,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:04.428212+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:04.428212+0000","last_peered":"2024-09-11T22:29:04.428212+0000","last_clean":"2024-09-11T22:29:04.428212+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:04.428212+0000","last_undegraded":"2024-09-11T22:29:04.428212+0000","last_fullsized":"2024-09-11T22:29:04.428212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'47","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.570828+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:02.570828+0000","last_peered":"2024-09-11T22:29:02.570828+0000","last_clean":"2024-09-11T22:29:02.570828+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:02.570828+0000","last_undegraded":"2024-09-11T22:29:02.570828+0000","last_fullsized":"2024-09-11T22:29:02.570828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325913+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325913+0000","last_peered":"2024-09-11T22:29:02.325913+0000","last_clean":"2024-09-11T22:29:02.325913+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325913+0000","last_undegraded":"2024-09-11T22:29:02.325913+0000","last_fullsized":"2024-09-11T22:29:02.325913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595149,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":304,"num_read_kb":256,"num_write":204,"num_write_kb":1406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1880064,"data_stored":1785447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":442494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41188,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703964,"statfs":{"total":95995035648,"available":95952859136,"internally_reserved":0,"allocated":1724416,"data_stored":1234308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704376,"statfs":{"total":95995035648,"available":95953281024,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712696,"statfs":{"total":95995035648,"available":95961800704,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1033561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32792,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712360,"statfs":{"total":95995035648,"available":95961456640,"internally_reserved":0,"allocated":1646592,"data_stored":1164761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":967648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":512611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":201329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:13.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:29:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:14.328 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:14 smithi022 ceph-mon[30966]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-11T22:29:14.328 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:14 smithi022 ceph-mon[30966]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:14.328 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:14 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:29:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:14 smithi169 ceph-mon[35628]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-11T22:29:14.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:14 smithi169 ceph-mon[35628]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:14.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:14 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:29:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:14 smithi045 ceph-mon[35556]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-11T22:29:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:14 smithi045 ceph-mon[35556]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:14.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:14 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:29:14.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 -- 172.21.15.22:0/1221055208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 msgr2=0x7ff3a4105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 --2- 172.21.15.22:0/1221055208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a4105e70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff394009900 tx=0x7ff39402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 -- 172.21.15.22:0/1221055208 shutdown_connections 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 --2- 172.21.15.22:0/1221055208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 0x7ff3a410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 --2- 172.21.15.22:0/1221055208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 0x7ff3a4101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 --2- 172.21.15.22:0/1221055208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a4105e70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.698+0000 7ff3a9358640 1 -- 172.21.15.22:0/1221055208 >> 172.21.15.22:0/1221055208 conn(0x7ff3a4077210 msgr2=0x7ff3a40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- 172.21.15.22:0/1221055208 shutdown_connections 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- 172.21.15.22:0/1221055208 wait complete. 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 Processor -- start 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- start start 2024-09-11T22:29:14.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 0x7ff3a4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 0x7ff3a4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4111090 con 0x7ff3a4105a90 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4110f10 con 0x7ff3a4101bc0 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.699+0000 7ff3a9358640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4111210 con 0x7ff3a4101240 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36730/0 (socket says 172.21.15.22:36730) 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff39bfff640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 0x7ff3a4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 -- 172.21.15.22:0/4085358106 learned_addr learned my addr 172.21.15.22:0/4085358106 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a2ffd640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 0x7ff3a4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 -- 172.21.15.22:0/4085358106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 msgr2=0x7ff3a4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 0x7ff3a4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 -- 172.21.15.22:0/4085358106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 msgr2=0x7ff3a4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 0x7ff3a4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 -- 172.21.15.22:0/4085358106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a419d510 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a37fe640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00eb10 tx=0x7ff39c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c004b20 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a419d800 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff39c004cc0 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0107f0 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.700+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a41a50e0 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.701+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a4101680 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.703+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7ff39c005020 con 0x7ff3a4105a90 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.703+0000 7ff3a0ff9640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 0x7ff3900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.703+0000 7ff3a2ffd640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 0x7ff3900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:14.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.703+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff39c0cfb30 con 0x7ff3a4105a90 2024-09-11T22:29:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.704+0000 7ff3a2ffd640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 0x7ff3900a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff394009230 tx=0x7ff3940058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:14.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.707+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff39c09c630 con 0x7ff3a4105a90 2024-09-11T22:29:14.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.881+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3a410a030 con 0x7ff3900a2d80 2024-09-11T22:29:14.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.887+0000 7ff3a0ff9640 1 -- 172.21.15.22:0/4085358106 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257677 (secure 0 0 0) 0x7ff394031760 con 0x7ff3900a2d80 2024-09-11T22:29:14.888 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:14.891 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.891+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 msgr2=0x7ff3900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.891+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 0x7ff3900a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff394009230 tx=0x7ff3940058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.891+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 msgr2=0x7ff3a419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.891+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00eb10 tx=0x7ff39c00c2d0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 shutdown_connections 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff3900a2d80 0x7ff3900a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3a4105a90 0x7ff3a419ce30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3a4101bc0 0x7ff3a4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 --2- 172.21.15.22:0/4085358106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a4101240 0x7ff3a4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 >> 172.21.15.22:0/4085358106 conn(0x7ff3a4077210 msgr2=0x7ff3a4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 shutdown_connections 2024-09-11T22:29:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:14.892+0000 7ff3a9358640 1 -- 172.21.15.22:0/4085358106 wait complete. 2024-09-11T22:29:15.651 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-11T22:29:14.342452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":806,"num_read_kb":823,"num_write":533,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":879,"ondisk_log_size":879,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397652,"kb_used_data":14736,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544172,"statfs":{"total":1151940427776,"available":1151533232128,"internally_reserved":0,"allocated":15089664,"data_stored":9457077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":453,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.995914"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.102669+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:13.102669+0000","last_peered":"2024-09-11T22:29:13.102669+0000","last_clean":"2024-09-11T22:29:13.102669+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:13.102669+0000","last_undegraded":"2024-09-11T22:29:13.102669+0000","last_fullsized":"2024-09-11T22:29:13.102669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":217,"num_read_kb":177,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'65","reported_seq":120,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:10.932899+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:10.932899+0000","last_peered":"2024-09-11T22:29:10.932899+0000","last_clean":"2024-09-11T22:29:10.932899+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:10.932899+0000","last_undegraded":"2024-09-11T22:29:10.932899+0000","last_fullsized":"2024-09-11T22:29:10.932899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":391,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:04.428212+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:04.428212+0000","last_peered":"2024-09-11T22:29:04.428212+0000","last_clean":"2024-09-11T22:29:04.428212+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:04.428212+0000","last_undegraded":"2024-09-11T22:29:04.428212+0000","last_fullsized":"2024-09-11T22:29:04.428212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'100","reported_seq":216,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:11.321189+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:11.321189+0000","last_peered":"2024-09-11T22:29:11.321189+0000","last_clean":"2024-09-11T22:29:11.321189+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:11.321189+0000","last_undegraded":"2024-09-11T22:29:11.321189+0000","last_fullsized":"2024-09-11T22:29:11.321189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":184,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325965+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325965+0000","last_peered":"2024-09-11T22:29:02.325965+0000","last_clean":"2024-09-11T22:29:02.325965+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325965+0000","last_undegraded":"2024-09-11T22:29:02.325965+0000","last_fullsized":"2024-09-11T22:29:02.325965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":569,"num_read_kb":493,"num_write":330,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2469888,"data_stored":2375343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":442494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41500,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703652,"statfs":{"total":95995035648,"available":95952539648,"internally_reserved":0,"allocated":1921024,"data_stored":1430940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939693,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40772,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704380,"statfs":{"total":95995035648,"available":95953285120,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712700,"statfs":{"total":95995035648,"available":95961804800,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1033561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33104,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712048,"statfs":{"total":95995035648,"available":95961137152,"internally_reserved":0,"allocated":1843200,"data_stored":1361393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28748,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716404,"statfs":{"total":95995035648,"available":95965597696,"internally_reserved":0,"allocated":1642496,"data_stored":1164280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":512611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733184,"data_stored":721552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":328414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":397961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:15.655 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:29:15.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:29:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:16.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:16 smithi022 ceph-mon[30966]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-11T22:29:16.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:16 smithi022 ceph-mon[30966]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:16.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:16 smithi169 ceph-mon[35628]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-11T22:29:16.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:16 smithi169 ceph-mon[35628]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:16.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:16 smithi045 ceph-mon[35556]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 47 op/s 2024-09-11T22:29:16.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:16 smithi045 ceph-mon[35556]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:16.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.472+0000 7f42fe903640 1 -- 172.21.15.22:0/2328727424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f8103660 msgr2=0x7f42f810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.472+0000 7f42fe903640 1 --2- 172.21.15.22:0/2328727424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f8103660 0x7f42f810bb50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009900 tx=0x7f42ec02a480 comp rx=0 tx=0).stop 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 -- 172.21.15.22:0/2328727424 shutdown_connections 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 --2- 172.21.15.22:0/2328727424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f810c170 0x7f42f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 --2- 172.21.15.22:0/2328727424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f8103660 0x7f42f810bb50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 --2- 172.21.15.22:0/2328727424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 0x7f42f8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 -- 172.21.15.22:0/2328727424 >> 172.21.15.22:0/2328727424 conn(0x7f42f80fc7a0 msgr2=0x7f42f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 -- 172.21.15.22:0/2328727424 shutdown_connections 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 -- 172.21.15.22:0/2328727424 wait complete. 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 Processor -- start 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.473+0000 7f42fe903640 1 -- start start 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 0x7f42f8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 0x7f42f8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8112090 con 0x7f42f810c170 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8111f10 con 0x7f42f8102d40 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fe903640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8112210 con 0x7f42f8103660 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36754/0 (socket says 172.21.15.22:36754) 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 -- 172.21.15.22:0/91836896 learned_addr learned my addr 172.21.15.22:0/91836896 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42f7fff640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 0x7f42f8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42f77fe640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 0x7f42f8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 -- 172.21.15.22:0/91836896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 msgr2=0x7f42f8198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 0x7f42f8198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 -- 172.21.15.22:0/91836896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 msgr2=0x7f42f8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 0x7f42f8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 -- 172.21.15.22:0/91836896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f819d540 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42f77fe640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 0x7f42f8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42fcea0640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42f000eaa0 tx=0x7f42f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.474+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f000cdb0 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.475+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f0004b20 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.475+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f819d830 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.475+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011760 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.475+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f81a5110 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.476+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f8103120 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.477+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f42f0011900 con 0x7f42f810c170 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.478+0000 7f42f57fa640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 0x7f42e00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.478+0000 7f42f7fff640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 0x7f42e00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.478+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f42f00cfb50 con 0x7f42f810c170 2024-09-11T22:29:16.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.478+0000 7f42f7fff640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 0x7f42e00a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009bd0 tx=0x7f42e8005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:16.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.481+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42f0016030 con 0x7f42f810c170 2024-09-11T22:29:16.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.652+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42f8062630 con 0x7f42e00a2d80 2024-09-11T22:29:16.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.658+0000 7f42f57fa640 1 -- 172.21.15.22:0/91836896 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257678 (secure 0 0 0) 0x7f42f8062630 con 0x7f42e00a2d80 2024-09-11T22:29:16.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:16.663 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-11T22:29:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 msgr2=0x7f42e00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 0x7f42e00a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009bd0 tx=0x7f42e8005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 msgr2=0x7f42f819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42f000eaa0 tx=0x7f42f000ef60 comp rx=0 tx=0).stop 2024-09-11T22:29:16.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 shutdown_connections 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42e00a2d80 0x7f42e00a5240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f810c170 0x7f42f819ce60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42f8103660 0x7f42f8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 --2- 172.21.15.22:0/91836896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42f8102d40 0x7f42f8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 >> 172.21.15.22:0/91836896 conn(0x7f42f80fc7a0 msgr2=0x7f42f80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 shutdown_connections 2024-09-11T22:29:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:16.661+0000 7f42fe903640 1 -- 172.21.15.22:0/91836896 wait complete. 2024-09-11T22:29:17.412 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-11T22:29:16.343105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382383,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":806,"num_read_kb":823,"num_write":533,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":879,"ondisk_log_size":879,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":397652,"kb_used_data":14736,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544172,"statfs":{"total":1151940427776,"available":1151533232128,"internally_reserved":0,"allocated":15089664,"data_stored":9457077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":391492922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":453,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002858"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931224+0000","last_change":"2024-09-11T22:27:23.814723+0000","last_active":"2024-09-11T22:29:02.931224+0000","last_peered":"2024-09-11T22:29:02.931224+0000","last_clean":"2024-09-11T22:29:02.931224+0000","last_became_active":"2024-09-11T22:27:23.814369+0000","last_became_peered":"2024-09-11T22:27:23.814369+0000","last_unstale":"2024-09-11T22:29:02.931224+0000","last_undegraded":"2024-09-11T22:29:02.931224+0000","last_fullsized":"2024-09-11T22:29:02.931224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:02.901828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932233+0000","last_change":"2024-09-11T22:27:23.810823+0000","last_active":"2024-09-11T22:29:02.932233+0000","last_peered":"2024-09-11T22:29:02.932233+0000","last_clean":"2024-09-11T22:29:02.932233+0000","last_became_active":"2024-09-11T22:27:23.810386+0000","last_became_peered":"2024-09-11T22:27:23.810386+0000","last_unstale":"2024-09-11T22:29:02.932233+0000","last_undegraded":"2024-09-11T22:29:02.932233+0000","last_fullsized":"2024-09-11T22:29:02.932233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:31.614794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931954+0000","last_change":"2024-09-11T22:27:23.811891+0000","last_active":"2024-09-11T22:29:02.931954+0000","last_peered":"2024-09-11T22:29:02.931954+0000","last_clean":"2024-09-11T22:29:02.931954+0000","last_became_active":"2024-09-11T22:27:23.811587+0000","last_became_peered":"2024-09-11T22:27:23.811587+0000","last_unstale":"2024-09-11T22:29:02.931954+0000","last_undegraded":"2024-09-11T22:29:02.931954+0000","last_fullsized":"2024-09-11T22:29:02.931954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:27.670257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494176+0000","last_change":"2024-09-11T22:27:23.817567+0000","last_active":"2024-09-11T22:29:02.494176+0000","last_peered":"2024-09-11T22:29:02.494176+0000","last_clean":"2024-09-11T22:29:02.494176+0000","last_became_active":"2024-09-11T22:27:23.817187+0000","last_became_peered":"2024-09-11T22:27:23.817187+0000","last_unstale":"2024-09-11T22:29:02.494176+0000","last_undegraded":"2024-09-11T22:29:02.494176+0000","last_fullsized":"2024-09-11T22:29:02.494176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:07.472576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420277+0000","last_change":"2024-09-11T22:27:23.820742+0000","last_active":"2024-09-11T22:29:02.420277+0000","last_peered":"2024-09-11T22:29:02.420277+0000","last_clean":"2024-09-11T22:29:02.420277+0000","last_became_active":"2024-09-11T22:27:23.820350+0000","last_became_peered":"2024-09-11T22:27:23.820350+0000","last_unstale":"2024-09-11T22:29:02.420277+0000","last_undegraded":"2024-09-11T22:29:02.420277+0000","last_fullsized":"2024-09-11T22:29:02.420277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:04.109257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431069+0000","last_change":"2024-09-11T22:27:23.809854+0000","last_active":"2024-09-11T22:29:02.431069+0000","last_peered":"2024-09-11T22:29:02.431069+0000","last_clean":"2024-09-11T22:29:02.431069+0000","last_became_active":"2024-09-11T22:27:23.809514+0000","last_became_peered":"2024-09-11T22:27:23.809514+0000","last_unstale":"2024-09-11T22:29:02.431069+0000","last_undegraded":"2024-09-11T22:29:02.431069+0000","last_fullsized":"2024-09-11T22:29:02.431069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:27.006611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578366+0000","last_change":"2024-09-11T22:27:23.815863+0000","last_active":"2024-09-11T22:29:02.578366+0000","last_peered":"2024-09-11T22:29:02.578366+0000","last_clean":"2024-09-11T22:29:02.578366+0000","last_became_active":"2024-09-11T22:27:23.815253+0000","last_became_peered":"2024-09-11T22:27:23.815253+0000","last_unstale":"2024-09-11T22:29:02.578366+0000","last_undegraded":"2024-09-11T22:29:02.578366+0000","last_fullsized":"2024-09-11T22:29:02.578366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:52.506228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420626+0000","last_change":"2024-09-11T22:27:23.816846+0000","last_active":"2024-09-11T22:29:02.420626+0000","last_peered":"2024-09-11T22:29:02.420626+0000","last_clean":"2024-09-11T22:29:02.420626+0000","last_became_active":"2024-09-11T22:27:23.816124+0000","last_became_peered":"2024-09-11T22:27:23.816124+0000","last_unstale":"2024-09-11T22:29:02.420626+0000","last_undegraded":"2024-09-11T22:29:02.420626+0000","last_fullsized":"2024-09-11T22:29:02.420626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.670707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327889+0000","last_change":"2024-09-11T22:27:23.813156+0000","last_active":"2024-09-11T22:29:02.327889+0000","last_peered":"2024-09-11T22:29:02.327889+0000","last_clean":"2024-09-11T22:29:02.327889+0000","last_became_active":"2024-09-11T22:27:23.812815+0000","last_became_peered":"2024-09-11T22:27:23.812815+0000","last_unstale":"2024-09-11T22:29:02.327889+0000","last_undegraded":"2024-09-11T22:29:02.327889+0000","last_fullsized":"2024-09-11T22:29:02.327889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.665782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431427+0000","last_change":"2024-09-11T22:27:23.811239+0000","last_active":"2024-09-11T22:29:02.431427+0000","last_peered":"2024-09-11T22:29:02.431427+0000","last_clean":"2024-09-11T22:29:02.431427+0000","last_became_active":"2024-09-11T22:27:23.810858+0000","last_became_peered":"2024-09-11T22:27:23.810858+0000","last_unstale":"2024-09-11T22:29:02.431427+0000","last_undegraded":"2024-09-11T22:29:02.431427+0000","last_fullsized":"2024-09-11T22:29:02.431427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:36.277488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578680+0000","last_change":"2024-09-11T22:27:23.824602+0000","last_active":"2024-09-11T22:29:02.578680+0000","last_peered":"2024-09-11T22:29:02.578680+0000","last_clean":"2024-09-11T22:29:02.578680+0000","last_became_active":"2024-09-11T22:27:23.824203+0000","last_became_peered":"2024-09-11T22:27:23.824203+0000","last_unstale":"2024-09-11T22:29:02.578680+0000","last_undegraded":"2024-09-11T22:29:02.578680+0000","last_fullsized":"2024-09-11T22:29:02.578680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:52.186572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494259+0000","last_change":"2024-09-11T22:27:23.810949+0000","last_active":"2024-09-11T22:29:02.494259+0000","last_peered":"2024-09-11T22:29:02.494259+0000","last_clean":"2024-09-11T22:29:02.494259+0000","last_became_active":"2024-09-11T22:27:23.810601+0000","last_became_peered":"2024-09-11T22:27:23.810601+0000","last_unstale":"2024-09-11T22:29:02.494259+0000","last_undegraded":"2024-09-11T22:29:02.494259+0000","last_fullsized":"2024-09-11T22:29:02.494259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:11.579782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931999+0000","last_change":"2024-09-11T22:28:28.039557+0000","last_active":"2024-09-11T22:29:02.931999+0000","last_peered":"2024-09-11T22:29:02.931999+0000","last_clean":"2024-09-11T22:29:02.931999+0000","last_became_active":"2024-09-11T22:28:28.038893+0000","last_became_peered":"2024-09-11T22:28:28.038893+0000","last_unstale":"2024-09-11T22:29:02.931999+0000","last_undegraded":"2024-09-11T22:29:02.931999+0000","last_fullsized":"2024-09-11T22:29:02.931999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:39.460229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930866+0000","last_change":"2024-09-11T22:27:23.811226+0000","last_active":"2024-09-11T22:29:02.930866+0000","last_peered":"2024-09-11T22:29:02.930866+0000","last_clean":"2024-09-11T22:29:02.930866+0000","last_became_active":"2024-09-11T22:27:23.810736+0000","last_became_peered":"2024-09-11T22:27:23.810736+0000","last_unstale":"2024-09-11T22:29:02.930866+0000","last_undegraded":"2024-09-11T22:29:02.930866+0000","last_fullsized":"2024-09-11T22:29:02.930866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:58.275655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931188+0000","last_change":"2024-09-11T22:27:23.815381+0000","last_active":"2024-09-11T22:29:02.931188+0000","last_peered":"2024-09-11T22:29:02.931188+0000","last_clean":"2024-09-11T22:29:02.931188+0000","last_became_active":"2024-09-11T22:27:23.814871+0000","last_became_peered":"2024-09-11T22:27:23.814871+0000","last_unstale":"2024-09-11T22:29:02.931188+0000","last_undegraded":"2024-09-11T22:29:02.931188+0000","last_fullsized":"2024-09-11T22:29:02.931188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:46.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326638+0000","last_change":"2024-09-11T22:27:23.821911+0000","last_active":"2024-09-11T22:29:02.326638+0000","last_peered":"2024-09-11T22:29:02.326638+0000","last_clean":"2024-09-11T22:29:02.326638+0000","last_became_active":"2024-09-11T22:27:23.821445+0000","last_became_peered":"2024-09-11T22:27:23.821445+0000","last_unstale":"2024-09-11T22:29:02.326638+0000","last_undegraded":"2024-09-11T22:29:02.326638+0000","last_fullsized":"2024-09-11T22:29:02.326638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.781207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931230+0000","last_change":"2024-09-11T22:27:23.817583+0000","last_active":"2024-09-11T22:29:02.931230+0000","last_peered":"2024-09-11T22:29:02.931230+0000","last_clean":"2024-09-11T22:29:02.931230+0000","last_became_active":"2024-09-11T22:27:23.816815+0000","last_became_peered":"2024-09-11T22:27:23.816815+0000","last_unstale":"2024-09-11T22:29:02.931230+0000","last_undegraded":"2024-09-11T22:29:02.931230+0000","last_fullsized":"2024-09-11T22:29:02.931230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:25.292830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325850+0000","last_change":"2024-09-11T22:27:23.811034+0000","last_active":"2024-09-11T22:29:02.325850+0000","last_peered":"2024-09-11T22:29:02.325850+0000","last_clean":"2024-09-11T22:29:02.325850+0000","last_became_active":"2024-09-11T22:27:23.810748+0000","last_became_peered":"2024-09-11T22:27:23.810748+0000","last_unstale":"2024-09-11T22:29:02.325850+0000","last_undegraded":"2024-09-11T22:29:02.325850+0000","last_fullsized":"2024-09-11T22:29:02.325850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:53.880722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632009+0000","last_change":"2024-09-11T22:27:23.810782+0000","last_active":"2024-09-11T22:29:02.632009+0000","last_peered":"2024-09-11T22:29:02.632009+0000","last_clean":"2024-09-11T22:29:02.632009+0000","last_became_active":"2024-09-11T22:27:23.810421+0000","last_became_peered":"2024-09-11T22:27:23.810421+0000","last_unstale":"2024-09-11T22:29:02.632009+0000","last_undegraded":"2024-09-11T22:29:02.632009+0000","last_fullsized":"2024-09-11T22:29:02.632009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:01.115738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930857+0000","last_change":"2024-09-11T22:27:23.814612+0000","last_active":"2024-09-11T22:29:02.930857+0000","last_peered":"2024-09-11T22:29:02.930857+0000","last_clean":"2024-09-11T22:29:02.930857+0000","last_became_active":"2024-09-11T22:27:23.814272+0000","last_became_peered":"2024-09-11T22:27:23.814272+0000","last_unstale":"2024-09-11T22:29:02.930857+0000","last_undegraded":"2024-09-11T22:29:02.930857+0000","last_fullsized":"2024-09-11T22:29:02.930857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:01.715754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932181+0000","last_change":"2024-09-11T22:27:23.816349+0000","last_active":"2024-09-11T22:29:02.932181+0000","last_peered":"2024-09-11T22:29:02.932181+0000","last_clean":"2024-09-11T22:29:02.932181+0000","last_became_active":"2024-09-11T22:27:23.816004+0000","last_became_peered":"2024-09-11T22:27:23.816004+0000","last_unstale":"2024-09-11T22:29:02.932181+0000","last_undegraded":"2024-09-11T22:29:02.932181+0000","last_fullsized":"2024-09-11T22:29:02.932181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:23.990467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327356+0000","last_change":"2024-09-11T22:27:23.822105+0000","last_active":"2024-09-11T22:29:02.327356+0000","last_peered":"2024-09-11T22:29:02.327356+0000","last_clean":"2024-09-11T22:29:02.327356+0000","last_became_active":"2024-09-11T22:27:23.821495+0000","last_became_peered":"2024-09-11T22:27:23.821495+0000","last_unstale":"2024-09-11T22:29:02.327356+0000","last_undegraded":"2024-09-11T22:29:02.327356+0000","last_fullsized":"2024-09-11T22:29:02.327356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:08:00.612230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420914+0000","last_change":"2024-09-11T22:27:23.811993+0000","last_active":"2024-09-11T22:29:02.420914+0000","last_peered":"2024-09-11T22:29:02.420914+0000","last_clean":"2024-09-11T22:29:02.420914+0000","last_became_active":"2024-09-11T22:27:23.811604+0000","last_became_peered":"2024-09-11T22:27:23.811604+0000","last_unstale":"2024-09-11T22:29:02.420914+0000","last_undegraded":"2024-09-11T22:29:02.420914+0000","last_fullsized":"2024-09-11T22:29:02.420914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:17:36.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326925+0000","last_change":"2024-09-11T22:27:23.812545+0000","last_active":"2024-09-11T22:29:02.326925+0000","last_peered":"2024-09-11T22:29:02.326925+0000","last_clean":"2024-09-11T22:29:02.326925+0000","last_became_active":"2024-09-11T22:27:23.811246+0000","last_became_peered":"2024-09-11T22:27:23.811246+0000","last_unstale":"2024-09-11T22:29:02.326925+0000","last_undegraded":"2024-09-11T22:29:02.326925+0000","last_fullsized":"2024-09-11T22:29:02.326925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:57.169236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421735+0000","last_change":"2024-09-11T22:27:23.814230+0000","last_active":"2024-09-11T22:29:02.421735+0000","last_peered":"2024-09-11T22:29:02.421735+0000","last_clean":"2024-09-11T22:29:02.421735+0000","last_became_active":"2024-09-11T22:27:23.813895+0000","last_became_peered":"2024-09-11T22:27:23.813895+0000","last_unstale":"2024-09-11T22:29:02.421735+0000","last_undegraded":"2024-09-11T22:29:02.421735+0000","last_fullsized":"2024-09-11T22:29:02.421735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:23.524730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632167+0000","last_change":"2024-09-11T22:27:23.811207+0000","last_active":"2024-09-11T22:29:02.632167+0000","last_peered":"2024-09-11T22:29:02.632167+0000","last_clean":"2024-09-11T22:29:02.632167+0000","last_became_active":"2024-09-11T22:27:23.810784+0000","last_became_peered":"2024-09-11T22:27:23.810784+0000","last_unstale":"2024-09-11T22:29:02.632167+0000","last_undegraded":"2024-09-11T22:29:02.632167+0000","last_fullsized":"2024-09-11T22:29:02.632167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:31.474373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931098+0000","last_change":"2024-09-11T22:27:23.816595+0000","last_active":"2024-09-11T22:29:02.931098+0000","last_peered":"2024-09-11T22:29:02.931098+0000","last_clean":"2024-09-11T22:29:02.931098+0000","last_became_active":"2024-09-11T22:27:23.816149+0000","last_became_peered":"2024-09-11T22:27:23.816149+0000","last_unstale":"2024-09-11T22:29:02.931098+0000","last_undegraded":"2024-09-11T22:29:02.931098+0000","last_fullsized":"2024-09-11T22:29:02.931098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:59.220409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930763+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.930763+0000","last_peered":"2024-09-11T22:29:02.930763+0000","last_clean":"2024-09-11T22:29:02.930763+0000","last_became_active":"2024-09-11T22:27:23.809354+0000","last_became_peered":"2024-09-11T22:27:23.809354+0000","last_unstale":"2024-09-11T22:29:02.930763+0000","last_undegraded":"2024-09-11T22:29:02.930763+0000","last_fullsized":"2024-09-11T22:29:02.930763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:07.540375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931604+0000","last_change":"2024-09-11T22:27:23.818059+0000","last_active":"2024-09-11T22:29:02.931604+0000","last_peered":"2024-09-11T22:29:02.931604+0000","last_clean":"2024-09-11T22:29:02.931604+0000","last_became_active":"2024-09-11T22:27:23.817706+0000","last_became_peered":"2024-09-11T22:27:23.817706+0000","last_unstale":"2024-09-11T22:29:02.931604+0000","last_undegraded":"2024-09-11T22:29:02.931604+0000","last_fullsized":"2024-09-11T22:29:02.931604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.773247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631877+0000","last_change":"2024-09-11T22:27:23.810166+0000","last_active":"2024-09-11T22:29:02.631877+0000","last_peered":"2024-09-11T22:29:02.631877+0000","last_clean":"2024-09-11T22:29:02.631877+0000","last_became_active":"2024-09-11T22:27:23.809816+0000","last_became_peered":"2024-09-11T22:27:23.809816+0000","last_unstale":"2024-09-11T22:29:02.631877+0000","last_undegraded":"2024-09-11T22:29:02.631877+0000","last_fullsized":"2024-09-11T22:29:02.631877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:06.163703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.631917+0000","last_change":"2024-09-11T22:27:23.817904+0000","last_active":"2024-09-11T22:29:02.631917+0000","last_peered":"2024-09-11T22:29:02.631917+0000","last_clean":"2024-09-11T22:29:02.631917+0000","last_became_active":"2024-09-11T22:27:23.817574+0000","last_became_peered":"2024-09-11T22:27:23.817574+0000","last_unstale":"2024-09-11T22:29:02.631917+0000","last_undegraded":"2024-09-11T22:29:02.631917+0000","last_fullsized":"2024-09-11T22:29:02.631917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:49.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930900+0000","last_change":"2024-09-11T22:27:23.815046+0000","last_active":"2024-09-11T22:29:02.930900+0000","last_peered":"2024-09-11T22:29:02.930900+0000","last_clean":"2024-09-11T22:29:02.930900+0000","last_became_active":"2024-09-11T22:27:23.814671+0000","last_became_peered":"2024-09-11T22:27:23.814671+0000","last_unstale":"2024-09-11T22:29:02.930900+0000","last_undegraded":"2024-09-11T22:29:02.930900+0000","last_fullsized":"2024-09-11T22:29:02.930900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:27.710417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:23.808773+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:23.808344+0000","last_became_peered":"2024-09-11T22:27:23.808344+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:44.360108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327060+0000","last_change":"2024-09-11T22:28:28.041890+0000","last_active":"2024-09-11T22:29:02.327060+0000","last_peered":"2024-09-11T22:29:02.327060+0000","last_clean":"2024-09-11T22:29:02.327060+0000","last_became_active":"2024-09-11T22:28:28.040761+0000","last_became_peered":"2024-09-11T22:28:28.040761+0000","last_unstale":"2024-09-11T22:29:02.327060+0000","last_undegraded":"2024-09-11T22:29:02.327060+0000","last_fullsized":"2024-09-11T22:29:02.327060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.984745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327153+0000","last_change":"2024-09-11T22:27:23.810120+0000","last_active":"2024-09-11T22:29:02.327153+0000","last_peered":"2024-09-11T22:29:02.327153+0000","last_clean":"2024-09-11T22:29:02.327153+0000","last_became_active":"2024-09-11T22:27:23.809747+0000","last_became_peered":"2024-09-11T22:27:23.809747+0000","last_unstale":"2024-09-11T22:29:02.327153+0000","last_undegraded":"2024-09-11T22:29:02.327153+0000","last_fullsized":"2024-09-11T22:29:02.327153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:05.566649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431136+0000","last_change":"2024-09-11T22:27:21.798301+0000","last_active":"2024-09-11T22:29:02.431136+0000","last_peered":"2024-09-11T22:29:02.431136+0000","last_clean":"2024-09-11T22:29:02.431136+0000","last_became_active":"2024-09-11T22:27:21.797807+0000","last_became_peered":"2024-09-11T22:27:21.797807+0000","last_unstale":"2024-09-11T22:29:02.431136+0000","last_undegraded":"2024-09-11T22:29:02.431136+0000","last_fullsized":"2024-09-11T22:29:02.431136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:36.107679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930957+0000","last_change":"2024-09-11T22:27:21.793123+0000","last_active":"2024-09-11T22:29:02.930957+0000","last_peered":"2024-09-11T22:29:02.930957+0000","last_clean":"2024-09-11T22:29:02.930957+0000","last_became_active":"2024-09-11T22:27:21.792777+0000","last_became_peered":"2024-09-11T22:27:21.792777+0000","last_unstale":"2024-09-11T22:29:02.930957+0000","last_undegraded":"2024-09-11T22:29:02.930957+0000","last_fullsized":"2024-09-11T22:29:02.930957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:18.813727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420724+0000","last_change":"2024-09-11T22:27:23.815705+0000","last_active":"2024-09-11T22:29:02.420724+0000","last_peered":"2024-09-11T22:29:02.420724+0000","last_clean":"2024-09-11T22:29:02.420724+0000","last_became_active":"2024-09-11T22:27:23.815414+0000","last_became_peered":"2024-09-11T22:27:23.815414+0000","last_unstale":"2024-09-11T22:29:02.420724+0000","last_undegraded":"2024-09-11T22:29:02.420724+0000","last_fullsized":"2024-09-11T22:29:02.420724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:57.816522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327296+0000","last_change":"2024-09-11T22:27:21.797662+0000","last_active":"2024-09-11T22:29:02.327296+0000","last_peered":"2024-09-11T22:29:02.327296+0000","last_clean":"2024-09-11T22:29:02.327296+0000","last_became_active":"2024-09-11T22:27:21.796596+0000","last_became_peered":"2024-09-11T22:27:21.796596+0000","last_unstale":"2024-09-11T22:29:02.327296+0000","last_undegraded":"2024-09-11T22:29:02.327296+0000","last_fullsized":"2024-09-11T22:29:02.327296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:12.069447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325557+0000","last_change":"2024-09-11T22:27:23.809686+0000","last_active":"2024-09-11T22:29:02.325557+0000","last_peered":"2024-09-11T22:29:02.325557+0000","last_clean":"2024-09-11T22:29:02.325557+0000","last_became_active":"2024-09-11T22:27:23.809392+0000","last_became_peered":"2024-09-11T22:27:23.809392+0000","last_unstale":"2024-09-11T22:29:02.325557+0000","last_undegraded":"2024-09-11T22:29:02.325557+0000","last_fullsized":"2024-09-11T22:29:02.325557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:18.772481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431331+0000","last_change":"2024-09-11T22:27:21.794401+0000","last_active":"2024-09-11T22:29:02.431331+0000","last_peered":"2024-09-11T22:29:02.431331+0000","last_clean":"2024-09-11T22:29:02.431331+0000","last_became_active":"2024-09-11T22:27:21.794074+0000","last_became_peered":"2024-09-11T22:27:21.794074+0000","last_unstale":"2024-09-11T22:29:02.431331+0000","last_undegraded":"2024-09-11T22:29:02.431331+0000","last_fullsized":"2024-09-11T22:29:02.431331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:52.390384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.328068+0000","last_change":"2024-09-11T22:27:23.809528+0000","last_active":"2024-09-11T22:29:02.328068+0000","last_peered":"2024-09-11T22:29:02.328068+0000","last_clean":"2024-09-11T22:29:02.328068+0000","last_became_active":"2024-09-11T22:27:23.809182+0000","last_became_peered":"2024-09-11T22:27:23.809182+0000","last_unstale":"2024-09-11T22:29:02.328068+0000","last_undegraded":"2024-09-11T22:29:02.328068+0000","last_fullsized":"2024-09-11T22:29:02.328068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:08.619508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578529+0000","last_change":"2024-09-11T22:27:21.800198+0000","last_active":"2024-09-11T22:29:02.578529+0000","last_peered":"2024-09-11T22:29:02.578529+0000","last_clean":"2024-09-11T22:29:02.578529+0000","last_became_active":"2024-09-11T22:27:21.799809+0000","last_became_peered":"2024-09-11T22:27:21.799809+0000","last_unstale":"2024-09-11T22:29:02.578529+0000","last_undegraded":"2024-09-11T22:29:02.578529+0000","last_fullsized":"2024-09-11T22:29:02.578529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:07.223568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932734+0000","last_change":"2024-09-11T22:27:23.812973+0000","last_active":"2024-09-11T22:29:02.932734+0000","last_peered":"2024-09-11T22:29:02.932734+0000","last_clean":"2024-09-11T22:29:02.932734+0000","last_became_active":"2024-09-11T22:27:23.812639+0000","last_became_peered":"2024-09-11T22:27:23.812639+0000","last_unstale":"2024-09-11T22:29:02.932734+0000","last_undegraded":"2024-09-11T22:29:02.932734+0000","last_fullsized":"2024-09-11T22:29:02.932734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:19.226350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327144+0000","last_change":"2024-09-11T22:27:21.998719+0000","last_active":"2024-09-11T22:29:02.327144+0000","last_peered":"2024-09-11T22:29:02.327144+0000","last_clean":"2024-09-11T22:29:02.327144+0000","last_became_active":"2024-09-11T22:27:21.998347+0000","last_became_peered":"2024-09-11T22:27:21.998347+0000","last_unstale":"2024-09-11T22:29:02.327144+0000","last_undegraded":"2024-09-11T22:29:02.327144+0000","last_fullsized":"2024-09-11T22:29:02.327144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:09.939909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327453+0000","last_change":"2024-09-11T22:27:23.814467+0000","last_active":"2024-09-11T22:29:02.327453+0000","last_peered":"2024-09-11T22:29:02.327453+0000","last_clean":"2024-09-11T22:29:02.327453+0000","last_became_active":"2024-09-11T22:27:23.814143+0000","last_became_peered":"2024-09-11T22:27:23.814143+0000","last_unstale":"2024-09-11T22:29:02.327453+0000","last_undegraded":"2024-09-11T22:29:02.327453+0000","last_fullsized":"2024-09-11T22:29:02.327453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.889669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":274,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.102669+0000","last_change":"2024-09-11T22:27:21.803322+0000","last_active":"2024-09-11T22:29:13.102669+0000","last_peered":"2024-09-11T22:29:13.102669+0000","last_clean":"2024-09-11T22:29:13.102669+0000","last_became_active":"2024-09-11T22:27:21.802854+0000","last_became_peered":"2024-09-11T22:27:21.802854+0000","last_unstale":"2024-09-11T22:29:13.102669+0000","last_undegraded":"2024-09-11T22:29:13.102669+0000","last_fullsized":"2024-09-11T22:29:13.102669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:07.936304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69535,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":217,"num_read_kb":177,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420477+0000","last_change":"2024-09-11T22:27:23.820385+0000","last_active":"2024-09-11T22:29:02.420477+0000","last_peered":"2024-09-11T22:29:02.420477+0000","last_clean":"2024-09-11T22:29:02.420477+0000","last_became_active":"2024-09-11T22:27:23.819441+0000","last_became_peered":"2024-09-11T22:27:23.819441+0000","last_unstale":"2024-09-11T22:29:02.420477+0000","last_undegraded":"2024-09-11T22:29:02.420477+0000","last_fullsized":"2024-09-11T22:29:02.420477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:55.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632010+0000","last_change":"2024-09-11T22:27:21.801895+0000","last_active":"2024-09-11T22:29:02.632010+0000","last_peered":"2024-09-11T22:29:02.632010+0000","last_clean":"2024-09-11T22:29:02.632010+0000","last_became_active":"2024-09-11T22:27:21.801539+0000","last_became_peered":"2024-09-11T22:27:21.801539+0000","last_unstale":"2024-09-11T22:29:02.632010+0000","last_undegraded":"2024-09-11T22:29:02.632010+0000","last_fullsized":"2024-09-11T22:29:02.632010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:39.251553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931270+0000","last_change":"2024-09-11T22:27:23.815133+0000","last_active":"2024-09-11T22:29:02.931270+0000","last_peered":"2024-09-11T22:29:02.931270+0000","last_clean":"2024-09-11T22:29:02.931270+0000","last_became_active":"2024-09-11T22:27:23.814805+0000","last_became_peered":"2024-09-11T22:27:23.814805+0000","last_unstale":"2024-09-11T22:29:02.931270+0000","last_undegraded":"2024-09-11T22:29:02.931270+0000","last_fullsized":"2024-09-11T22:29:02.931270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.627893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327088+0000","last_change":"2024-09-11T22:27:21.798600+0000","last_active":"2024-09-11T22:29:02.327088+0000","last_peered":"2024-09-11T22:29:02.327088+0000","last_clean":"2024-09-11T22:29:02.327088+0000","last_became_active":"2024-09-11T22:27:21.797169+0000","last_became_peered":"2024-09-11T22:27:21.797169+0000","last_unstale":"2024-09-11T22:29:02.327088+0000","last_undegraded":"2024-09-11T22:29:02.327088+0000","last_fullsized":"2024-09-11T22:29:02.327088+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.977134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578545+0000","last_change":"2024-09-11T22:28:28.039216+0000","last_active":"2024-09-11T22:29:02.578545+0000","last_peered":"2024-09-11T22:29:02.578545+0000","last_clean":"2024-09-11T22:29:02.578545+0000","last_became_active":"2024-09-11T22:28:28.038697+0000","last_became_peered":"2024-09-11T22:28:28.038697+0000","last_unstale":"2024-09-11T22:29:02.578545+0000","last_undegraded":"2024-09-11T22:29:02.578545+0000","last_fullsized":"2024-09-11T22:29:02.578545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:52.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494164+0000","last_change":"2024-09-11T22:27:21.793845+0000","last_active":"2024-09-11T22:29:02.494164+0000","last_peered":"2024-09-11T22:29:02.494164+0000","last_clean":"2024-09-11T22:29:02.494164+0000","last_became_active":"2024-09-11T22:27:21.793406+0000","last_became_peered":"2024-09-11T22:27:21.793406+0000","last_unstale":"2024-09-11T22:29:02.494164+0000","last_undegraded":"2024-09-11T22:29:02.494164+0000","last_fullsized":"2024-09-11T22:29:02.494164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:31.381613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578317+0000","last_change":"2024-09-11T22:27:23.822430+0000","last_active":"2024-09-11T22:29:02.578317+0000","last_peered":"2024-09-11T22:29:02.578317+0000","last_clean":"2024-09-11T22:29:02.578317+0000","last_became_active":"2024-09-11T22:27:23.822090+0000","last_became_peered":"2024-09-11T22:27:23.822090+0000","last_unstale":"2024-09-11T22:29:02.578317+0000","last_undegraded":"2024-09-11T22:29:02.578317+0000","last_fullsized":"2024-09-11T22:29:02.578317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.632654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420232+0000","last_change":"2024-09-11T22:27:21.998751+0000","last_active":"2024-09-11T22:29:02.420232+0000","last_peered":"2024-09-11T22:29:02.420232+0000","last_clean":"2024-09-11T22:29:02.420232+0000","last_became_active":"2024-09-11T22:27:21.998310+0000","last_became_peered":"2024-09-11T22:27:21.998310+0000","last_unstale":"2024-09-11T22:29:02.420232+0000","last_undegraded":"2024-09-11T22:29:02.420232+0000","last_fullsized":"2024-09-11T22:29:02.420232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:23.130214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326993+0000","last_change":"2024-09-11T22:27:23.810717+0000","last_active":"2024-09-11T22:29:02.326993+0000","last_peered":"2024-09-11T22:29:02.326993+0000","last_clean":"2024-09-11T22:29:02.326993+0000","last_became_active":"2024-09-11T22:27:23.809990+0000","last_became_peered":"2024-09-11T22:27:23.809990+0000","last_unstale":"2024-09-11T22:29:02.326993+0000","last_undegraded":"2024-09-11T22:29:02.326993+0000","last_fullsized":"2024-09-11T22:29:02.326993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:43.150544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420474+0000","last_change":"2024-09-11T22:27:21.801108+0000","last_active":"2024-09-11T22:29:02.420474+0000","last_peered":"2024-09-11T22:29:02.420474+0000","last_clean":"2024-09-11T22:29:02.420474+0000","last_became_active":"2024-09-11T22:27:21.800722+0000","last_became_peered":"2024-09-11T22:27:21.800722+0000","last_unstale":"2024-09-11T22:29:02.420474+0000","last_undegraded":"2024-09-11T22:29:02.420474+0000","last_fullsized":"2024-09-11T22:29:02.420474+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:27.445725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931060+0000","last_change":"2024-09-11T22:27:23.815715+0000","last_active":"2024-09-11T22:29:02.931060+0000","last_peered":"2024-09-11T22:29:02.931060+0000","last_clean":"2024-09-11T22:29:02.931060+0000","last_became_active":"2024-09-11T22:27:23.815324+0000","last_became_peered":"2024-09-11T22:27:23.815324+0000","last_unstale":"2024-09-11T22:29:02.931060+0000","last_undegraded":"2024-09-11T22:29:02.931060+0000","last_fullsized":"2024-09-11T22:29:02.931060+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:53.430879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931657+0000","last_change":"2024-09-11T22:27:21.800036+0000","last_active":"2024-09-11T22:29:02.931657+0000","last_peered":"2024-09-11T22:29:02.931657+0000","last_clean":"2024-09-11T22:29:02.931657+0000","last_became_active":"2024-09-11T22:27:21.799622+0000","last_became_peered":"2024-09-11T22:27:21.799622+0000","last_unstale":"2024-09-11T22:29:02.931657+0000","last_undegraded":"2024-09-11T22:29:02.931657+0000","last_fullsized":"2024-09-11T22:29:02.931657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:35.881519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578569+0000","last_change":"2024-09-11T22:27:23.821670+0000","last_active":"2024-09-11T22:29:02.578569+0000","last_peered":"2024-09-11T22:29:02.578569+0000","last_clean":"2024-09-11T22:29:02.578569+0000","last_became_active":"2024-09-11T22:27:23.821336+0000","last_became_peered":"2024-09-11T22:27:23.821336+0000","last_unstale":"2024-09-11T22:29:02.578569+0000","last_undegraded":"2024-09-11T22:29:02.578569+0000","last_fullsized":"2024-09-11T22:29:02.578569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'65","reported_seq":120,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:10.932899+0000","last_change":"2024-09-11T22:27:21.793961+0000","last_active":"2024-09-11T22:29:10.932899+0000","last_peered":"2024-09-11T22:29:10.932899+0000","last_clean":"2024-09-11T22:29:10.932899+0000","last_became_active":"2024-09-11T22:27:21.793584+0000","last_became_peered":"2024-09-11T22:27:21.793584+0000","last_unstale":"2024-09-11T22:29:10.932899+0000","last_undegraded":"2024-09-11T22:29:10.932899+0000","last_fullsized":"2024-09-11T22:29:10.932899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.876617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578464+0000","last_change":"2024-09-11T22:27:23.818919+0000","last_active":"2024-09-11T22:29:02.578464+0000","last_peered":"2024-09-11T22:29:02.578464+0000","last_clean":"2024-09-11T22:29:02.578464+0000","last_became_active":"2024-09-11T22:27:23.818559+0000","last_became_peered":"2024-09-11T22:27:23.818559+0000","last_unstale":"2024-09-11T22:29:02.578464+0000","last_undegraded":"2024-09-11T22:29:02.578464+0000","last_fullsized":"2024-09-11T22:29:02.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:06.957080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632180+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.632180+0000","last_peered":"2024-09-11T22:29:02.632180+0000","last_clean":"2024-09-11T22:29:02.632180+0000","last_became_active":"2024-09-11T22:27:22.596493+0000","last_became_peered":"2024-09-11T22:27:22.596493+0000","last_unstale":"2024-09-11T22:29:02.632180+0000","last_undegraded":"2024-09-11T22:29:02.632180+0000","last_fullsized":"2024-09-11T22:29:02.632180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:45.003679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578738+0000","last_change":"2024-09-11T22:27:23.820652+0000","last_active":"2024-09-11T22:29:02.578738+0000","last_peered":"2024-09-11T22:29:02.578738+0000","last_clean":"2024-09-11T22:29:02.578738+0000","last_became_active":"2024-09-11T22:27:23.820289+0000","last_became_peered":"2024-09-11T22:27:23.820289+0000","last_unstale":"2024-09-11T22:29:02.578738+0000","last_undegraded":"2024-09-11T22:29:02.578738+0000","last_fullsized":"2024-09-11T22:29:02.578738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:14.832832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":391,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:04.428212+0000","last_change":"2024-09-11T22:26:13.103607+0000","last_active":"2024-09-11T22:29:04.428212+0000","last_peered":"2024-09-11T22:29:04.428212+0000","last_clean":"2024-09-11T22:29:04.428212+0000","last_became_active":"2024-09-11T22:26:13.103166+0000","last_became_peered":"2024-09-11T22:26:13.103166+0000","last_unstale":"2024-09-11T22:29:04.428212+0000","last_undegraded":"2024-09-11T22:29:04.428212+0000","last_fullsized":"2024-09-11T22:29:04.428212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:22:47.048955+0000","last_clean_scrub_stamp":"2024-09-11T22:22:47.048955+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:21.103261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494156+0000","last_change":"2024-09-11T22:27:21.791932+0000","last_active":"2024-09-11T22:29:02.494156+0000","last_peered":"2024-09-11T22:29:02.494156+0000","last_clean":"2024-09-11T22:29:02.494156+0000","last_became_active":"2024-09-11T22:27:21.790678+0000","last_became_peered":"2024-09-11T22:27:21.790678+0000","last_unstale":"2024-09-11T22:29:02.494156+0000","last_undegraded":"2024-09-11T22:29:02.494156+0000","last_fullsized":"2024-09-11T22:29:02.494156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:34.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421328+0000","last_change":"2024-09-11T22:27:23.814912+0000","last_active":"2024-09-11T22:29:02.421328+0000","last_peered":"2024-09-11T22:29:02.421328+0000","last_clean":"2024-09-11T22:29:02.421328+0000","last_became_active":"2024-09-11T22:27:23.814596+0000","last_became_peered":"2024-09-11T22:27:23.814596+0000","last_unstale":"2024-09-11T22:29:02.421328+0000","last_undegraded":"2024-09-11T22:29:02.421328+0000","last_fullsized":"2024-09-11T22:29:02.421328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.731249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578475+0000","last_change":"2024-09-11T22:27:21.797198+0000","last_active":"2024-09-11T22:29:02.578475+0000","last_peered":"2024-09-11T22:29:02.578475+0000","last_clean":"2024-09-11T22:29:02.578475+0000","last_became_active":"2024-09-11T22:27:21.796463+0000","last_became_peered":"2024-09-11T22:27:21.796463+0000","last_unstale":"2024-09-11T22:29:02.578475+0000","last_undegraded":"2024-09-11T22:29:02.578475+0000","last_fullsized":"2024-09-11T22:29:02.578475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:44.434857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930807+0000","last_change":"2024-09-11T22:27:23.810302+0000","last_active":"2024-09-11T22:29:02.930807+0000","last_peered":"2024-09-11T22:29:02.930807+0000","last_clean":"2024-09-11T22:29:02.930807+0000","last_became_active":"2024-09-11T22:27:23.809983+0000","last_became_peered":"2024-09-11T22:27:23.809983+0000","last_unstale":"2024-09-11T22:29:02.930807+0000","last_undegraded":"2024-09-11T22:29:02.930807+0000","last_fullsized":"2024-09-11T22:29:02.930807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:28.127924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931063+0000","last_change":"2024-09-11T22:27:21.999227+0000","last_active":"2024-09-11T22:29:02.931063+0000","last_peered":"2024-09-11T22:29:02.931063+0000","last_clean":"2024-09-11T22:29:02.931063+0000","last_became_active":"2024-09-11T22:27:21.998822+0000","last_became_peered":"2024-09-11T22:27:21.998822+0000","last_unstale":"2024-09-11T22:29:02.931063+0000","last_undegraded":"2024-09-11T22:29:02.931063+0000","last_fullsized":"2024-09-11T22:29:02.931063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:26.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326997+0000","last_change":"2024-09-11T22:27:23.810335+0000","last_active":"2024-09-11T22:29:02.326997+0000","last_peered":"2024-09-11T22:29:02.326997+0000","last_clean":"2024-09-11T22:29:02.326997+0000","last_became_active":"2024-09-11T22:27:23.807659+0000","last_became_peered":"2024-09-11T22:27:23.807659+0000","last_unstale":"2024-09-11T22:29:02.326997+0000","last_undegraded":"2024-09-11T22:29:02.326997+0000","last_fullsized":"2024-09-11T22:29:02.326997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:51.899412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578520+0000","last_change":"2024-09-11T22:27:21.797082+0000","last_active":"2024-09-11T22:29:02.578520+0000","last_peered":"2024-09-11T22:29:02.578520+0000","last_clean":"2024-09-11T22:29:02.578520+0000","last_became_active":"2024-09-11T22:27:21.796657+0000","last_became_peered":"2024-09-11T22:27:21.796657+0000","last_unstale":"2024-09-11T22:29:02.578520+0000","last_undegraded":"2024-09-11T22:29:02.578520+0000","last_fullsized":"2024-09-11T22:29:02.578520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:34.136356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431178+0000","last_change":"2024-09-11T22:28:28.322968+0000","last_active":"2024-09-11T22:29:02.431178+0000","last_peered":"2024-09-11T22:29:02.431178+0000","last_clean":"2024-09-11T22:29:02.431178+0000","last_became_active":"2024-09-11T22:28:28.322489+0000","last_became_peered":"2024-09-11T22:28:28.322489+0000","last_unstale":"2024-09-11T22:29:02.431178+0000","last_undegraded":"2024-09-11T22:29:02.431178+0000","last_fullsized":"2024-09-11T22:29:02.431178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:33.237840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325747+0000","last_change":"2024-09-11T22:27:21.997596+0000","last_active":"2024-09-11T22:29:02.325747+0000","last_peered":"2024-09-11T22:29:02.325747+0000","last_clean":"2024-09-11T22:29:02.325747+0000","last_became_active":"2024-09-11T22:27:21.997203+0000","last_became_peered":"2024-09-11T22:27:21.997203+0000","last_unstale":"2024-09-11T22:29:02.325747+0000","last_undegraded":"2024-09-11T22:29:02.325747+0000","last_fullsized":"2024-09-11T22:29:02.325747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:15.180596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.431254+0000","last_change":"2024-09-11T22:27:23.818508+0000","last_active":"2024-09-11T22:29:02.431254+0000","last_peered":"2024-09-11T22:29:02.431254+0000","last_clean":"2024-09-11T22:29:02.431254+0000","last_became_active":"2024-09-11T22:27:23.818134+0000","last_became_peered":"2024-09-11T22:27:23.818134+0000","last_unstale":"2024-09-11T22:29:02.431254+0000","last_undegraded":"2024-09-11T22:29:02.431254+0000","last_fullsized":"2024-09-11T22:29:02.431254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:05.355942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420565+0000","last_change":"2024-09-11T22:27:21.998014+0000","last_active":"2024-09-11T22:29:02.420565+0000","last_peered":"2024-09-11T22:29:02.420565+0000","last_clean":"2024-09-11T22:29:02.420565+0000","last_became_active":"2024-09-11T22:27:21.997567+0000","last_became_peered":"2024-09-11T22:27:21.997567+0000","last_unstale":"2024-09-11T22:29:02.420565+0000","last_undegraded":"2024-09-11T22:29:02.420565+0000","last_fullsized":"2024-09-11T22:29:02.420565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:59.210165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.931624+0000","last_change":"2024-09-11T22:27:23.807765+0000","last_active":"2024-09-11T22:29:02.931624+0000","last_peered":"2024-09-11T22:29:02.931624+0000","last_clean":"2024-09-11T22:29:02.931624+0000","last_became_active":"2024-09-11T22:27:23.807356+0000","last_became_peered":"2024-09-11T22:27:23.807356+0000","last_unstale":"2024-09-11T22:29:02.931624+0000","last_undegraded":"2024-09-11T22:29:02.931624+0000","last_fullsized":"2024-09-11T22:29:02.931624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'100","reported_seq":216,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:11.321189+0000","last_change":"2024-09-11T22:27:21.796956+0000","last_active":"2024-09-11T22:29:11.321189+0000","last_peered":"2024-09-11T22:29:11.321189+0000","last_clean":"2024-09-11T22:29:11.321189+0000","last_became_active":"2024-09-11T22:27:21.796608+0000","last_became_peered":"2024-09-11T22:27:21.796608+0000","last_unstale":"2024-09-11T22:29:11.321189+0000","last_undegraded":"2024-09-11T22:29:11.321189+0000","last_fullsized":"2024-09-11T22:29:11.321189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:49.184484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":184,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422456+0000","last_change":"2024-09-11T22:27:23.818805+0000","last_active":"2024-09-11T22:29:02.422456+0000","last_peered":"2024-09-11T22:29:02.422456+0000","last_clean":"2024-09-11T22:29:02.422456+0000","last_became_active":"2024-09-11T22:27:23.818474+0000","last_became_peered":"2024-09-11T22:27:23.818474+0000","last_unstale":"2024-09-11T22:29:02.422456+0000","last_undegraded":"2024-09-11T22:29:02.422456+0000","last_fullsized":"2024-09-11T22:29:02.422456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.494297+0000","last_change":"2024-09-11T22:27:22.596972+0000","last_active":"2024-09-11T22:29:02.494297+0000","last_peered":"2024-09-11T22:29:02.494297+0000","last_clean":"2024-09-11T22:29:02.494297+0000","last_became_active":"2024-09-11T22:27:22.596593+0000","last_became_peered":"2024-09-11T22:27:22.596593+0000","last_unstale":"2024-09-11T22:29:02.494297+0000","last_undegraded":"2024-09-11T22:29:02.494297+0000","last_fullsized":"2024-09-11T22:29:02.494297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.512534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932357+0000","last_change":"2024-09-11T22:27:23.814275+0000","last_active":"2024-09-11T22:29:02.932357+0000","last_peered":"2024-09-11T22:29:02.932357+0000","last_clean":"2024-09-11T22:29:02.932357+0000","last_became_active":"2024-09-11T22:27:23.813522+0000","last_became_peered":"2024-09-11T22:27:23.813522+0000","last_unstale":"2024-09-11T22:29:02.932357+0000","last_undegraded":"2024-09-11T22:29:02.932357+0000","last_fullsized":"2024-09-11T22:29:02.932357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:40.123663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.326716+0000","last_change":"2024-09-11T22:28:28.322991+0000","last_active":"2024-09-11T22:29:02.326716+0000","last_peered":"2024-09-11T22:29:02.326716+0000","last_clean":"2024-09-11T22:29:02.326716+0000","last_became_active":"2024-09-11T22:28:28.322523+0000","last_became_peered":"2024-09-11T22:28:28.322523+0000","last_unstale":"2024-09-11T22:29:02.326716+0000","last_undegraded":"2024-09-11T22:29:02.326716+0000","last_fullsized":"2024-09-11T22:29:02.326716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:39.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420245+0000","last_change":"2024-09-11T22:27:23.817411+0000","last_active":"2024-09-11T22:29:02.420245+0000","last_peered":"2024-09-11T22:29:02.420245+0000","last_clean":"2024-09-11T22:29:02.420245+0000","last_became_active":"2024-09-11T22:27:23.817062+0000","last_became_peered":"2024-09-11T22:27:23.817062+0000","last_unstale":"2024-09-11T22:29:02.420245+0000","last_undegraded":"2024-09-11T22:29:02.420245+0000","last_fullsized":"2024-09-11T22:29:02.420245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:43.823440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421019+0000","last_change":"2024-09-11T22:27:21.792635+0000","last_active":"2024-09-11T22:29:02.421019+0000","last_peered":"2024-09-11T22:29:02.421019+0000","last_clean":"2024-09-11T22:29:02.421019+0000","last_became_active":"2024-09-11T22:27:21.792300+0000","last_became_peered":"2024-09-11T22:27:21.792300+0000","last_unstale":"2024-09-11T22:29:02.421019+0000","last_undegraded":"2024-09-11T22:29:02.421019+0000","last_fullsized":"2024-09-11T22:29:02.421019+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:55.809721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930907+0000","last_change":"2024-09-11T22:27:23.811791+0000","last_active":"2024-09-11T22:29:02.930907+0000","last_peered":"2024-09-11T22:29:02.930907+0000","last_clean":"2024-09-11T22:29:02.930907+0000","last_became_active":"2024-09-11T22:27:23.811005+0000","last_became_peered":"2024-09-11T22:27:23.811005+0000","last_unstale":"2024-09-11T22:29:02.930907+0000","last_undegraded":"2024-09-11T22:29:02.930907+0000","last_fullsized":"2024-09-11T22:29:02.930907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:44.694248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.632063+0000","last_change":"2024-09-11T22:27:21.802512+0000","last_active":"2024-09-11T22:29:02.632063+0000","last_peered":"2024-09-11T22:29:02.632063+0000","last_clean":"2024-09-11T22:29:02.632063+0000","last_became_active":"2024-09-11T22:27:21.801767+0000","last_became_peered":"2024-09-11T22:27:21.801767+0000","last_unstale":"2024-09-11T22:29:02.632063+0000","last_undegraded":"2024-09-11T22:29:02.632063+0000","last_fullsized":"2024-09-11T22:29:02.632063+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:16.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.421110+0000","last_change":"2024-09-11T22:27:23.811000+0000","last_active":"2024-09-11T22:29:02.421110+0000","last_peered":"2024-09-11T22:29:02.421110+0000","last_clean":"2024-09-11T22:29:02.421110+0000","last_became_active":"2024-09-11T22:27:23.810635+0000","last_became_peered":"2024-09-11T22:27:23.810635+0000","last_unstale":"2024-09-11T22:29:02.421110+0000","last_undegraded":"2024-09-11T22:29:02.421110+0000","last_fullsized":"2024-09-11T22:29:02.421110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:06.244417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420281+0000","last_change":"2024-09-11T22:27:21.803132+0000","last_active":"2024-09-11T22:29:02.420281+0000","last_peered":"2024-09-11T22:29:02.420281+0000","last_clean":"2024-09-11T22:29:02.420281+0000","last_became_active":"2024-09-11T22:27:21.802650+0000","last_became_peered":"2024-09-11T22:27:21.802650+0000","last_unstale":"2024-09-11T22:29:02.420281+0000","last_undegraded":"2024-09-11T22:29:02.420281+0000","last_fullsized":"2024-09-11T22:29:02.420281+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:48.648596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.578451+0000","last_change":"2024-09-11T22:27:23.817591+0000","last_active":"2024-09-11T22:29:02.578451+0000","last_peered":"2024-09-11T22:29:02.578451+0000","last_clean":"2024-09-11T22:29:02.578451+0000","last_became_active":"2024-09-11T22:27:23.817247+0000","last_became_peered":"2024-09-11T22:27:23.817247+0000","last_unstale":"2024-09-11T22:29:02.578451+0000","last_undegraded":"2024-09-11T22:29:02.578451+0000","last_fullsized":"2024-09-11T22:29:02.578451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:00.861944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327100+0000","last_change":"2024-09-11T22:27:23.809982+0000","last_active":"2024-09-11T22:29:02.327100+0000","last_peered":"2024-09-11T22:29:02.327100+0000","last_clean":"2024-09-11T22:29:02.327100+0000","last_became_active":"2024-09-11T22:27:23.809512+0000","last_became_peered":"2024-09-11T22:27:23.809512+0000","last_unstale":"2024-09-11T22:29:02.327100+0000","last_undegraded":"2024-09-11T22:29:02.327100+0000","last_fullsized":"2024-09-11T22:29:02.327100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.251000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.930838+0000","last_change":"2024-09-11T22:28:28.047124+0000","last_active":"2024-09-11T22:29:02.930838+0000","last_peered":"2024-09-11T22:29:02.930838+0000","last_clean":"2024-09-11T22:29:02.930838+0000","last_became_active":"2024-09-11T22:28:28.041306+0000","last_became_peered":"2024-09-11T22:28:28.041306+0000","last_unstale":"2024-09-11T22:29:02.930838+0000","last_undegraded":"2024-09-11T22:29:02.930838+0000","last_fullsized":"2024-09-11T22:29:02.930838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:59.114867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.327393+0000","last_change":"2024-09-11T22:27:23.810376+0000","last_active":"2024-09-11T22:29:02.327393+0000","last_peered":"2024-09-11T22:29:02.327393+0000","last_clean":"2024-09-11T22:29:02.327393+0000","last_became_active":"2024-09-11T22:27:23.809219+0000","last_became_peered":"2024-09-11T22:27:23.809219+0000","last_unstale":"2024-09-11T22:29:02.327393+0000","last_undegraded":"2024-09-11T22:29:02.327393+0000","last_fullsized":"2024-09-11T22:29:02.327393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:30.347654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.420502+0000","last_change":"2024-09-11T22:27:21.800939+0000","last_active":"2024-09-11T22:29:02.420502+0000","last_peered":"2024-09-11T22:29:02.420502+0000","last_clean":"2024-09-11T22:29:02.420502+0000","last_became_active":"2024-09-11T22:27:21.800514+0000","last_became_peered":"2024-09-11T22:27:21.800514+0000","last_unstale":"2024-09-11T22:29:02.420502+0000","last_undegraded":"2024-09-11T22:29:02.420502+0000","last_fullsized":"2024-09-11T22:29:02.420502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:58:44.025728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.932665+0000","last_change":"2024-09-11T22:27:23.808988+0000","last_active":"2024-09-11T22:29:02.932665+0000","last_peered":"2024-09-11T22:29:02.932665+0000","last_clean":"2024-09-11T22:29:02.932665+0000","last_became_active":"2024-09-11T22:27:23.807071+0000","last_became_peered":"2024-09-11T22:27:23.807071+0000","last_unstale":"2024-09-11T22:29:02.932665+0000","last_undegraded":"2024-09-11T22:29:02.932665+0000","last_fullsized":"2024-09-11T22:29:02.932665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:20.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422315+0000","last_change":"2024-09-11T22:27:21.997624+0000","last_active":"2024-09-11T22:29:02.422315+0000","last_peered":"2024-09-11T22:29:02.422315+0000","last_clean":"2024-09-11T22:29:02.422315+0000","last_became_active":"2024-09-11T22:27:21.997254+0000","last_became_peered":"2024-09-11T22:27:21.997254+0000","last_unstale":"2024-09-11T22:29:02.422315+0000","last_undegraded":"2024-09-11T22:29:02.422315+0000","last_fullsized":"2024-09-11T22:29:02.422315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:50.928137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.422034+0000","last_change":"2024-09-11T22:27:23.814753+0000","last_active":"2024-09-11T22:29:02.422034+0000","last_peered":"2024-09-11T22:29:02.422034+0000","last_clean":"2024-09-11T22:29:02.422034+0000","last_became_active":"2024-09-11T22:27:23.814439+0000","last_became_peered":"2024-09-11T22:27:23.814439+0000","last_unstale":"2024-09-11T22:29:02.422034+0000","last_undegraded":"2024-09-11T22:29:02.422034+0000","last_fullsized":"2024-09-11T22:29:02.422034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:22.784293+0000","last_clean_scrub_stamp":"2024-09-11T22:27:22.784293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:19.568804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T22:29:02.325965+0000","last_change":"2024-09-11T22:28:28.044577+0000","last_active":"2024-09-11T22:29:02.325965+0000","last_peered":"2024-09-11T22:29:02.325965+0000","last_clean":"2024-09-11T22:29:02.325965+0000","last_became_active":"2024-09-11T22:28:28.040018+0000","last_became_peered":"2024-09-11T22:28:28.040018+0000","last_unstale":"2024-09-11T22:29:02.325965+0000","last_undegraded":"2024-09-11T22:29:02.325965+0000","last_fullsized":"2024-09-11T22:29:02.325965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:27:20.780702+0000","last_clean_scrub_stamp":"2024-09-11T22:27:20.780702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:27.161509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":791781,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":569,"num_read_kb":493,"num_write":330,"num_write_kb":2320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2469888,"data_stored":2375343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":442494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41500,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703652,"statfs":{"total":95995035648,"available":95952539648,"internally_reserved":0,"allocated":1921024,"data_stored":1430940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939693,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40772,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704380,"statfs":{"total":95995035648,"available":95953285120,"internally_reserved":0,"allocated":1298432,"data_stored":836292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712700,"statfs":{"total":95995035648,"available":95961804800,"internally_reserved":0,"allocated":1298432,"data_stored":835732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1033561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33104,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712048,"statfs":{"total":95995035648,"available":95961137152,"internally_reserved":0,"allocated":1843200,"data_stored":1361393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28748,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716404,"statfs":{"total":95995035648,"available":95965597696,"internally_reserved":0,"allocated":1642496,"data_stored":1164280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":512063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":512611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40392,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704760,"statfs":{"total":95995035648,"available":95953674240,"internally_reserved":0,"allocated":905216,"data_stored":442584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":69569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733184,"data_stored":721552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":328414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":397961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:17.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/578799771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa410c170 msgr2=0x7fcaa410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:18.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/578799771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa410c170 0x7fcaa410e610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009ca0 tx=0x7fca9c02a950 comp rx=0 tx=0).stop 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/578799771 shutdown_connections 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/578799771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa410c170 0x7fcaa410e610 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/578799771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 0x7fcaa410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/578799771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa4102d40 0x7fcaa4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/578799771 >> 172.21.15.22:0/578799771 conn(0x7fcaa40fc7a0 msgr2=0x7fcaa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/578799771 shutdown_connections 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/578799771 wait complete. 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.150+0000 7fcaaa3f2640 1 Processor -- start 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 -- start start 2024-09-11T22:29:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 0x7fcaa419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa410c170 0x7fcaa419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4112090 con 0x7fcaa4102d40 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4111f10 con 0x7fcaa4103660 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaaa3f2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4112210 con 0x7fcaa410c170 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36764/0 (socket says 172.21.15.22:36764) 2024-09-11T22:29:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 -- 172.21.15.22:0/1925891747 learned_addr learned my addr 172.21.15.22:0/1925891747 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa37fe640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 0x7fcaa419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa898f640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa410c170 0x7fcaa419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 -- 172.21.15.22:0/1925891747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa410c170 msgr2=0x7fcaa419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa410c170 0x7fcaa419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 -- 172.21.15.22:0/1925891747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 msgr2=0x7fcaa419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.151+0000 7fcaa3fff640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 0x7fcaa419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaa3fff640 1 -- 172.21.15.22:0/1925891747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa419f680 con 0x7fcaa4102d40 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaa3fff640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca9400d770 tx=0x7fca9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94017070 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca94005520 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa419f970 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94010460 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.152+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41a7250 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.153+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4103120 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.154+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fca94004ea0 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.155+0000 7fcaa17fa640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 0x7fca8c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.155+0000 7fcaa37fe640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 0x7fca8c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.155+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fca940cf020 con 0x7fcaa4102d40 2024-09-11T22:29:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.155+0000 7fcaa37fe640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 0x7fca8c0a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcaa410ea90 tx=0x7fca9800b2e0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.159+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca9409b4d0 con 0x7fcaa4102d40 2024-09-11T22:29:18.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.369+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa41a7420 con 0x7fcaa4102d40 2024-09-11T22:29:18.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:18 smithi022 ceph-mon[30966]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-11T22:29:18.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:18 smithi022 ceph-mon[30966]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:18.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.370+0000 7fcaa17fa640 1 -- 172.21.15.22:0/1925891747 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7fca9409f7d0 con 0x7fcaa4102d40 2024-09-11T22:29:18.371 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:18.371 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:18.372 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 msgr2=0x7fca8c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 0x7fca8c0a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcaa410ea90 tx=0x7fca9800b2e0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 msgr2=0x7fcaa419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca9400d770 tx=0x7fca9400dc30 comp rx=0 tx=0).stop 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 shutdown_connections 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fca8c0a2d80 0x7fca8c0a5240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcaa410c170 0x7fcaa419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa4103660 0x7fcaa419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 --2- 172.21.15.22:0/1925891747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcaa4102d40 0x7fcaa419a6d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 >> 172.21.15.22:0/1925891747 conn(0x7fcaa40fc7a0 msgr2=0x7fcaa410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.372+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 shutdown_connections 2024-09-11T22:29:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:18.373+0000 7fcaaa3f2640 1 -- 172.21.15.22:0/1925891747 wait complete. 2024-09-11T22:29:18.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:18 smithi169 ceph-mon[35628]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-11T22:29:18.405 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:18 smithi169 ceph-mon[35628]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:18.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:18 smithi045 ceph-mon[35556]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 43 op/s 2024-09-11T22:29:18.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:18 smithi045 ceph-mon[35556]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:19.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:19.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:19.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:19 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1925891747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:19.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:19 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1925891747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:19.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:19 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1925891747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 -- 172.21.15.22:0/3772100794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c101df0 msgr2=0x7f866c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 --2- 172.21.15.22:0/3772100794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c101df0 0x7f866c1021d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8668009900 tx=0x7f866802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 -- 172.21.15.22:0/3772100794 shutdown_connections 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 --2- 172.21.15.22:0/3772100794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c106f20 0x7f866c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 --2- 172.21.15.22:0/3772100794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c1027a0 0x7f866c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 --2- 172.21.15.22:0/3772100794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c101df0 0x7f866c1021d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 -- 172.21.15.22:0/3772100794 >> 172.21.15.22:0/3772100794 conn(0x7f866c0fd8b0 msgr2=0x7f866c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 -- 172.21.15.22:0/3772100794 shutdown_connections 2024-09-11T22:29:19.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 -- 172.21.15.22:0/3772100794 wait complete. 2024-09-11T22:29:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.800+0000 7f867445e640 1 Processor -- start 2024-09-11T22:29:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 -- start start 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c101df0 0x7f866c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c106f20 0x7f866c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f866c1120a0 con 0x7f866c1027a0 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f866c111f20 con 0x7f866c101df0 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f867445e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f866c112220 con 0x7f866c106f20 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36782/0 (socket says 172.21.15.22:36782) 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 -- 172.21.15.22:0/3004738538 learned_addr learned my addr 172.21.15.22:0/3004738538 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86729fb640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c106f20 0x7f866c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86721fa640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c101df0 0x7f866c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 -- 172.21.15.22:0/3004738538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c106f20 msgr2=0x7f866c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c106f20 0x7f866c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 -- 172.21.15.22:0/3004738538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c101df0 msgr2=0x7f866c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c101df0 0x7f866c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.801+0000 7f86719f9640 1 -- 172.21.15.22:0/3004738538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c19d4f0 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f86719f9640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c970 tx=0x7f865c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c007bb0 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f865c007d50 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866c19d7e0 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c00f4b0 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.802+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866c1a50c0 con 0x7f866c1027a0 2024-09-11T22:29:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.803+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f866c1021d0 con 0x7f866c1027a0 2024-09-11T22:29:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.804+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f865c0046c0 con 0x7f866c1027a0 2024-09-11T22:29:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.805+0000 7f86637fe640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 0x7f86580a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.805+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f865c0cf2b0 con 0x7f866c1027a0 2024-09-11T22:29:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.805+0000 7f86721fa640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 0x7f86580a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.805+0000 7f86721fa640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 0x7f86580a52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8668009230 tx=0x7f86680058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:19.809+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f865c014030 con 0x7f866c1027a0 2024-09-11T22:29:20.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.022+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f866c02d7c0 con 0x7f866c1027a0 2024-09-11T22:29:20.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.023+0000 7f86637fe640 1 -- 172.21.15.22:0/3004738538 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f865c0860c0 con 0x7f866c1027a0 2024-09-11T22:29:20.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:20.025 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:20.025 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:20.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 msgr2=0x7f86580a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 0x7f86580a52c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8668009230 tx=0x7f86680058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 msgr2=0x7f866c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c970 tx=0x7f865c00ce30 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 shutdown_connections 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f86580a2e00 0x7f86580a52c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f866c106f20 0x7f866c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f866c1027a0 0x7f866c198a80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 --2- 172.21.15.22:0/3004738538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f866c101df0 0x7f866c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 >> 172.21.15.22:0/3004738538 conn(0x7f866c0fd8b0 msgr2=0x7f866c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 shutdown_connections 2024-09-11T22:29:20.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:20.026+0000 7f867445e640 1 -- 172.21.15.22:0/3004738538 wait complete. 2024-09-11T22:29:20.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:20 smithi022 ceph-mon[30966]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T22:29:20.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:20 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3004738538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:20 smithi169 ceph-mon[35628]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T22:29:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:20 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3004738538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:20 smithi045 ceph-mon[35556]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T22:29:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:20 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3004738538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:20.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:21.035 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:21.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 -- 172.21.15.22:0/1701612607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520100a90 msgr2=0x7fc520100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 --2- 172.21.15.22:0/1701612607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520100a90 0x7fc520100ef0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc508009930 tx=0x7fc50802a420 comp rx=0 tx=0).stop 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 -- 172.21.15.22:0/1701612607 shutdown_connections 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 --2- 172.21.15.22:0/1701612607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520101430 0x7fc52010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 --2- 172.21.15.22:0/1701612607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520100a90 0x7fc520100ef0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 --2- 172.21.15.22:0/1701612607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc520106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.515+0000 7fc52552a640 1 -- 172.21.15.22:0/1701612607 >> 172.21.15.22:0/1701612607 conn(0x7fc5200fc7d0 msgr2=0x7fc5200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.516+0000 7fc52552a640 1 -- 172.21.15.22:0/1701612607 shutdown_connections 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.516+0000 7fc52552a640 1 -- 172.21.15.22:0/1701612607 wait complete. 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.516+0000 7fc52552a640 1 Processor -- start 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.516+0000 7fc52552a640 1 -- start start 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.516+0000 7fc52552a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520100a90 0x7fc520198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc52019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc520110ff0 con 0x7fc520101430 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc520110e70 con 0x7fc520106a90 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc520111170 con 0x7fc520100a90 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36788/0 (socket says 172.21.15.22:36788) 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 -- 172.21.15.22:0/1256043742 learned_addr learned my addr 172.21.15.22:0/1256043742 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51effd640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520100a90 0x7fc520198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51f7fe640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc52019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 -- 172.21.15.22:0/1256043742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520100a90 msgr2=0x7fc520198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520100a90 0x7fc520198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 -- 172.21.15.22:0/1256043742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 msgr2=0x7fc52019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc52019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 -- 172.21.15.22:0/1256043742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52019d530 con 0x7fc520101430 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51f7fe640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc52019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc51e7fc640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc508009a50 tx=0x7fc508004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50803f030 con 0x7fc520101430 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc508003af0 con 0x7fc520101430 2024-09-11T22:29:21.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52019d7c0 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.517+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508035070 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.518+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5201a5100 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.519+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5201021d0 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.520+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fc508042030 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.521+0000 7fc517fff640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 0x7fc50c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.521+0000 7fc51effd640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 0x7fc50c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.521+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc5080efe70 con 0x7fc520101430 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.521+0000 7fc51effd640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 0x7fc50c0a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc518007ec0 tx=0x7fc5180075b0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.525+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5080bc970 con 0x7fc520101430 2024-09-11T22:29:21.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.703+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc52010a030 con 0x7fc520101430 2024-09-11T22:29:21.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.704+0000 7fc517fff640 1 -- 172.21.15.22:0/1256043742 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23020 (secure 0 0 0) 0x7fc5080bc270 con 0x7fc520101430 2024-09-11T22:29:21.705 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:21.706 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:29:02.319828+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/1813461442":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/1692369784":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4017592669":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1661302101":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3117763107":"2024-09-12T22:29:02.319778+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3117763107":"2024-09-12T22:29:02.319778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 msgr2=0x7fc50c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 0x7fc50c0a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc518007ec0 tx=0x7fc5180075b0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 msgr2=0x7fc520198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc508009a50 tx=0x7fc508004270 comp rx=0 tx=0).stop 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 shutdown_connections 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc50c0a2d80 0x7fc50c0a5240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc520106a90 0x7fc52019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc520101430 0x7fc520198ac0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 --2- 172.21.15.22:0/1256043742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc520100a90 0x7fc520198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 >> 172.21.15.22:0/1256043742 conn(0x7fc5200fc7d0 msgr2=0x7fc52006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 shutdown_connections 2024-09-11T22:29:21.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:21.707+0000 7fc52552a640 1 -- 172.21.15.22:0/1256043742 wait complete. 2024-09-11T22:29:22.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:22 smithi022 ceph-mon[30966]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:22.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:22 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1256043742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:22.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-11T22:29:22.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:22 smithi169 ceph-mon[35628]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:22.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:22 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1256043742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:22 smithi045 ceph-mon[35556]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:22.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:22 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1256043742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:22.638 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:23.877 INFO:teuthology.orchestra.run.smithi022.stdout:{"run_dir":"/var/run/ceph"} 2024-09-11T22:29:23.878 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-11T22:29:23.878 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-11T22:29:23.879 DEBUG:tasks.quiescer:Yielding 2024-09-11T22:29:23.879 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T22:29:23.902 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:29:23.903 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T22:29:23.903 INFO:tasks.workunit:timeout=3h 2024-09-11T22:29:23.903 INFO:tasks.workunit:cleanup=True 2024-09-11T22:29:23.903 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:23.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-11 22:27:40.904912502 +0000 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-11 22:27:40.904912502 +0000 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-11 22:29:00.409729715 +0000 2024-09-11T22:29:23.921 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-11 22:27:40.904912502 +0000 2024-09-11T22:29:23.922 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T22:29:23.922 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T22:29:23.994 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:29:24.050 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T22:29:24.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:24 smithi022 ceph-mon[30966]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:24.178 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:24.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:24 smithi169 ceph-mon[35628]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:24 smithi045 ceph-mon[35556]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-11T22:29:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2117225955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c107b80 msgr2=0x7ff19c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2117225955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c107b80 0x7ff19c107f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff198009cd0 tx=0x7ff19802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2117225955 shutdown_connections 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2117225955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c102480 0x7ff19c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2117225955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 0x7ff19c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2117225955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c107b80 0x7ff19c107f60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2117225955 >> 172.21.15.22:0/2117225955 conn(0x7ff19c0fd7e0 msgr2=0x7ff19c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2117225955 shutdown_connections 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.559+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2117225955 wait complete. 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 Processor -- start 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 -- start start 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 0x7ff19c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 0x7ff19c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c112010 con 0x7ff19c102480 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c111e90 con 0x7ff19c101ae0 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a3c0a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c112190 con 0x7ff19c107b80 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.560+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55004/0 (socket says 172.21.15.22:55004) 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 -- 172.21.15.22:0/2214448953 learned_addr learned my addr 172.21.15.22:0/2214448953 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 0x7ff19c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 0x7ff19c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 -- 172.21.15.22:0/2214448953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 msgr2=0x7ff19c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 0x7ff19c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 -- 172.21.15.22:0/2214448953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 msgr2=0x7ff19c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 0x7ff19c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 -- 172.21.15.22:0/2214448953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c19d410 con 0x7ff19c102480 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 0x7ff19c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00e9f0 tx=0x7ff18c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff192ffd640 1 -- 172.21.15.22:0/2214448953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c00cd80 con 0x7ff19c102480 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff192ffd640 1 -- 172.21.15.22:0/2214448953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff18c010930 con 0x7ff19c102480 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c19d700 con 0x7ff19c102480 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff192ffd640 1 -- 172.21.15.22:0/2214448953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c018b00 con 0x7ff19c102480 2024-09-11T22:29:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.561+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c1a4f90 con 0x7ff19c102480 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff192ffd640 1 -- 172.21.15.22:0/2214448953 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7ff18c018ca0 con 0x7ff19c102480 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 Processor -- start 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 -- start start 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc5262f0 con 0x55b3fc5c6820 2024-09-11T22:29:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc4ce270 con 0x55b3fc5c5f00 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.564+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc5222b0 con 0x55b3fc5d10c0 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a19a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a19a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55018/0 (socket says 172.21.15.22:55018) 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:50430/0 (socket says 172.21.15.22:50430) 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a19a6640 1 -- 172.21.15.22:0/2779789525 learned_addr learned my addr 172.21.15.22:0/2779789525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff192ffd640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 0x7ff1880a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 -- 172.21.15.22:0/2779789525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 msgr2=0x55b3fc5d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 -- 172.21.15.22:0/2779789525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 msgr2=0x55b3fc5d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 -- 172.21.15.22:0/2779789525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fc4cd340 con 0x55b3fc5c5f00 2024-09-11T22:29:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff192ffd640 1 -- 172.21.15.22:0/2214448953 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff18c0cf970 con 0x7ff19c102480 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 0x7ff1880a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.565+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff194009b30 tx=0x7ff1940113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fd0b2beddf546 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff187fff640 1 -- 172.21.15.22:0/2779789525 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194020070 con 0x55b3fc5c5f00 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff187fff640 1 -- 172.21.15.22:0/2779789525 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff194012c70 con 0x55b3fc5c5f00 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff187fff640 1 -- 172.21.15.22:0/2779789525 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19400f480 con 0x55b3fc5c5f00 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff1a6a77740 1 -- 172.21.15.22:0/2779789525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 msgr2=0x55b3fc5c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 0x7ff1880a5380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff19401d000 tx=0x7ff19400f740 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.566+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff194009b30 tx=0x7ff1940113e0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 -- 172.21.15.22:0/2779789525 shutdown_connections 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/2779789525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5c62e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 -- 172.21.15.22:0/2779789525 >> 172.21.15.22:0/2779789525 conn(0x55b3fc5c2470 msgr2=0x55b3fc5c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 -- 172.21.15.22:0/2779789525 shutdown_connections 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 -- 172.21.15.22:0/2779789525 wait complete. 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 -- start start 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 Processor -- start 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.567+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc5d3c90 con 0x55b3fc5c6820 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc4af290 con 0x55b3fc5d10c0 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b3fc5d3e10 con 0x55b3fc5c5f00 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 10 client.0 _ll_register_callbacks cb 0x55b3fc4e0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55022/0 (socket says 172.21.15.22:55022) 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 -- 172.21.15.22:0/725685287 learned_addr learned my addr 172.21.15.22:0/725685287 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 -- 172.21.15.22:0/725685287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5c5f00 msgr2=0x55b3fc5cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 -- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5d10c0 msgr2=0x55b3fc5cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 -- 172.21.15.22:0/725685287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3fc239210 con 0x55b3fc5c6820 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0cd0e0 tx=0x7ff18c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88016e300bcec0ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c09b8b0 con 0x55b3fc5c6820 2024-09-11T22:29:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff18c09b1c0 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.568+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff194012c70 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff18c09b6d0 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 10 client.15294 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b3fc305620 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff194012c70 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff18c097ac0 con 0x55b3fc5c6820 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 10 client.15294 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 20 client.15294 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc5e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 4 client.15294 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3fc533a20 con 0x55b3fc5e0fe0 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.569+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc5e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1857fa640 10 client.15294 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc5e33d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc4aaa08a2bcece server_cookie=a420d51dbe8e6892 in_seq=0 out_seq=0 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1857fa640 1 -- 172.21.15.22:0/725685287 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3fc533a20 con 0x55b3fc5e0fe0 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1857fa640 10 client.15294 handle_command_reply: tid=0 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1a6a77740 1 client.15294 shutdown 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.570+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 msgr2=0x55b3fc5ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0cd0e0 tx=0x7ff18c009310 comp rx=0 tx=0).stop 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 shutdown_connections 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc5e33d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1857fa640 0 client.15294 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5ce4c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/725685287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 >> 172.21.15.22:0/725685287 conn(0x55b3fc5c2470 msgr2=0x55b3fc5bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 shutdown_connections 2024-09-11T22:29:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 1 -- 172.21.15.22:0/725685287 wait complete. 2024-09-11T22:29:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.571+0000 7ff1a6a77740 20 client.15294 trim_cache size 0 max 16384 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 Processor -- start 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 -- start start 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1a95e0 con 0x55b3fc5c6820 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1abe40 con 0x55b3fc5c5f00 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1a9c30 con 0x55b3fc5d10c0 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55036/0 (socket says 172.21.15.22:55036) 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 -- 172.21.15.22:0/3564120792 learned_addr learned my addr 172.21.15.22:0/3564120792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 -- 172.21.15.22:0/3564120792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 msgr2=0x55b3fc5e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 -- 172.21.15.22:0/3564120792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 msgr2=0x55b3fc5bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a11a5640 1 -- 172.21.15.22:0/3564120792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3fc5c22a0 con 0x55b3fc5c6820 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.586+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.587+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c6a0 tx=0x7ff18c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df28bdb25afdb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.587+0000 7ff1877fe640 1 -- 172.21.15.22:0/3564120792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c010cf0 con 0x55b3fc5c6820 2024-09-11T22:29:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.587+0000 7ff1877fe640 1 -- 172.21.15.22:0/3564120792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff18c09bd70 con 0x55b3fc5c6820 2024-09-11T22:29:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.587+0000 7ff1877fe640 1 -- 172.21.15.22:0/3564120792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0cd300 con 0x55b3fc5c6820 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- 172.21.15.22:0/3564120792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 msgr2=0x55b3fc5e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c6a0 tx=0x7ff18c00c7d0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- 172.21.15.22:0/3564120792 shutdown_connections 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c6820 0x55b3fc5e8c70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/3564120792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- 172.21.15.22:0/3564120792 >> 172.21.15.22:0/3564120792 conn(0x55b3fc5c2470 msgr2=0x55b3fc5bc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- 172.21.15.22:0/3564120792 shutdown_connections 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- 172.21.15.22:0/3564120792 wait complete. 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.588+0000 7ff1a6a77740 1 -- start start 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 Processor -- start 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1aa300 con 0x55b3fc5c5f00 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1ab770 con 0x55b3fc5c6820 2024-09-11T22:29:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c1aa9d0 con 0x55b3fc5d10c0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a6a77740 10 client.0 _ll_register_callbacks cb 0x7ff18c0980d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a19a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a19a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55042/0 (socket says 172.21.15.22:55042) 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.589+0000 7ff1a19a6640 1 -- 172.21.15.22:0/149289770 learned_addr learned my addr 172.21.15.22:0/149289770 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a21a7640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 -- 172.21.15.22:0/149289770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 msgr2=0x55b3fc5d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 -- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c6820 msgr2=0x55b3fc5d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 -- 172.21.15.22:0/149289770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3fc5d5460 con 0x55b3fc5c5f00 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a19a6640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff19802ae00 tx=0x7ff198031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06a72835761db32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1857fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198031c90 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff198003970 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3fc52dd70 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.590+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff198031e30 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 10 client.15300 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b3fc64b9d0 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55b3fc52dd70 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff198030070 con 0x55b3fc5c5f00 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 10 client.15300 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 10 client.15300 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 20 client.15300 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc64e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 4 client.15300 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3fc4aa900 con 0x55b3fc5e0fe0 2024-09-11T22:29:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.591+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc64e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.592+0000 7ff1a11a5640 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc64e110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48daed7c16d06b2c server_cookie=15fdcfd1bcb6e0ea in_seq=0 out_seq=0 2024-09-11T22:29:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.592+0000 7ff1857fa640 10 client.15300 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1857fa640 1 -- 172.21.15.22:0/149289770 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3fc4aa900 con 0x55b3fc5e0fe0 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1857fa640 10 client.15300 handle_command_reply: tid=0 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 client.15300 shutdown 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 msgr2=0x55b3fc5d95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff19802ae00 tx=0x7ff198031830 comp rx=0 tx=0).stop 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 shutdown_connections 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b3fc5e0fe0 0x55b3fc64e110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b3fc5d10c0 0x55b3fc5d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3fc5c6820 0x55b3fc5d4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 --2- 172.21.15.22:0/149289770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b3fc5c5f00 0x55b3fc5d95a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1857fa640 0 client.15300 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 >> 172.21.15.22:0/149289770 conn(0x55b3fc5c2470 msgr2=0x55b3fc5bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 shutdown_connections 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 1 -- 172.21.15.22:0/149289770 wait complete. 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.603+0000 7ff1a6a77740 20 client.15300 trim_cache size 0 max 16384 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:29:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 msgr2=0x7ff1880a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 0x7ff1880a5380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff19401d000 tx=0x7ff19400f740 comp rx=0 tx=0).stop 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 msgr2=0x7ff19c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00e9f0 tx=0x7ff18c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 shutdown_connections 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1880a2ec0 0x7ff1880a5380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff19c107b80 0x7ff19c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff19c102480 0x7ff19c198960 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 --2- 172.21.15.22:0/2214448953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19c101ae0 0x7ff19c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 >> 172.21.15.22:0/2214448953 conn(0x7ff19c0fd7e0 msgr2=0x7ff19c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 shutdown_connections 2024-09-11T22:29:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:24.604+0000 7ff1a3c0a640 1 -- 172.21.15.22:0/2214448953 wait complete. 2024-09-11T22:29:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 -- 172.21.15.22:0/3050606298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 msgr2=0x7f41ac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 --2- 172.21.15.22:0/3050606298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac10d950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009cd0 tx=0x7f41a402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 -- 172.21.15.22:0/3050606298 shutdown_connections 2024-09-11T22:29:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 --2- 172.21.15.22:0/3050606298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac10d950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 --2- 172.21.15.22:0/3050606298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac100a80 0x7f41ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 --2- 172.21.15.22:0/3050606298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac106a80 0x7f41ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 -- 172.21.15.22:0/3050606298 >> 172.21.15.22:0/3050606298 conn(0x7f41ac0fc7a0 msgr2=0x7f41ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 -- 172.21.15.22:0/3050606298 shutdown_connections 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.712+0000 7f41b12ff640 1 -- 172.21.15.22:0/3050606298 wait complete. 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.713+0000 7f41b12ff640 1 Processor -- start 2024-09-11T22:29:24.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.713+0000 7f41b12ff640 1 -- start start 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.713+0000 7f41b12ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac100a80 0x7f41ac19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.713+0000 7f41b12ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41b12ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac106a80 0x7f41ac19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41b12ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac110fa0 con 0x7f41ac101420 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41b12ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac110e20 con 0x7f41ac106a80 2024-09-11T22:29:24.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41b12ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac111120 con 0x7f41ac100a80 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55056/0 (socket says 172.21.15.22:55056) 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 -- 172.21.15.22:0/2961012744 learned_addr learned my addr 172.21.15.22:0/2961012744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41ab7fe640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac106a80 0x7f41ac19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aaffd640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac100a80 0x7f41ac19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 -- 172.21.15.22:0/2961012744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac100a80 msgr2=0x7f41ac19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac100a80 0x7f41ac19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 -- 172.21.15.22:0/2961012744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac106a80 msgr2=0x7f41ac19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac106a80 0x7f41ac19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 -- 172.21.15.22:0/2961012744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac19f6a0 con 0x7f41ac101420 2024-09-11T22:29:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f41aa7fc640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41a000d950 tx=0x7f41a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.714+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0017070 con 0x7f41ac101420 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.715+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41ac19f990 con 0x7f41ac101420 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.715+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41a0009c30 con 0x7f41ac101420 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.715+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a000f740 con 0x7f41ac101420 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.715+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ac1a7270 con 0x7f41ac101420 2024-09-11T22:29:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.716+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41ac100ee0 con 0x7f41ac101420 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.717+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f41a0010a80 con 0x7f41ac101420 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.718+0000 7f4193fff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 0x7f41940a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.718+0000 7f41aaffd640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 0x7f41940a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.718+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f41a00cf470 con 0x7f41ac101420 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.718+0000 7f41aaffd640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 0x7f41940a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f419c00bb60 tx=0x7f419c00b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.721+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41a0009de0 con 0x7f41ac101420 2024-09-11T22:29:24.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.933+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41ac19ba50 con 0x7f41ac101420 2024-09-11T22:29:24.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.933+0000 7f4193fff640 1 -- 172.21.15.22:0/2961012744 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f41ac19ba50 con 0x7f41ac101420 2024-09-11T22:29:24.934 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:24.934 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:24.935 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 msgr2=0x7f41940a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 0x7f41940a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f419c00bb60 tx=0x7f419c00b390 comp rx=0 tx=0).stop 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 msgr2=0x7f41ac19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41a000d950 tx=0x7f41a000de10 comp rx=0 tx=0).stop 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 shutdown_connections 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f41940a2d80 0x7f41940a5240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41ac106a80 0x7f41ac19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41ac101420 0x7f41ac19ac30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 --2- 172.21.15.22:0/2961012744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac100a80 0x7f41ac19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 >> 172.21.15.22:0/2961012744 conn(0x7f41ac0fc7a0 msgr2=0x7f41ac06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.935+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 shutdown_connections 2024-09-11T22:29:24.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:24.936+0000 7f41b12ff640 1 -- 172.21.15.22:0/2961012744 wait complete. 2024-09-11T22:29:25.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:25 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2961012744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:25.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:25 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2961012744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:25.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:27:24.459196+0000', 'modified': '2024-09-11T22:27:33.502987+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/1224562712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 1224562712}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 1224562712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6839/2293732037', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 2293732037}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 2293732037}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-11T22:29:25.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:29:25.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:29:25.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:25 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2961012744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:25.920 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:26.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:26 smithi022 ceph-mon[30966]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-11T22:29:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:26 smithi045 ceph-mon[35556]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- 172.21.15.22:0/1810113344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 msgr2=0x7ff194106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/1810113344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff194106e40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff190009930 tx=0x7ff19002a420 comp rx=0 tx=0).stop 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- 172.21.15.22:0/1810113344 shutdown_connections 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/1810113344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194101400 0x7ff19410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/1810113344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194100a60 0x7ff194100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/1810113344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff194106e40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- 172.21.15.22:0/1810113344 >> 172.21.15.22:0/1810113344 conn(0x7ff1940fc780 msgr2=0x7ff1940feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- 172.21.15.22:0/1810113344 shutdown_connections 2024-09-11T22:29:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- 172.21.15.22:0/1810113344 wait complete. 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 Processor -- start 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.391+0000 7ff19b8a1640 1 -- start start 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 0x7ff1941993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194101400 0x7ff194199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff194110fc0 con 0x7ff194106a60 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff194110e40 con 0x7ff194101400 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff194111140 con 0x7ff194100a60 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55070/0 (socket says 172.21.15.22:55070) 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 -- 172.21.15.22:0/2368146068 learned_addr learned my addr 172.21.15.22:0/2368146068 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff198e3c640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194101400 0x7ff194199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19963d640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 0x7ff1941993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 -- 172.21.15.22:0/2368146068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 msgr2=0x7ff1941993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 0x7ff1941993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 -- 172.21.15.22:0/2368146068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194101400 msgr2=0x7ff194199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194101400 0x7ff194199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 -- 172.21.15.22:0/2368146068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1941a4990 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19963d640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 0x7ff1941993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff199e3e640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b970 tx=0x7ff18c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff18a7fc640 1 -- 172.21.15.22:0/2368146068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c019070 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff18a7fc640 1 -- 172.21.15.22:0/2368146068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff18c00cb40 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1941a4b60 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.392+0000 7ff18a7fc640 1 -- 172.21.15.22:0/2368146068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c007700 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.393+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1941a5070 con 0x7ff194106a60 2024-09-11T22:29:26.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.395+0000 7ff18a7fc640 1 -- 172.21.15.22:0/2368146068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7ff18c01c070 con 0x7ff194106a60 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.395+0000 7ff19dc7a740 1 Processor -- start 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.395+0000 7ff19dc7a740 1 -- start start 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f307670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f309fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f263090 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f20aa70 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f25f050 con 0x55ae5f307bb0 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55084/0 (socket says 172.21.15.22:55084) 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 -- 172.21.15.22:0/4079108043 learned_addr learned my addr 172.21.15.22:0/4079108043 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:26.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff18a7fc640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 0x7ff1800a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff19963d640 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f307670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f309fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 -- 172.21.15.22:0/4079108043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 msgr2=0x55ae5f309fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f309fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff199e3e640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 0x7ff1800a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 -- 172.21.15.22:0/4079108043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fd2f0 msgr2=0x55ae5f307670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f307670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff18a7fc640 1 -- 172.21.15.22:0/2368146068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff18c0ce9f0 con 0x7ff194106a60 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 -- 172.21.15.22:0/4079108043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5f217130 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.396+0000 7ff198e3c640 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1840058a0 tx=0x7ff18400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4d1bd6598a33c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff17f7fe640 1 -- 172.21.15.22:0/4079108043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184004030 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff199e3e640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 0x7ff1800a52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0cc1e0 tx=0x7ff18c085a80 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff17f7fe640 1 -- 172.21.15.22:0/4079108043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff184005520 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff17f7fe640 1 -- 172.21.15.22:0/4079108043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184004d00 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 -- 172.21.15.22:0/4079108043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 msgr2=0x55ae5f2fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff1840058a0 tx=0x7ff18400b840 comp rx=0 tx=0).stop 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 -- 172.21.15.22:0/4079108043 shutdown_connections 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f309fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f307670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/4079108043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f2fcdb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 -- 172.21.15.22:0/4079108043 >> 172.21.15.22:0/4079108043 conn(0x55ae5f2f8f60 msgr2=0x55ae5f2f9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 -- 172.21.15.22:0/4079108043 shutdown_connections 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.397+0000 7ff19dc7a740 1 -- 172.21.15.22:0/4079108043 wait complete. 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 -- start start 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 Processor -- start 2024-09-11T22:29:26.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f307410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f304ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f30a780 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f21df20 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f30a900 con 0x55ae5f307bb0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19dc7a740 10 client.0 _ll_register_callbacks cb 0x55ae5f1e7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55092/0 (socket says 172.21.15.22:55092) 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.398+0000 7ff19963d640 1 -- 172.21.15.22:0/1691589856 learned_addr learned my addr 172.21.15.22:0/1691589856 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f307410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 -- 172.21.15.22:0/1691589856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 msgr2=0x55ae5f304ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f304ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 -- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 msgr2=0x55ae5f307410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f307410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 -- 172.21.15.22:0/1691589856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5efd42b0 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19963d640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff19002a940 tx=0x7ff190031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a95fb754f09e884 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff17cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190035040 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff190004240 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff184005520 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff190004440 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19dc7a740 10 client.15318 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:26.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ae5f316070 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.399+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff184005520 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff190004ce0 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 10 client.15318 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 10 client.15318 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 20 client.15318 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f318640 0x55ae5f319ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 4 client.15318 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae5f270600 con 0x55ae5f318640 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f318640 0x55ae5f319ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f318640 0x55ae5f319ab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd268ef3e84f3f7 server_cookie=bbde01d869211ffa in_seq=0 out_seq=0 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.400+0000 7ff17cff9640 10 client.15318 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff17cff9640 1 -- 172.21.15.22:0/1691589856 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae5f270600 con 0x55ae5f318640 2024-09-11T22:29:26.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff17cff9640 10 client.15318 handle_command_reply: tid=0 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 client.15318 shutdown 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 msgr2=0x55ae5f304760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff19002a940 tx=0x7ff190031900 comp rx=0 tx=0).stop 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 shutdown_connections 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f318640 0x55ae5f319ab0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f307bb0 0x55ae5f304ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f304760 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1691589856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f307410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 >> 172.21.15.22:0/1691589856 conn(0x55ae5f2f8f60 msgr2=0x55ae5f2fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.401+0000 7ff17cff9640 0 client.15318 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.402+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 shutdown_connections 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.402+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1691589856 wait complete. 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.402+0000 7ff19dc7a740 20 client.15318 trim_cache size 0 max 16384 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.419+0000 7ff19dc7a740 1 Processor -- start 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.419+0000 7ff19dc7a740 1 -- start start 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f317f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f317df0 con 0x55ae5f307bb0 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f3184c0 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f318b90 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55096/0 (socket says 172.21.15.22:55096) 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 -- 172.21.15.22:0/2617708956 learned_addr learned my addr 172.21.15.22:0/2617708956 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f317f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 -- 172.21.15.22:0/2617708956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fd2f0 msgr2=0x55ae5f3193e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 -- 172.21.15.22:0/2617708956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 msgr2=0x55ae5f317f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f317f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 -- 172.21.15.22:0/2617708956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5f319040 con 0x55ae5f307bb0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff198e3c640 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff184005870 tx=0x7ff184004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d1cdf1210ba7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff17effd640 1 -- 172.21.15.22:0/2617708956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1840293b0 con 0x55ae5f307bb0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff17effd640 1 -- 172.21.15.22:0/2617708956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff184029a50 con 0x55ae5f307bb0 2024-09-11T22:29:26.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.420+0000 7ff17effd640 1 -- 172.21.15.22:0/2617708956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184010a70 con 0x55ae5f307bb0 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- 172.21.15.22:0/2617708956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 msgr2=0x55ae5f322180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff184005870 tx=0x7ff184004840 comp rx=0 tx=0).stop 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- 172.21.15.22:0/2617708956 shutdown_connections 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f307bb0 0x55ae5f322180 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3193e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/2617708956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f317f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- 172.21.15.22:0/2617708956 >> 172.21.15.22:0/2617708956 conn(0x55ae5f2f8f60 msgr2=0x55ae5f303030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- 172.21.15.22:0/2617708956 shutdown_connections 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- 172.21.15.22:0/2617708956 wait complete. 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 -- start start 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.421+0000 7ff19dc7a740 1 Processor -- start 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f300d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 0x55ae5f384d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f319930 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f319260 con 0x55ae5f307bb0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ae5f31a000 con 0x55ae5f2fc9d0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19dc7a740 10 client.0 _ll_register_callbacks cb 0x7ff190031560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55110/0 (socket says 172.21.15.22:55110) 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 -- 172.21.15.22:0/1375699955 learned_addr learned my addr 172.21.15.22:0/1375699955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f300d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 0x55ae5f384d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 -- 172.21.15.22:0/1375699955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fc9d0 msgr2=0x55ae5f300d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f300d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 -- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 msgr2=0x55ae5f384d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 0x55ae5f384d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff19963d640 1 -- 172.21.15.22:0/1375699955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae5f3852c0 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.422+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 0x55ae5f384d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19963d640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff190003840 tx=0x7ff190001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7c4e0d0bdfe9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190053030 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff190003f70 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff184029a50 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff190035040 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 10 client.15324 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:26.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ae5f386540 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff184029a50 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff190004960 con 0x55ae5f2fd2f0 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 10 client.15324 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 10 client.15324 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 20 client.15324 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f38b170 0x55ae5f389e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 4 client.15324 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.423+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "status"}) -- 0x55ae5f26ab10 con 0x55ae5f38b170 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f38b170 0x55ae5f389e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff198e3c640 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f38b170 0x55ae5f389e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1b8deb2f974881 server_cookie=7b035062c119ac0b in_seq=0 out_seq=0 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff17cff9640 10 client.15324 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff17cff9640 1 -- 172.21.15.22:0/1375699955 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ae5f26ab10 con 0x55ae5f38b170 2024-09-11T22:29:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff17cff9640 10 client.15324 handle_command_reply: tid=0 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 client.15324 shutdown 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 msgr2=0x55ae5f3012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff190003840 tx=0x7ff190001e50 comp rx=0 tx=0).stop 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 shutdown_connections 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ae5f38b170 0x55ae5f389e80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae5f307bb0 0x55ae5f384d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae5f2fd2f0 0x55ae5f3012b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 --2- 172.21.15.22:0/1375699955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ae5f2fc9d0 0x55ae5f300d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 >> 172.21.15.22:0/1375699955 conn(0x55ae5f2f8f60 msgr2=0x55ae5f2f77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.424+0000 7ff17cff9640 0 client.15324 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 shutdown_connections 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19dc7a740 1 -- 172.21.15.22:0/1375699955 wait complete. 2024-09-11T22:29:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19dc7a740 20 client.15324 trim_cache size 0 max 16384 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "c727338c-708b-11ef-bcea-c7b262605968", 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24497, 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 121.61984868899999, 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 20, 2024-09-11T22:29:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 80, 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 132.35185870800001 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 msgr2=0x7ff1800a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 0x7ff1800a52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0cc1e0 tx=0x7ff18c085a80 comp rx=0 tx=0).stop 2024-09-11T22:29:26.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 msgr2=0x7ff1941a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b970 tx=0x7ff18c00be30 comp rx=0 tx=0).stop 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 shutdown_connections 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1800a2e00 0x7ff1800a52c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff194106a60 0x7ff1941a4450 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff194101400 0x7ff194199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 --2- 172.21.15.22:0/2368146068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff194100a60 0x7ff1941993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.425+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 >> 172.21.15.22:0/2368146068 conn(0x7ff1940fc780 msgr2=0x7ff1940fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.426+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 shutdown_connections 2024-09-11T22:29:26.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:26.426+0000 7ff19b8a1640 1 -- 172.21.15.22:0/2368146068 wait complete. 2024-09-11T22:29:26.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:26 smithi169 ceph-mon[35628]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-11T22:29:27.104 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-11T22:29:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:28 smithi045 ceph-mon[35556]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:29:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:28 smithi022 ceph-mon[30966]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:29:28.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:28 smithi169 ceph-mon[35628]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:29:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:30 smithi045 ceph-mon[35556]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T22:29:30.455 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:30 smithi169 ceph-mon[35628]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T22:29:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:30 smithi022 ceph-mon[30966]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-11T22:29:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:32 smithi022 ceph-mon[30966]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:32.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:32 smithi169 ceph-mon[35628]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:32.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:32 smithi045 ceph-mon[35556]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:34.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:34 smithi022 ceph-mon[30966]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:34.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:34 smithi169 ceph-mon[35628]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:34 smithi045 ceph-mon[35556]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:36.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:36 smithi022 ceph-mon[30966]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-11T22:29:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:36 smithi169 ceph-mon[35628]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-11T22:29:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:36 smithi045 ceph-mon[35556]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/4015583054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf41009b0 msgr2=0x7f5bf4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/4015583054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf41009b0 0x7f5bf4100e10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009930 tx=0x7f5be402a420 comp rx=0 tx=0).stop 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/4015583054 shutdown_connections 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/4015583054 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf4101350 0x7f5bf410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/4015583054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf41009b0 0x7f5bf4100e10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/4015583054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 0x7f5bf4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/4015583054 >> 172.21.15.22:0/4015583054 conn(0x7f5bf4077990 msgr2=0x7f5bf40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/4015583054 shutdown_connections 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.704+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/4015583054 wait complete. 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 Processor -- start 2024-09-11T22:29:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 -- start start 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf41009b0 0x7f5bf41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 0x7f5bf419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4110f20 con 0x7f5bf4101350 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4110da0 con 0x7f5bf41069c0 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfc1e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41110a0 con 0x7f5bf41009b0 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57718/0 (socket says 172.21.15.22:57718) 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bf9783640 1 -- 172.21.15.22:0/2162359204 learned_addr learned my addr 172.21.15.22:0/2162359204 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bfa785640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 0x7f5bf419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.705+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf41009b0 0x7f5bf41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 -- 172.21.15.22:0/2162359204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf41009b0 msgr2=0x7f5bf41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf41009b0 0x7f5bf41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 -- 172.21.15.22:0/2162359204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 msgr2=0x7f5bf419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 0x7f5bf419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 -- 172.21.15.22:0/2162359204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf419c2a0 con 0x7f5bf4101350 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bf9783640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009230 tx=0x7f5be4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5beaffd640 1 -- 172.21.15.22:0/2162359204 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be403f030 con 0x7f5bf4101350 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5beaffd640 1 -- 172.21.15.22:0/2162359204 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5be4003af0 con 0x7f5bf4101350 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf419c530 con 0x7f5bf4101350 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5beaffd640 1 -- 172.21.15.22:0/2162359204 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be4035070 con 0x7f5bf4101350 2024-09-11T22:29:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.706+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf41a3e20 con 0x7f5bf4101350 2024-09-11T22:29:37.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5beaffd640 1 -- 172.21.15.22:0/2162359204 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f5be4042030 con 0x7f5bf4101350 2024-09-11T22:29:37.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 Processor -- start 2024-09-11T22:29:37.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 -- start start 2024-09-11T22:29:37.711 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac2b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 0x5615dac35980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac382b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5615dab8d2f0 con 0x5615dac2ad00 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5615dab35270 con 0x5615dac2b620 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.709+0000 7f5bff05e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5615dab892b0 con 0x5615dac35ec0 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bfa785640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac2b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5beaffd640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 0x7f5be00a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bfa785640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac2b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57720/0 (socket says 172.21.15.22:57720) 2024-09-11T22:29:37.712 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bfa785640 1 -- 172.21.15.22:0/2414152842 learned_addr learned my addr 172.21.15.22:0/2414152842 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 0x5615dac35980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9783640 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bfa785640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 0x7f5be00a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5beaffd640 1 -- 172.21.15.22:0/2162359204 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5be40efcf0 con 0x7f5bf4101350 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 -- 172.21.15.22:0/2414152842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 msgr2=0x5615dac382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 -- 172.21.15.22:0/2414152842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 msgr2=0x5615dac2b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac2b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 -- 172.21.15.22:0/2414152842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615dab34340 con 0x5615dac2b620 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 0x5615dac35980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000db70 tx=0x7f5bf000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=376d5af07b26172c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.710+0000 7f5bfa785640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 0x7f5be00a5380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5bec007fd0 tx=0x7f5bec004ab0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bdffff640 1 -- 172.21.15.22:0/2414152842 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000de60 con 0x5615dac2b620 2024-09-11T22:29:37.713 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bdffff640 1 -- 172.21.15.22:0/2414152842 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5bf0005520 con 0x5615dac2b620 2024-09-11T22:29:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bdffff640 1 -- 172.21.15.22:0/2414152842 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0011680 con 0x5615dac2b620 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 -- 172.21.15.22:0/2414152842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 msgr2=0x5615dac35980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 0x5615dac35980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000db70 tx=0x7f5bf000f730 comp rx=0 tx=0).stop 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 -- 172.21.15.22:0/2414152842 shutdown_connections 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2b620 0x5615dac35980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 --2- 172.21.15.22:0/2414152842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac2b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 -- 172.21.15.22:0/2414152842 >> 172.21.15.22:0/2414152842 conn(0x5615dac27270 msgr2=0x5615dac27650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 -- 172.21.15.22:0/2414152842 shutdown_connections 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.711+0000 7f5bff05e740 1 -- 172.21.15.22:0/2414152842 wait complete. 2024-09-11T22:29:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 -- start start 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 Processor -- start 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 0x5615dac32cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac33770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5615dac38a90 con 0x5615dac2b620 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5615dab16290 con 0x5615dac2ad00 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5615dac38c10 con 0x5615dac35ec0 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bff05e740 10 client.0 _ll_register_callbacks cb 0x5615dab47140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57734/0 (socket says 172.21.15.22:57734) 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bf9f84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 0x5615dac32cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.712+0000 7f5bf9783640 1 -- 172.21.15.22:0/4003630490 learned_addr learned my addr 172.21.15.22:0/4003630490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bfa785640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac33770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 -- 172.21.15.22:0/4003630490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 msgr2=0x5615dac33770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac33770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 -- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 msgr2=0x5615dac32cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 0x5615dac32cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 -- 172.21.15.22:0/4003630490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615da8a0210 con 0x5615dac2b620 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 0x5615dac32cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5be40b8610 tx=0x7f5be402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fec8fa5c81c451 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be4049070 con 0x5615dac2b620 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5be403b460 con 0x5615dac2b620 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bf0005520 con 0x5615dac2b620 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5be40bc1b0 con 0x5615dac2b620 2024-09-11T22:29:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bff05e740 10 client.15336 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.713+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5615da96c620 con 0x5615dac2b620 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5bf0005520 con 0x5615dac2b620 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5be40d6070 con 0x5615dac2b620 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 10 client.15336 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 20 client.15336 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dac45be0 0x5615dac47fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 4 client.15336 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615dab9aa20 con 0x5615dac45be0 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.714+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dac45be0 0x5615dac47fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.715+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dac45be0 0x5615dac47fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b75ae02a80fd550d server_cookie=e554d92935aa7e39 in_seq=0 out_seq=0 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.715+0000 7f5bdd7fa640 10 client.15336 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.715+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4003630490 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615dab9aa20 con 0x5615dac45be0 2024-09-11T22:29:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.715+0000 7f5bdd7fa640 10 client.15336 handle_command_reply: tid=0 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.715+0000 7f5bff05e740 1 client.15336 shutdown 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 msgr2=0x5615dac33230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5be40b8610 tx=0x7f5be402a420 comp rx=0 tx=0).stop 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 shutdown_connections 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dac45be0 0x5615dac47fd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac35ec0 0x5615dac33770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac33230 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bdd7fa640 0 client.15336 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4003630490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac2ad00 0x5615dac32cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 >> 172.21.15.22:0/4003630490 conn(0x5615dac27270 msgr2=0x5615dac2cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 shutdown_connections 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 1 -- 172.21.15.22:0/4003630490 wait complete. 2024-09-11T22:29:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.716+0000 7f5bff05e740 20 client.15336 trim_cache size 0 max 16384 2024-09-11T22:29:37.735 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 Processor -- start 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 -- start start 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2ad00 0x5615dac4d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41a94b0 con 0x5615dac2b620 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41abd10 con 0x5615dac35ec0 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bff05e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41a9b00 con 0x5615dac2ad00 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57746/0 (socket says 172.21.15.22:57746) 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 -- 172.21.15.22:0/122560126 learned_addr learned my addr 172.21.15.22:0/122560126 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bfa785640 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2ad00 0x5615dac4d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 -- 172.21.15.22:0/122560126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2ad00 msgr2=0x5615dac4d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2ad00 0x5615dac4d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 -- 172.21.15.22:0/122560126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 msgr2=0x5615dac2ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 -- 172.21.15.22:0/122560126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615dac2b450 con 0x5615dac2b620 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.731+0000 7f5bf9783640 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5be40bc370 tx=0x7f5be40dc2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658ca3d2d27dc2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bdf7fe640 1 -- 172.21.15.22:0/122560126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be4049070 con 0x5615dac2b620 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bdf7fe640 1 -- 172.21.15.22:0/122560126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5be40c0560 con 0x5615dac2b620 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bdf7fe640 1 -- 172.21.15.22:0/122560126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be40ed680 con 0x5615dac2b620 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- 172.21.15.22:0/122560126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 msgr2=0x5615dac4ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5be40bc370 tx=0x7f5be40dc2c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- 172.21.15.22:0/122560126 shutdown_connections 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2b620 0x5615dac4ddb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 --2- 172.21.15.22:0/122560126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2ad00 0x5615dac4d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- 172.21.15.22:0/122560126 >> 172.21.15.22:0/122560126 conn(0x5615dac27270 msgr2=0x5615dac34d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- 172.21.15.22:0/122560126 shutdown_connections 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- 172.21.15.22:0/122560126 wait complete. 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.732+0000 7f5bff05e740 1 -- start start 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 Processor -- start 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2b620 0x5615dac2f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41aa1d0 con 0x5615dac2ad00 2024-09-11T22:29:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41ab640 con 0x5615dac35ec0 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41aa8a0 con 0x5615dac2b620 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bff05e740 10 client.0 _ll_register_callbacks cb 0x7f5be4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57748/0 (socket says 172.21.15.22:57748) 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 -- 172.21.15.22:0/4114620251 learned_addr learned my addr 172.21.15.22:0/4114620251 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bfa785640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2b620 0x5615dac2f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 -- 172.21.15.22:0/4114620251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2b620 msgr2=0x5615dac2f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2b620 0x5615dac2f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 -- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 msgr2=0x5615dac2fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.733+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bf9f84640 1 -- 172.21.15.22:0/4114620251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615dac303a0 con 0x5615dac2ad00 2024-09-11T22:29:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bf9f84640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0004e50 tx=0x7f5bf000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831db6241acd6471 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000de60 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5bf0004680 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be40c0560 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5bf0036050 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bff05e740 10 client.15342 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5615dacb0840 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5be40c0560 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5bf0005290 con 0x5615dac2ad00 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.734+0000 7f5bff05e740 10 client.15342 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bff05e740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bff05e740 20 client.15342 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dacb0b70 0x5615dacb2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bff05e740 4 client.15342 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:29:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615dab94d70 con 0x5615dacb0b70 2024-09-11T22:29:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dacb0b70 0x5615dacb2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bdd7fa640 10 client.15342 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.735+0000 7f5bf9783640 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dacb0b70 0x5615dacb2f90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=129d9468047e72cf server_cookie=c45d8e45a2dc0a80 in_seq=0 out_seq=0 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bdd7fa640 1 -- 172.21.15.22:0/4114620251 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615dab94d70 con 0x5615dacb0b70 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bdd7fa640 10 client.15342 handle_command_reply: tid=0 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 client.15342 shutdown 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 msgr2=0x5615dac3e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0004e50 tx=0x7f5bf000fce0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 shutdown_connections 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5615dacb0b70 0x5615dacb2f90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5615dac35ec0 0x5615dac2fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5615dac2b620 0x5615dac2f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bdd7fa640 0 client.15342 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 --2- 172.21.15.22:0/4114620251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615dac2ad00 0x5615dac3e450 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 >> 172.21.15.22:0/4114620251 conn(0x5615dac27270 msgr2=0x5615dac32cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 shutdown_connections 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 1 -- 172.21.15.22:0/4114620251 wait complete. 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.739+0000 7f5bff05e740 20 client.15342 trim_cache size 0 max 16384 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:29:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:29:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 msgr2=0x7f5be00a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 0x7f5be00a5380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5bec007fd0 tx=0x7f5bec004ab0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 msgr2=0x7f5bf41977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009230 tx=0x7f5be4004270 comp rx=0 tx=0).stop 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 shutdown_connections 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5be00a2ec0 0x7f5be00a5380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bf41069c0 0x7f5bf419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5bf4101350 0x7f5bf41977f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 --2- 172.21.15.22:0/2162359204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5bf41009b0 0x7f5bf41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 >> 172.21.15.22:0/2162359204 conn(0x7f5bf4077990 msgr2=0x7f5bf4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 shutdown_connections 2024-09-11T22:29:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:37.740+0000 7f5bfc1e8640 1 -- 172.21.15.22:0/2162359204 wait complete. 2024-09-11T22:29:38.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:38 smithi022 ceph-mon[30966]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:38 smithi169 ceph-mon[35628]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:38 smithi045 ceph-mon[35556]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-11T22:29:40.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:40 smithi022 ceph-mon[30966]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-11T22:29:40.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:40 smithi169 ceph-mon[35628]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-11T22:29:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:40 smithi045 ceph-mon[35556]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-11T22:29:41.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:29:42.105 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-11T22:29:42.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:42.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:42 smithi022 ceph-mon[30966]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:29:42.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:42 smithi169 ceph-mon[35628]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:29:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:42 smithi045 ceph-mon[35556]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:29:42.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 -- 172.21.15.22:0/2535515677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f101027c0 msgr2=0x7f2f10106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 --2- 172.21.15.22:0/2535515677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f101027c0 0x7f2f10106810 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009900 tx=0x7f2f0002a410 comp rx=0 tx=0).stop 2024-09-11T22:29:42.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 -- 172.21.15.22:0/2535515677 shutdown_connections 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 --2- 172.21.15.22:0/2535515677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10106f40 0x7f2f1010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 --2- 172.21.15.22:0/2535515677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f101027c0 0x7f2f10106810 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 --2- 172.21.15.22:0/2535515677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10101e10 0x7f2f101021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 -- 172.21.15.22:0/2535515677 >> 172.21.15.22:0/2535515677 conn(0x7f2f100fd8d0 msgr2=0x7f2f100ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 -- 172.21.15.22:0/2535515677 shutdown_connections 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.742+0000 7f2f17683640 1 -- 172.21.15.22:0/2535515677 wait complete. 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.743+0000 7f2f17683640 1 Processor -- start 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.743+0000 7f2f17683640 1 -- start start 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f101027c0 0x7f2f10198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10106f40 0x7f2f1019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101120c0 con 0x7f2f10101e10 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111f40 con 0x7f2f10106f40 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f17683640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10112240 con 0x7f2f101027c0 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57762/0 (socket says 172.21.15.22:57762) 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 -- 172.21.15.22:0/1682181569 learned_addr learned my addr 172.21.15.22:0/1682181569 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f101027c0 0x7f2f10198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f15c20640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10106f40 0x7f2f1019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 -- 172.21.15.22:0/1682181569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f101027c0 msgr2=0x7f2f10198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f101027c0 0x7f2f10198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 -- 172.21.15.22:0/1682181569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10106f40 msgr2=0x7f2f1019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10106f40 0x7f2f1019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 -- 172.21.15.22:0/1682181569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1019d4d0 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.744+0000 7f2f1541f640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00d950 tx=0x7f2f0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.745+0000 7f2f067fc640 1 -- 172.21.15.22:0/1682181569 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c017070 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.745+0000 7f2f067fc640 1 -- 172.21.15.22:0/1682181569 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f0c009c30 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.745+0000 7f2f067fc640 1 -- 172.21.15.22:0/1682181569 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00f740 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.745+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1019d7c0 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.745+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f101a50a0 con 0x7f2f10101e10 2024-09-11T22:29:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.747+0000 7f2f067fc640 1 -- 172.21.15.22:0/1682181569 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f2f0c010a80 con 0x7f2f10101e10 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.747+0000 7f2f19a5c740 1 Processor -- start 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 -- start start 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 0x55e25fed8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fee7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fee9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e25fe3e2e0 con 0x55e25fed8cc0 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e25fde5ce0 con 0x55e25fee7a90 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e25fe3a2a0 con 0x55e25fed83a0 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fee7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f15c20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 0x55e25fed8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f15c20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 0x55e25fed8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:45476/0 (socket says 172.21.15.22:45476) 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f15c20640 1 -- 172.21.15.22:0/3890326877 learned_addr learned my addr 172.21.15.22:0/3890326877 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.748+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fee9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f067fc640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 0x7f2efc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 -- 172.21.15.22:0/3890326877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 msgr2=0x55e25fed8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 0x55e25fed8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 -- 172.21.15.22:0/3890326877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 msgr2=0x55e25fee9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fee9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 -- 172.21.15.22:0/3890326877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e25fdca440 con 0x55e25fed8cc0 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f15c20640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 0x7f2efc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f067fc640 1 -- 172.21.15.22:0/1682181569 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2f0c0cf0a0 con 0x7f2f10101e10 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f1541f640 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fee7550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0cc820 tx=0x7f2f0c0b0b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3ce6fcddd0883 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2efb7fe640 1 -- 172.21.15.22:0/3890326877 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c020030 con 0x55e25fed8cc0 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2efb7fe640 1 -- 172.21.15.22:0/3890326877 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f0c0bb050 con 0x55e25fed8cc0 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2f15c20640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 0x7f2efc0a5240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005f40 tx=0x7f2f08004a40 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.749+0000 7f2efb7fe640 1 -- 172.21.15.22:0/3890326877 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c09b130 con 0x55e25fed8cc0 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 -- 172.21.15.22:0/3890326877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 msgr2=0x55e25fee7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fee7550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0cc820 tx=0x7f2f0c0b0b00 comp rx=0 tx=0).stop 2024-09-11T22:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 -- 172.21.15.22:0/3890326877 shutdown_connections 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fee9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fee7550 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/3890326877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fed83a0 0x55e25fed8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 -- 172.21.15.22:0/3890326877 >> 172.21.15.22:0/3890326877 conn(0x55e25fed4a30 msgr2=0x55e25fed4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 -- 172.21.15.22:0/3890326877 shutdown_connections 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.750+0000 7f2f19a5c740 1 -- 172.21.15.22:0/3890326877 wait complete. 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 -- start start 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 Processor -- start 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fee4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 0x55e25fee4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e25feea6c0 con 0x55e25fed83a0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e25fdf9050 con 0x55e25fed8cc0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e25feea840 con 0x55e25fee7a90 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f19a5c740 10 client.0 _ll_register_callbacks cb 0x55e25fe39160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57776/0 (socket says 172.21.15.22:57776) 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.751+0000 7f2f1541f640 1 -- 172.21.15.22:0/536650253 learned_addr learned my addr 172.21.15.22:0/536650253 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fee4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f15c20640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 0x55e25fee4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 -- 172.21.15.22:0/536650253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 msgr2=0x55e25fee4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 0x55e25fee4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 -- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 msgr2=0x55e25fee4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fee4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 -- 172.21.15.22:0/536650253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e25fbaf3c0 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f15c20640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 0x55e25fee4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fee4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f1541f640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c097fc0 tx=0x7f2f0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a03baaacdbce44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c020070 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2f0c0ccad0 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0c0bb050 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c0a2eb0 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f19a5c740 10 client.15354 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.752+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e25fef6120 con 0x55e25fed83a0 2024-09-11T22:29:42.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f0c0bb050 con 0x55e25fed83a0 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2f0c0a20e0 con 0x55e25fed83a0 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 10 client.15354 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 10 client.15354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 20 client.15354 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25fef7470 0x55e25fef9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 4 client.15354 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e25fe4b850 con 0x55e25fef7470 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.753+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25fef7470 0x55e25fef9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.754+0000 7f2ef8ff9640 10 client.15354 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.754+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25fef7470 0x55e25fef9860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d9e0f1ad16d8b9d server_cookie=a891ccb355e8023 in_seq=0 out_seq=0 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.754+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/536650253 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e25fe4b850 con 0x55e25fef7470 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.754+0000 7f2ef8ff9640 10 client.15354 handle_command_reply: tid=0 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.754+0000 7f2f19a5c740 1 client.15354 shutdown 2024-09-11T22:29:42.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 msgr2=0x55e25fee7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c097fc0 tx=0x7f2f0c005880 comp rx=0 tx=0).stop 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 shutdown_connections 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25fef7470 0x55e25fef9860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fee7a90 0x55e25fee4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fee4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2ef8ff9640 0 client.15354 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/536650253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed83a0 0x55e25fee7450 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 >> 172.21.15.22:0/536650253 conn(0x55e25fed4a30 msgr2=0x55e25feda790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 shutdown_connections 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 1 -- 172.21.15.22:0/536650253 wait complete. 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.755+0000 7f2f19a5c740 20 client.15354 trim_cache size 0 max 16384 2024-09-11T22:29:42.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 Processor -- start 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 -- start start 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 0x55e25fefcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fee1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101a9680 con 0x55e25fee7a90 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101abee0 con 0x55e25fed8cc0 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101a9cd0 con 0x55e25fef7470 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f14c1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 0x55e25fefcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:34162/0 (socket says 172.21.15.22:34162) 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f1541f640 1 -- 172.21.15.22:0/74891009 learned_addr learned my addr 172.21.15.22:0/74891009 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.773+0000 7f2f15c20640 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fee1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 -- 172.21.15.22:0/74891009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 msgr2=0x55e25fee1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fee1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 -- 172.21.15.22:0/74891009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 msgr2=0x55e25fefcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 0x55e25fefcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 -- 172.21.15.22:0/74891009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e25fed9230 con 0x55e25fed8cc0 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 0x55e25fefcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2f1541f640 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c09b580 tx=0x7f2f0c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a480f61d8b5f1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2efaffd640 1 -- 172.21.15.22:0/74891009 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c020040 con 0x55e25fed8cc0 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2efaffd640 1 -- 172.21.15.22:0/74891009 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f0c0bb040 con 0x55e25fed8cc0 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.774+0000 7f2efaffd640 1 -- 172.21.15.22:0/74891009 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a3b10 con 0x55e25fed8cc0 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 -- 172.21.15.22:0/74891009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 msgr2=0x55e25fefc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c09b580 tx=0x7f2f0c00bf60 comp rx=0 tx=0).stop 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 -- 172.21.15.22:0/74891009 shutdown_connections 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fee1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fee7a90 0x55e25fefcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/74891009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fed8cc0 0x55e25fefc880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 -- 172.21.15.22:0/74891009 >> 172.21.15.22:0/74891009 conn(0x55e25fed4a30 msgr2=0x55e25fee6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 -- 172.21.15.22:0/74891009 shutdown_connections 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.775+0000 7f2f19a5c740 1 -- 172.21.15.22:0/74891009 wait complete. 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 -- start start 2024-09-11T22:29:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 Processor -- start 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fefa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fefa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101aa3a0 con 0x55e25fed8cc0 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101ab810 con 0x55e25fee7a90 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101aaa70 con 0x55e25fef7470 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f19a5c740 10 client.0 _ll_register_callbacks cb 0x7f2f08009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f1541f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57786/0 (socket says 172.21.15.22:57786) 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f1541f640 1 -- 172.21.15.22:0/2591861422 learned_addr learned my addr 172.21.15.22:0/2591861422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.776+0000 7f2f15c20640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fefa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fefa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 -- 172.21.15.22:0/2591861422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 msgr2=0x55e25fefa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fefa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 -- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 msgr2=0x55e25fefa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fefa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 -- 172.21.15.22:0/2591861422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e25fefb010 con 0x55e25fed8cc0 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fefa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f15c20640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fefa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f1541f640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c09f910 tx=0x7f2f0c09b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa10a15e4b65d375 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c020070 con 0x55e25fed8cc0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2f0c0d2a30 con 0x55e25fed8cc0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0c0bb040 con 0x55e25fed8cc0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c09af50 con 0x55e25fed8cc0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f19a5c740 10 client.15360 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e25fefb010 con 0x55e25fed8cc0 2024-09-11T22:29:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.777+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f0c0bb040 con 0x55e25fed8cc0 2024-09-11T22:29:42.810 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:42.810 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:29:42.810 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:29:42.810 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2f0c097340 con 0x55e25fed8cc0 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 10 client.15360 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 10 client.15360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 20 client.15360 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25ff61ff0 0x55e25ff643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 4 client.15360 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e25fe45d60 con 0x55e25ff61ff0 2024-09-11T22:29:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.778+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25ff61ff0 0x55e25ff643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2ef8ff9640 10 client.15360 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f14c1e640 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25ff61ff0 0x55e25ff643e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722f6f7dc7c571cb server_cookie=3b009657db1b3d42 in_seq=0 out_seq=0 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2ef8ff9640 1 -- 172.21.15.22:0/2591861422 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e25fe45d60 con 0x55e25ff61ff0 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2ef8ff9640 10 client.15360 handle_command_reply: tid=0 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 client.15360 shutdown 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 msgr2=0x55e25fefcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c09f910 tx=0x7f2f0c09b6c0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 shutdown_connections 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e25ff61ff0 0x55e25ff643e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e25fef7470 0x55e25fefa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2ef8ff9640 0 client.15360 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e25fee7a90 0x55e25fefa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 --2- 172.21.15.22:0/2591861422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e25fed8cc0 0x55e25fefcf00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 >> 172.21.15.22:0/2591861422 conn(0x55e25fed4a30 msgr2=0x55e25fee2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 shutdown_connections 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 1 -- 172.21.15.22:0/2591861422 wait complete. 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.779+0000 7f2f19a5c740 20 client.15360 trim_cache size 0 max 16384 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 msgr2=0x7f2efc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 0x7f2efc0a5240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005f40 tx=0x7f2f08004a40 comp rx=0 tx=0).stop 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 msgr2=0x7f2f10198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00d950 tx=0x7f2f0c00de10 comp rx=0 tx=0).stop 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 shutdown_connections 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f2efc0a2d80 0x7f2efc0a5240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f10106f40 0x7f2f1019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f101027c0 0x7f2f10198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 --2- 172.21.15.22:0/1682181569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f10101e10 0x7f2f10198520 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 >> 172.21.15.22:0/1682181569 conn(0x7f2f100fd8d0 msgr2=0x7f2f100febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 shutdown_connections 2024-09-11T22:29:42.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:42.780+0000 7f2f17683640 1 -- 172.21.15.22:0/1682181569 wait complete. 2024-09-11T22:29:43.037 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:43.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:43 smithi022 ceph-mon[30966]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:43.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:43 smithi169 ceph-mon[35628]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:43.661 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:29:43.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:43.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:43 smithi045 ceph-mon[35556]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 -- 172.21.15.22:0/1693021006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 msgr2=0x7f6d8c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 --2- 172.21.15.22:0/1693021006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c10da40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009ca0 tx=0x7f6d8402a950 comp rx=0 tx=0).stop 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 -- 172.21.15.22:0/1693021006 shutdown_connections 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 --2- 172.21.15.22:0/1693021006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c10da40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 --2- 172.21.15.22:0/1693021006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c102570 0x7f6d8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 --2- 172.21.15.22:0/1693021006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c100e20 0x7f6d8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 -- 172.21.15.22:0/1693021006 >> 172.21.15.22:0/1693021006 conn(0x7f6d8c0fc7d0 msgr2=0x7f6d8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 -- 172.21.15.22:0/1693021006 shutdown_connections 2024-09-11T22:29:44.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.195+0000 7f6d945eb640 1 -- 172.21.15.22:0/1693021006 wait complete. 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 Processor -- start 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 -- start start 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 0x7f6d8c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c102570 0x7f6d8c199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c1110a0 con 0x7f6d8c102ef0 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c110f20 con 0x7f6d8c100e20 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d945eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c111220 con 0x7f6d8c102570 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.196+0000 7f6d92b88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59006/0 (socket says 172.21.15.22:59006) 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 -- 172.21.15.22:0/976618270 learned_addr learned my addr 172.21.15.22:0/976618270 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92387640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 0x7f6d8c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:44.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d91b86640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c102570 0x7f6d8c199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 -- 172.21.15.22:0/976618270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c102570 msgr2=0x7f6d8c199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c102570 0x7f6d8c199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 -- 172.21.15.22:0/976618270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 msgr2=0x7f6d8c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 0x7f6d8c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 -- 172.21.15.22:0/976618270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c1a49f0 con 0x7f6d8c102ef0 2024-09-11T22:29:44.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92387640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 0x7f6d8c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d92b88640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6d84005cc0 tx=0x7f6d8402f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84034040 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d84030940 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c1a4bc0 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.197+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84045480 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.198+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c1a5070 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.199+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c101200 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.200+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f6d84037020 con 0x7f6d8c102ef0 2024-09-11T22:29:44.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.201+0000 7f6d837fe640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 0x7f6d780a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.201+0000 7f6d92387640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 0x7f6d780a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.201+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6d840f0370 con 0x7f6d8c102ef0 2024-09-11T22:29:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.201+0000 7f6d92387640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 0x7f6d780a52c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d880058c0 tx=0x7f6d8800a250 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:44.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.205+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d840bcf80 con 0x7f6d8c102ef0 2024-09-11T22:29:44.275 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.439+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d8c1a52a0 con 0x7f6d8c102ef0 2024-09-11T22:29:44.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.440+0000 7f6d837fe640 1 -- 172.21.15.22:0/976618270 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f6d840bc880 con 0x7f6d8c102ef0 2024-09-11T22:29:44.824 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:44.824 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:44.824 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:44.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 msgr2=0x7f6d780a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 0x7f6d780a52c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d880058c0 tx=0x7f6d8800a250 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 msgr2=0x7f6d8c1a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6d84005cc0 tx=0x7f6d8402f720 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 shutdown_connections 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6d780a2e00 0x7f6d780a52c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c1a44b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d8c102570 0x7f6d8c199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 --2- 172.21.15.22:0/976618270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d8c100e20 0x7f6d8c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.442+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 >> 172.21.15.22:0/976618270 conn(0x7f6d8c0fc7d0 msgr2=0x7f6d8c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.443+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 shutdown_connections 2024-09-11T22:29:44.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:44.443+0000 7f6d945eb640 1 -- 172.21.15.22:0/976618270 wait complete. 2024-09-11T22:29:45.261 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-11T22:29:45.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-11T22:29:45.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:45 smithi022 ceph-mon[30966]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:45.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:45 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/976618270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:45.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 -- 172.21.15.22:0/3178961361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26810c160 msgr2=0x7fc26810e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/3178961361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26810c160 0x7fc26810e5e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc260009ca0 tx=0x7fc26002a950 comp rx=0 tx=0).stop 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 -- 172.21.15.22:0/3178961361 shutdown_connections 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/3178961361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26810c160 0x7fc26810e5e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/3178961361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2681036a0 0x7fc26810bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/3178961361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc268103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 -- 172.21.15.22:0/3178961361 >> 172.21.15.22:0/3178961361 conn(0x7fc2680fc780 msgr2=0x7fc2680feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 -- 172.21.15.22:0/3178961361 shutdown_connections 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.517+0000 7fc26e8c1640 1 -- 172.21.15.22:0/3178961361 wait complete. 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.518+0000 7fc26e8c1640 1 Processor -- start 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.518+0000 7fc26e8c1640 1 -- start start 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc26819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26810c160 0x7fc26819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc268112060 con 0x7fc2681036a0 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc268111ee0 con 0x7fc26810c160 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26e8c1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681121e0 con 0x7fc268102d80 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc267fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc26819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59014/0 (socket says 172.21.15.22:59014) 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 -- 172.21.15.22:0/337477857 learned_addr learned my addr 172.21.15.22:0/337477857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc26ce5e640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26810c160 0x7fc26819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 -- 172.21.15.22:0/337477857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 msgr2=0x7fc26819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc26819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 -- 172.21.15.22:0/337477857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26810c160 msgr2=0x7fc26819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26810c160 0x7fc26819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc2677fe640 1 -- 172.21.15.22:0/337477857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26819f650 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.519+0000 7fc267fff640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc26819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc2677fe640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00d950 tx=0x7fc25c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c017030 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc25c004020 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26819f940 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c004a00 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.520+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2681a7220 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.521+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc268103160 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.522+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fc25c0041d0 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.523+0000 7fc2657fa640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 0x7fc2500a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.523+0000 7fc267fff640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 0x7fc2500a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.523+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc25c0cee80 con 0x7fc2681036a0 2024-09-11T22:29:45.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.524+0000 7fc267fff640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 0x7fc2500a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc258009fc0 tx=0x7fc258005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:45.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.527+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc25c09b980 con 0x7fc2681036a0 2024-09-11T22:29:45.644 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:45.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:45 smithi045 ceph-mon[35556]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:45.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:45 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/976618270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:45.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.758+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2681a74c0 con 0x7fc2681036a0 2024-09-11T22:29:45.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.758+0000 7fc2657fa640 1 -- 172.21.15.22:0/337477857 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7fc25c09b280 con 0x7fc2681036a0 2024-09-11T22:29:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:29:45.760 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:29:45.760 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:29:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.760+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 msgr2=0x7fc2500a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.760+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 0x7fc2500a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc258009fc0 tx=0x7fc258005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.760+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 msgr2=0x7fc26819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.760+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00d950 tx=0x7fc25c00de10 comp rx=0 tx=0).stop 2024-09-11T22:29:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 shutdown_connections 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2500a2d80 0x7fc2500a5240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc26810c160 0x7fc26819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2681036a0 0x7fc26819abe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 --2- 172.21.15.22:0/337477857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc268102d80 0x7fc26819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 >> 172.21.15.22:0/337477857 conn(0x7fc2680fc780 msgr2=0x7fc2680fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 shutdown_connections 2024-09-11T22:29:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:45.761+0000 7fc26e8c1640 1 -- 172.21.15.22:0/337477857 wait complete. 2024-09-11T22:29:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:45 smithi169 ceph-mon[35628]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:45 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/976618270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:46.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:29:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:46 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/337477857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:46.718 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:46 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/337477857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:46.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 -- 172.21.15.22:0/3331346901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e00103ff0 msgr2=0x7f7e001043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/3331346901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e00103ff0 0x7f7e001043d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009900 tx=0x7f7df002a410 comp rx=0 tx=0).stop 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 -- 172.21.15.22:0/3331346901 shutdown_connections 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/3331346901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e00110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/3331346901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e001049a0 0x7f7e001089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/3331346901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e00103ff0 0x7f7e001043d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 -- 172.21.15.22:0/3331346901 >> 172.21.15.22:0/3331346901 conn(0x7f7e000ffab0 msgr2=0x7f7e00101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 -- 172.21.15.22:0/3331346901 shutdown_connections 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.816+0000 7f7e04ce8640 1 -- 172.21.15.22:0/3331346901 wait complete. 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 Processor -- start 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 -- start start 2024-09-11T22:29:46.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 0x7f7e0019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e0019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001142b0 con 0x7f7e001049a0 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00114130 con 0x7f7e00109120 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.817+0000 7f7e04ce8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00114430 con 0x7f7e00103ff0 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59024/0 (socket says 172.21.15.22:59024) 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/968749576 learned_addr learned my addr 172.21.15.22:0/968749576 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 0x7f7e0019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e0019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/968749576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 msgr2=0x7f7e0019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 0x7f7e0019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/968749576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 msgr2=0x7f7e0019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e0019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/968749576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0019f620 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 0x7f7e0019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e0019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c920 tx=0x7f7df400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.818+0000 7f7def7fe640 1 -- 172.21.15.22:0/968749576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4007c70 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.819+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0019f910 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.819+0000 7f7def7fe640 1 -- 172.21.15.22:0/968749576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df4007e10 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.819+0000 7f7def7fe640 1 -- 172.21.15.22:0/968749576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4018940 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.819+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e001a71f0 con 0x7f7e001049a0 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 Processor -- start 2024-09-11T22:29:46.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 -- start start 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466847b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x558466854d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5584667ad2a0 con 0x558466848080 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558466754b10 con 0x558466852940 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7e070c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5584667a9260 con 0x558466847760 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.822+0000 7f7def7fe640 1 -- 172.21.15.22:0/968749576 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f7df4018b20 con 0x7f7e001049a0 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.823+0000 7f7dfe59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.823+0000 7f7dfe59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59030/0 (socket says 172.21.15.22:59030) 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.823+0000 7f7dfe59c640 1 -- 172.21.15.22:0/2730201009 learned_addr learned my addr 172.21.15.22:0/2730201009 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.823+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466847b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.823+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x558466854d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 -- 172.21.15.22:0/2730201009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 msgr2=0x558466847b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466847b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 -- 172.21.15.22:0/2730201009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 msgr2=0x558466854d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x558466854d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 -- 172.21.15.22:0/2730201009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55846651eb90 con 0x558466848080 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x558466854d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009900 tx=0x7f7df00040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30ca39e7964d04a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.824+0000 7f7def7fe640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 0x7f7de80a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.825+0000 7f7decff9640 1 -- 172.21.15.22:0/2730201009 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df003f070 con 0x558466848080 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.825+0000 7f7decff9640 1 -- 172.21.15.22:0/2730201009 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df0005520 con 0x558466848080 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.825+0000 7f7decff9640 1 -- 172.21.15.22:0/2730201009 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0035070 con 0x558466848080 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.825+0000 7f7def7fe640 1 -- 172.21.15.22:0/968749576 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7df40cf7a0 con 0x7f7e001049a0 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.825+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 0x7f7de80a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 -- 172.21.15.22:0/2730201009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 msgr2=0x558466852400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009900 tx=0x7f7df00040f0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 0x7f7de80a5340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7df8017fd0 tx=0x7f7df800a6b0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 -- 172.21.15.22:0/2730201009 shutdown_connections 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x558466854d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x558466852400 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 --2- 172.21.15.22:0/2730201009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466847b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 -- 172.21.15.22:0/2730201009 >> 172.21.15.22:0/2730201009 conn(0x558466843cf0 msgr2=0x5584668440d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 -- 172.21.15.22:0/2730201009 shutdown_connections 2024-09-11T22:29:46.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.826+0000 7f7e070c1740 1 -- 172.21.15.22:0/2730201009 wait complete. 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 -- start start 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 Processor -- start 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x55846684fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558466855510 con 0x558466852940 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5584667356e0 con 0x558466848080 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558466855690 con 0x558466847760 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7e070c1740 10 client.0 _ll_register_callbacks cb 0x558466759a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7dfed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7dfed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59044/0 (socket says 172.21.15.22:59044) 2024-09-11T22:29:46.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7dfed9d640 1 -- 172.21.15.22:0/4183821130 learned_addr learned my addr 172.21.15.22:0/4183821130 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x55846684fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.827+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 -- 172.21.15.22:0/4183821130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 msgr2=0x55846684f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 -- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 msgr2=0x55846684fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x55846684fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 -- 172.21.15.22:0/4183821130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55846685ea30 con 0x558466852940 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7df8025660 tx=0x7f7df8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0959bea1a0a91f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7de5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8032060 con 0x558466852940 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7df801d030 con 0x558466852940 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.828+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df0005520 con 0x558466852940 2024-09-11T22:29:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7df8023780 con 0x558466852940 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 10 client.15384 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558466861400 con 0x558466852940 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df0005520 con 0x558466852940 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7df802dce0 con 0x558466852940 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 10 client.15384 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 10 client.15384 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 20 client.15384 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668628c0 0x558466864d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 4 client.15384 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584667ba9d0 con 0x5584668628c0 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.829+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668628c0 0x558466864d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.830+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668628c0 0x558466864d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4423d6a00b79e6 server_cookie=2c3e32e09e044713 in_seq=0 out_seq=0 2024-09-11T22:29:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.830+0000 7f7de5ffb640 10 client.15384 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7de5ffb640 1 -- 172.21.15.22:0/4183821130 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584667ba9d0 con 0x5584668628c0 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7de5ffb640 10 client.15384 handle_command_reply: tid=0 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 client.15384 shutdown 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 msgr2=0x5584668502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7df8025660 tx=0x7f7df8004ab0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 shutdown_connections 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668628c0 0x558466864d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668502c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x55846684fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 --2- 172.21.15.22:0/4183821130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7de5ffb640 0 client.15384 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 >> 172.21.15.22:0/4183821130 conn(0x558466843cf0 msgr2=0x5584668499d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 shutdown_connections 2024-09-11T22:29:46.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 1 -- 172.21.15.22:0/4183821130 wait complete. 2024-09-11T22:29:46.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.831+0000 7f7e070c1740 20 client.15384 trim_cache size 0 max 16384 2024-09-11T22:29:46.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 Processor -- start 2024-09-11T22:29:46.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 -- start start 2024-09-11T22:29:46.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x55846686ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001a9540 con 0x558466848080 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001abda0 con 0x558466852940 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7e070c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001a9b90 con 0x558466847760 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59046/0 (socket says 172.21.15.22:59046) 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/1922417539 learned_addr learned my addr 172.21.15.22:0/1922417539 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.849+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x55846686ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/1922417539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 msgr2=0x55846684e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/1922417539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 msgr2=0x55846686ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x55846686ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 -- 172.21.15.22:0/1922417539 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55846684b1c0 con 0x558466848080 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7df409b840 tx=0x7f7df4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d767e12c6c49ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7de7fff640 1 -- 172.21.15.22:0/1922417539 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df409c240 con 0x558466848080 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7de7fff640 1 -- 172.21.15.22:0/1922417539 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df409bb40 con 0x558466848080 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.850+0000 7f7de7fff640 1 -- 172.21.15.22:0/1922417539 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40cd0d0 con 0x558466848080 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 -- 172.21.15.22:0/1922417539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 msgr2=0x55846686a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7df409b840 tx=0x7f7df4000bc0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 -- 172.21.15.22:0/1922417539 shutdown_connections 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466852940 0x55846686ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466848080 0x55846686a5e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 --2- 172.21.15.22:0/1922417539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x55846684e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 -- 172.21.15.22:0/1922417539 >> 172.21.15.22:0/1922417539 conn(0x558466843cf0 msgr2=0x5584668518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 -- 172.21.15.22:0/1922417539 shutdown_connections 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.851+0000 7f7e070c1740 1 -- 172.21.15.22:0/1922417539 wait complete. 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 -- start start 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 Processor -- start 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466856cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x558466857200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001aa260 con 0x558466852940 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001ab6d0 con 0x558466848080 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001aa930 con 0x558466847760 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7e070c1740 10 client.0 _ll_register_callbacks cb 0x7f7df800ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7dfed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7dfed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59052/0 (socket says 172.21.15.22:59052) 2024-09-11T22:29:46.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7dfed9d640 1 -- 172.21.15.22:0/3037019743 learned_addr learned my addr 172.21.15.22:0/3037019743 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466856cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.852+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x558466857200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 -- 172.21.15.22:0/3037019743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 msgr2=0x558466856cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466856cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 -- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 msgr2=0x558466857200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x558466857200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 -- 172.21.15.22:0/3037019743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55846684e7f0 con 0x558466852940 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfdd9b640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x558466857200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7dfed9d640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7df8000f80 tx=0x7f7df80233f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8acdefdb9d28c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7de5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8023920 con 0x558466852940 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7df8023ac0 con 0x558466852940 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df409bb40 con 0x558466852940 2024-09-11T22:29:46.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7df8032020 con 0x558466852940 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7e070c1740 10 client.15390 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.853+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5584668cdb40 con 0x558466852940 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df409bb40 con 0x558466852940 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7df803f020 con 0x558466852940 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 10 client.15390 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 10 client.15390 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 20 client.15390 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668ce320 0x5584668d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 4 client.15390 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.854+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5584667b4d20 con 0x5584668ce320 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.855+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668ce320 0x5584668d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.855+0000 7f7de5ffb640 10 client.15390 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:46.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.855+0000 7f7dfe59c640 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668ce320 0x5584668d0740 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6b3724b238b13c server_cookie=9b8945f5347d448d in_seq=0 out_seq=0 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7de5ffb640 1 -- 172.21.15.22:0/3037019743 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5584667b4d20 con 0x5584668ce320 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7de5ffb640 10 client.15390 handle_command_reply: tid=0 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 client.15390 shutdown 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 msgr2=0x5584668cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7df8000f80 tx=0x7f7df80233f0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 shutdown_connections 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5584668ce320 0x5584668d0740 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7de5ffb640 0 client.15390 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558466852940 0x5584668cc5b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558466848080 0x558466857200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 --2- 172.21.15.22:0/3037019743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558466847760 0x558466856cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 >> 172.21.15.22:0/3037019743 conn(0x558466843cf0 msgr2=0x5584668491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 shutdown_connections 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.864+0000 7f7e070c1740 1 -- 172.21.15.22:0/3037019743 wait complete. 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e070c1740 20 client.15390 trim_cache size 0 max 16384 2024-09-11T22:29:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 20, 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 2, 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "3797d11a": { 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 2, 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:29:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 msgr2=0x7f7de80a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 0x7f7de80a5340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7df8017fd0 tx=0x7f7df800a6b0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 msgr2=0x7f7e0019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c920 tx=0x7f7df400cde0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 shutdown_connections 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7de80a2e80 0x7f7de80a5340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00109120 0x7f7e0019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e001049a0 0x7f7e0019abb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 --2- 172.21.15.22:0/968749576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e00103ff0 0x7f7e0019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.865+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 >> 172.21.15.22:0/968749576 conn(0x7f7e000ffab0 msgr2=0x7f7e00100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.866+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 shutdown_connections 2024-09-11T22:29:46.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:46.866+0000 7f7e04ce8640 1 -- 172.21.15.22:0/968749576 wait complete. 2024-09-11T22:29:46.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:46 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/337477857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:47 smithi022 ceph-mon[30966]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:47.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:47 smithi045 ceph-mon[35556]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:47.684 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:47.709 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3797d11a', quiesce took 5.6 seconds. Will release after: 18.9 2024-09-11T22:29:47.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:47 smithi169 ceph-mon[35628]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:29:48.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 -- 172.21.15.22:0/617752585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 msgr2=0x7f607c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 --2- 172.21.15.22:0/617752585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c101200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6078009900 tx=0x7f607802a480 comp rx=0 tx=0).stop 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 -- 172.21.15.22:0/617752585 shutdown_connections 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 --2- 172.21.15.22:0/617752585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102ef0 0x7f607c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 --2- 172.21.15.22:0/617752585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102570 0x7f607c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 --2- 172.21.15.22:0/617752585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c101200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 -- 172.21.15.22:0/617752585 >> 172.21.15.22:0/617752585 conn(0x7f607c0fc7d0 msgr2=0x7f607c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 -- 172.21.15.22:0/617752585 shutdown_connections 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.211+0000 7f60843a2640 1 -- 172.21.15.22:0/617752585 wait complete. 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.212+0000 7f60843a2640 1 Processor -- start 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.212+0000 7f60843a2640 1 -- start start 2024-09-11T22:29:48.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.212+0000 7f60843a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f60843a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102570 0x7f607c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f60843a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102ef0 0x7f607c19d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f60843a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1110e0 con 0x7f607c100e20 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f60843a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110f60 con 0x7f607c102570 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f60843a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f607c111260 con 0x7f607c102ef0 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59060/0 (socket says 172.21.15.22:59060) 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 -- 172.21.15.22:0/483810360 learned_addr learned my addr 172.21.15.22:0/483810360 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608293f640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102ef0 0x7f607c19d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608193d640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102570 0x7f607c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 -- 172.21.15.22:0/483810360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102ef0 msgr2=0x7f607c19d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102ef0 0x7f607c19d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 -- 172.21.15.22:0/483810360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102570 msgr2=0x7f607c198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102570 0x7f607c198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 -- 172.21.15.22:0/483810360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c19d6e0 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.213+0000 7f608213e640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6078006010 tx=0x7f6078004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.214+0000 7f60737fe640 1 -- 172.21.15.22:0/483810360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607803f030 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.214+0000 7f60737fe640 1 -- 172.21.15.22:0/483810360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6078005500 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.214+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c19d970 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.214+0000 7f60737fe640 1 -- 172.21.15.22:0/483810360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078035070 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.214+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c1a52b0 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.216+0000 7f60737fe640 1 -- 172.21.15.22:0/483810360 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f6078042030 con 0x7f607c100e20 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.216+0000 7f608677b740 1 Processor -- start 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 -- start start 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1c00 0x55d906abd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d906a0d2f0 con 0x55d906ab1280 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d9069b4cf0 con 0x55d906ab1c00 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608677b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d906a092b0 con 0x55d906ab65d0 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608213e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608213e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59064/0 (socket says 172.21.15.22:59064) 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f608213e640 1 -- 172.21.15.22:0/3337162609 learned_addr learned my addr 172.21.15.22:0/3337162609 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.217+0000 7f60737fe640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 0x7f60680a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608293f640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608193d640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1c00 0x55d906abd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608293f640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 0x7f60680a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 -- 172.21.15.22:0/3337162609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 msgr2=0x55d906ab69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 -- 172.21.15.22:0/3337162609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1c00 msgr2=0x55d906abd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f60737fe640 1 -- 172.21.15.22:0/483810360 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f60780efb50 con 0x7f607c100e20 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1c00 0x55d906abd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 -- 172.21.15.22:0/3337162609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9069993a0 con 0x55d906ab1280 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608293f640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608293f640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 0x7f60680a52c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f607400a780 tx=0x7f607400a4d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f608213e640 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f60780ed310 tx=0x7f6078031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3837b874c3b230f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.218+0000 7f6070dea640 1 -- 172.21.15.22:0/3337162609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078049070 con 0x55d906ab1280 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f6070dea640 1 -- 172.21.15.22:0/3337162609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f60780047a0 con 0x55d906ab1280 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f6070dea640 1 -- 172.21.15.22:0/3337162609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60780c4bc0 con 0x55d906ab1280 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 -- 172.21.15.22:0/3337162609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 msgr2=0x55d906ab16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f60780ed310 tx=0x7f6078031400 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 -- 172.21.15.22:0/3337162609 shutdown_connections 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1c00 0x55d906abd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1280 0x55d906ab16c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 --2- 172.21.15.22:0/3337162609 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 -- 172.21.15.22:0/3337162609 >> 172.21.15.22:0/3337162609 conn(0x55d906a70310 msgr2=0x55d906aa36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.219+0000 7f608677b740 1 -- 172.21.15.22:0/3337162609 shutdown_connections 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 -- 172.21.15.22:0/3337162609 wait complete. 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 -- start start 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 Processor -- start 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906abd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906aba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.220+0000 7f608677b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59080/0 (socket says 172.21.15.22:59080) 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 -- 172.21.15.22:0/1426884066 learned_addr learned my addr 172.21.15.22:0/1426884066 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d906a0d2f0 con 0x55d906ab65d0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d9069c8060 con 0x55d906ab1280 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d906ab7100 con 0x55d906ab1c00 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608213e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906abd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608193d640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906aba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608677b740 10 client.0 _ll_register_callbacks cb 0x55d90671b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 -- 172.21.15.22:0/1426884066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 msgr2=0x55d906aba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906aba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 -- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 msgr2=0x55d906abd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906abd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90677e3c0 con 0x55d906ab65d0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60780047a0 con 0x55d906ab65d0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f608293f640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6074005fb0 tx=0x7f6074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c3a656f2ad559f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f6065ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.221+0000 7f6065ffb640 1 -- 172.21.15.22:0/1426884066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074026070 con 0x55d906ab65d0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f6065ffb640 1 -- 172.21.15.22:0/1426884066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6074004d20 con 0x55d906ab65d0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f6065ffb640 1 -- 172.21.15.22:0/1426884066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f607400fe10 con 0x55d906ab65d0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 10 client.15402 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55d906ac8e30 con 0x55d906ab65d0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f6065ffb640 1 -- 172.21.15.22:0/1426884066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6074003970 con 0x55d906ab65d0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 10 client.15402 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 20 client.15402 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906aca280 0x55d906acc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.222+0000 7f608677b740 4 client.15402 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.223+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d906a1a860 con 0x55d906aca280 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.223+0000 7f608213e640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906aca280 0x55d906acc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.223+0000 7f6065ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.223+0000 7f608213e640 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906aca280 0x55d906acc720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc2b064108ce74e server_cookie=ece4c0cf88cdaf9c in_seq=0 out_seq=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f6065ffb640 1 -- 172.21.15.22:0/1426884066 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d906a1a860 con 0x55d906aca280 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f6065ffb640 10 client.15402 handle_command_reply: tid=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 client.15402 shutdown 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 msgr2=0x55d906aba990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6074005fb0 tx=0x7f6074004a40 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 shutdown_connections 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906aca280 0x55d906acc720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906aba990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906aba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 --2- 172.21.15.22:0/1426884066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906abd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 >> 172.21.15.22:0/1426884066 conn(0x55d906a70310 msgr2=0x55d906ab0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f6065ffb640 0 client.15402 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 shutdown_connections 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.224+0000 7f608677b740 1 -- 172.21.15.22:0/1426884066 wait complete. 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.225+0000 7f608677b740 20 client.15402 trim_cache size 0 max 16384 2024-09-11T22:29:48.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.240+0000 7f608677b740 1 Processor -- start 2024-09-11T22:29:48.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 -- start start 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1a9680 con 0x55d906ab1c00 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1abee0 con 0x55d906ab1280 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608677b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1a9cd0 con 0x55d906ab65d0 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59086/0 (socket says 172.21.15.22:59086) 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 -- 172.21.15.22:0/1962109450 learned_addr learned my addr 172.21.15.22:0/1962109450 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608213e640 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608293f640 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 -- 172.21.15.22:0/1962109450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 msgr2=0x55d906ab0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 -- 172.21.15.22:0/1962109450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 msgr2=0x55d906ac67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.241+0000 7f608193d640 1 -- 172.21.15.22:0/1962109450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d906ab89a0 con 0x55d906ab1c00 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.242+0000 7f608193d640 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f606c00b7c0 tx=0x7f606c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3577fe4dde57de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.242+0000 7f6067fff640 1 -- 172.21.15.22:0/1962109450 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c01b070 con 0x55d906ab1c00 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.242+0000 7f6067fff640 1 -- 172.21.15.22:0/1962109450 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f606c015450 con 0x55d906ab1c00 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.242+0000 7f6067fff640 1 -- 172.21.15.22:0/1962109450 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c0145b0 con 0x55d906ab1c00 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 -- 172.21.15.22:0/1962109450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 msgr2=0x55d906ab9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f606c00b7c0 tx=0x7f606c00bc80 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 -- 172.21.15.22:0/1962109450 shutdown_connections 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab65d0 0x55d906ab0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab1c00 0x55d906ab9430 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 --2- 172.21.15.22:0/1962109450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 -- 172.21.15.22:0/1962109450 >> 172.21.15.22:0/1962109450 conn(0x55d906a70310 msgr2=0x55d906ab8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 -- 172.21.15.22:0/1962109450 shutdown_connections 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.243+0000 7f608677b740 1 -- 172.21.15.22:0/1962109450 wait complete. 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 -- start start 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 Processor -- start 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906ad1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906ad1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1aa3a0 con 0x55d906ab65d0 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1ab810 con 0x55d906ab1280 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f607c1aaa70 con 0x55d906ab1c00 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.244+0000 7f608677b740 10 client.0 _ll_register_callbacks cb 0x7f6074014830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608293f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906ad1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:43498/0 (socket says 172.21.15.22:43498) 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 -- 172.21.15.22:0/3517489731 learned_addr learned my addr 172.21.15.22:0/3517489731 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608193d640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906ad1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 -- 172.21.15.22:0/3517489731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 msgr2=0x55d906ad1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906ad1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 -- 172.21.15.22:0/3517489731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 msgr2=0x55d906ad1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906ad1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.245+0000 7f608213e640 1 -- 172.21.15.22:0/3517489731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d906ad2180 con 0x55d906ab1280 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f608213e640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60780b83b0 tx=0x7f60780bbbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a036a16ec468e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f6065ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078049040 con 0x55d906ab1280 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f60780b85c0 con 0x55d906ab1280 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606c015450 con 0x55d906ab1280 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f60780bb8b0 con 0x55d906ab1280 2024-09-11T22:29:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f608677b740 10 client.25118 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.246+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d906b34d50 con 0x55d906ab1280 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.247+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f60780bc650 con 0x55d906ab1280 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.247+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f60780ed4e0 con 0x55d906ab1280 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.247+0000 7f608677b740 10 client.25118 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.247+0000 7f608677b740 10 client.25118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.247+0000 7f608677b740 20 client.25118 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906b352d0 0x55d906b376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f608677b740 4 client.25118 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f606c015450 con 0x55d906b352d0 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f608193d640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906b352d0 0x55d906b376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f608193d640 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906b352d0 0x55d906b376c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=846f9302e07d199c server_cookie=8cfcb8c9139ea143 in_seq=0 out_seq=0 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.248+0000 7f6065ffb640 10 client.25118 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f6065ffb640 1 -- 172.21.15.22:0/3517489731 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f606c015450 con 0x55d906b352d0 2024-09-11T22:29:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f6065ffb640 10 client.25118 handle_command_reply: tid=0 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 client.25118 shutdown 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 msgr2=0x55d906ac2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60780b83b0 tx=0x7f60780bbbc0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 shutdown_connections 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d906b352d0 0x55d906b376c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d906ab65d0 0x55d906ad1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d906ab1c00 0x55d906ad1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f6065ffb640 0 client.25118 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 --2- 172.21.15.22:0/3517489731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d906ab1280 0x55d906ac2e20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 >> 172.21.15.22:0/3517489731 conn(0x55d906a70310 msgr2=0x55d906ab9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 shutdown_connections 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 1 -- 172.21.15.22:0/3517489731 wait complete. 2024-09-11T22:29:48.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.249+0000 7f608677b740 20 client.25118 trim_cache size 0 max 16384 2024-09-11T22:29:48.257 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:29:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 msgr2=0x7f60680a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 0x7f60680a52c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f607400a780 tx=0x7f607400a4d0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 msgr2=0x7f607c198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6078006010 tx=0x7f6078004c00 comp rx=0 tx=0).stop 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 shutdown_connections 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60680a2e00 0x7f60680a52c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f607c102ef0 0x7f607c19d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c102570 0x7f607c198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 --2- 172.21.15.22:0/483810360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f607c100e20 0x7f607c198730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 >> 172.21.15.22:0/483810360 conn(0x7f607c0fc7d0 msgr2=0x7f607c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 shutdown_connections 2024-09-11T22:29:48.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:48.250+0000 7f60843a2640 1 -- 172.21.15.22:0/483810360 wait complete. 2024-09-11T22:29:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:49 smithi022 ceph-mon[30966]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T22:29:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:49 smithi169 ceph-mon[35628]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T22:29:49.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:49 smithi045 ceph-mon[35556]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-11T22:29:49.978 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:29:49.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:29:50.244 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 -- 172.21.15.22:0/3511475406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 msgr2=0x7f33fc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 --2- 172.21.15.22:0/3511475406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc1067f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009900 tx=0x7f33ec02a410 comp rx=0 tx=0).stop 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 -- 172.21.15.22:0/3511475406 shutdown_connections 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 --2- 172.21.15.22:0/3511475406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 --2- 172.21.15.22:0/3511475406 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc1067f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 --2- 172.21.15.22:0/3511475406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 0x7f33fc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 -- 172.21.15.22:0/3511475406 >> 172.21.15.22:0/3511475406 conn(0x7f33fc0fd8f0 msgr2=0x7f33fc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 -- 172.21.15.22:0/3511475406 shutdown_connections 2024-09-11T22:29:50.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 -- 172.21.15.22:0/3511475406 wait complete. 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.756+0000 7f34032df640 1 Processor -- start 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 -- start start 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 0x7f33fc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1120a0 con 0x7f33fc1027a0 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc111f20 con 0x7f33fc101df0 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f34032df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc112220 con 0x7f33fc106f20 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59114/0 (socket says 172.21.15.22:59114) 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 -- 172.21.15.22:0/4288381363 learned_addr learned my addr 172.21.15.22:0/4288381363 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340107b640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 0x7f33fc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340187c640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 -- 172.21.15.22:0/4288381363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 msgr2=0x7f33fc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 -- 172.21.15.22:0/4288381363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 msgr2=0x7f33fc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 0x7f33fc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340087a640 1 -- 172.21.15.22:0/4288381363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc19d4b0 con 0x7f33fc1027a0 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.757+0000 7f340187c640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f340087a640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f33ec006010 tx=0x7f33ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f33f27fc640 1 -- 172.21.15.22:0/4288381363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec03f030 con 0x7f33fc1027a0 2024-09-11T22:29:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f33f27fc640 1 -- 172.21.15.22:0/4288381363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33ec003d00 con 0x7f33fc1027a0 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc19d740 con 0x7f33fc1027a0 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f33f27fc640 1 -- 172.21.15.22:0/4288381363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec035070 con 0x7f33fc1027a0 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.758+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc1a5080 con 0x7f33fc1027a0 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 Processor -- start 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 -- start start 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d619ff280 con 0x557d61a99b60 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557d619a6b10 con 0x557d61aa4d40 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f34056b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d619fb240 con 0x557d61a9a480 2024-09-11T22:29:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.761+0000 7f33f27fc640 1 -- 172.21.15.22:0/4288381363 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f33ec042030 con 0x7f33fc1027a0 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59116/0 (socket says 172.21.15.22:59116) 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 -- 172.21.15.22:0/3766508486 learned_addr learned my addr 172.21.15.22:0/3766508486 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340087a640 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 -- 172.21.15.22:0/3766508486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 msgr2=0x557d61aa4800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa4800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 -- 172.21.15.22:0/3766508486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 msgr2=0x557d61aa7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 -- 172.21.15.22:0/3766508486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d619b31f0 con 0x557d61a99b60 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340087a640 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.762+0000 7f340187c640 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009ea0 tx=0x7f33f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405644083dc10ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f33f27fc640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 0x7f33e80a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f33e77fe640 1 -- 172.21.15.22:0/3766508486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4004d20 con 0x557d61a99b60 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f33e77fe640 1 -- 172.21.15.22:0/3766508486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33f400ee80 con 0x557d61a99b60 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f33e77fe640 1 -- 172.21.15.22:0/3766508486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4005810 con 0x557d61a99b60 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f33f27fc640 1 -- 172.21.15.22:0/4288381363 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f33ec0efb50 con 0x7f33fc1027a0 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f340107b640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 0x7f33e80a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f34056b8740 1 -- 172.21.15.22:0/3766508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 msgr2=0x557d61a99f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f34056b8740 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009ea0 tx=0x7f33f4009f90 comp rx=0 tx=0).stop 2024-09-11T22:29:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.763+0000 7f340107b640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 0x7f33e80a52c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557d61a96f50 tx=0x7f33f800b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 -- 172.21.15.22:0/3766508486 shutdown_connections 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 --2- 172.21.15.22:0/3766508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61a99f40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 -- 172.21.15.22:0/3766508486 >> 172.21.15.22:0/3766508486 conn(0x557d61a960f0 msgr2=0x557d61a964d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 -- 172.21.15.22:0/3766508486 shutdown_connections 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 -- 172.21.15.22:0/3766508486 wait complete. 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 -- start start 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.764+0000 7f34056b8740 1 Processor -- start 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 0x557d61aa1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d61aa7910 con 0x557d61a9a480 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557d619b9f10 con 0x557d61aa4d40 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d61aa7a90 con 0x557d61a99b60 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f34056b8740 10 client.0 _ll_register_callbacks cb 0x557d61982a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59120/0 (socket says 172.21.15.22:59120) 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340107b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 0x557d61aa1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 -- 172.21.15.22:0/1675632026 learned_addr learned my addr 172.21.15.22:0/1675632026 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340187c640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 -- 172.21.15.22:0/1675632026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 msgr2=0x557d61aa1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 0x557d61aa1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 -- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 msgr2=0x557d61aa2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 -- 172.21.15.22:0/1675632026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d617706a0 con 0x557d61a9a480 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340107b640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 0x557d61aa1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f340087a640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0b89e0 tx=0x7f33ec003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9551238baed8cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.765+0000 7f33e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec049070 con 0x557d61a9a480 2024-09-11T22:29:50.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f33ec03b460 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d61a0c7f0 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f33ec0b82b0 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 10 client.15420 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557d61ab3510 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x557d61a0c7f0 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f33ec0ed4e0 con 0x557d61a9a480 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 10 client.15420 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 20 client.15420 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:50.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61ab48d0 0x557d61ab6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 4 client.15420 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.766+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d61a06d00 con 0x557d61ab48d0 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.767+0000 7f340107b640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61ab48d0 0x557d61ab6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.767+0000 7f33e4ff9640 10 client.15420 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.767+0000 7f340107b640 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61ab48d0 0x557d61ab6ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796099ee04b30d8b server_cookie=431965a3645b158a in_seq=0 out_seq=0 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f33e4ff9640 1 -- 172.21.15.22:0/1675632026 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d61a06d00 con 0x557d61ab48d0 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f33e4ff9640 10 client.15420 handle_command_reply: tid=0 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 client.15420 shutdown 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 msgr2=0x557d61aa2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0b89e0 tx=0x7f33ec003f30 comp rx=0 tx=0).stop 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 shutdown_connections 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61ab48d0 0x557d61ab6ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a9a480 0x557d61aa2150 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 --2- 172.21.15.22:0/1675632026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a99b60 0x557d61aa1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 >> 172.21.15.22:0/1675632026 conn(0x557d61a960f0 msgr2=0x557d61a95270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f33e4ff9640 0 client.15420 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 shutdown_connections 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.768+0000 7f34056b8740 1 -- 172.21.15.22:0/1675632026 wait complete. 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.769+0000 7f34056b8740 20 client.15420 trim_cache size 0 max 16384 2024-09-11T22:29:50.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 Processor -- start 2024-09-11T22:29:50.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 -- start start 2024-09-11T22:29:50.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61abcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61a94a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1a95b0 con 0x557d61a99b60 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1abe30 con 0x557d61aa4d40 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f34056b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1a9c20 con 0x557d61a9a480 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f340107b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f340107b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59122/0 (socket says 172.21.15.22:59122) 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f340107b640 1 -- 172.21.15.22:0/740127579 learned_addr learned my addr 172.21.15.22:0/740127579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f340187c640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61a94a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.788+0000 7f340087a640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61abcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 -- 172.21.15.22:0/740127579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 msgr2=0x557d61abcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61abcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 -- 172.21.15.22:0/740127579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 msgr2=0x557d61a94a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61a94a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 -- 172.21.15.22:0/740127579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d61aa7470 con 0x557d61a99b60 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340187c640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61a94a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:50.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f340107b640 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33f8010860 tx=0x7f33f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac5b28d67846284 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f33e6ffd640 1 -- 172.21.15.22:0/740127579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f802d070 con 0x557d61a99b60 2024-09-11T22:29:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f33e6ffd640 1 -- 172.21.15.22:0/740127579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33f8027890 con 0x557d61a99b60 2024-09-11T22:29:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.789+0000 7f33e6ffd640 1 -- 172.21.15.22:0/740127579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f801ec70 con 0x557d61a99b60 2024-09-11T22:29:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 -- 172.21.15.22:0/740127579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 msgr2=0x557d61abc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33f8010860 tx=0x7f33f8013000 comp rx=0 tx=0).stop 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 -- 172.21.15.22:0/740127579 shutdown_connections 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61a94a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61abcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 --2- 172.21.15.22:0/740127579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61abc580 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 -- 172.21.15.22:0/740127579 >> 172.21.15.22:0/740127579 conn(0x557d61a960f0 msgr2=0x557d61aa0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 -- 172.21.15.22:0/740127579 shutdown_connections 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.790+0000 7f34056b8740 1 -- 172.21.15.22:0/740127579 wait complete. 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.791+0000 7f34056b8740 1 -- start start 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.791+0000 7f34056b8740 1 Processor -- start 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.791+0000 7f34056b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.791+0000 7f34056b8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.791+0000 7f34056b8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f34056b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1aa2f0 con 0x557d61a99b60 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f34056b8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1ab760 con 0x557d61aa4d40 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f34056b8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc1aa9c0 con 0x557d61a9a480 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59138/0 (socket says 172.21.15.22:59138) 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 -- 172.21.15.22:0/514691029 learned_addr learned my addr 172.21.15.22:0/514691029 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f34056b8740 10 client.0 _ll_register_callbacks cb 0x7f33ec0ed0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340187c640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 -- 172.21.15.22:0/514691029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 msgr2=0x557d61aa8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 -- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 msgr2=0x557d61aa8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 -- 172.21.15.22:0/514691029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d61aa9600 con 0x557d61a99b60 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340187c640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:50.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f340107b640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f33f8010e00 tx=0x7f33f8027e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b119019cff4f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f33e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.792+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8036060 con 0x557d61a99b60 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f33f8027390 con 0x557d61a99b60 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f8027890 con 0x557d61a99b60 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f33f802d070 con 0x557d61a99b60 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f34056b8740 10 client.15426 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:50.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557d61b1f610 con 0x557d61a99b60 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.793+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33f8027890 con 0x557d61a99b60 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f33f80046c0 con 0x557d61a99b60 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 10 client.15426 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 10 client.15426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 20 client.15426 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61b1fc20 0x557d61b22070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 4 client.15426 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:29:50.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557d61983110 con 0x557d61b1fc20 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f340087a640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61b1fc20 0x557d61b22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f340087a640 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61b1fc20 0x557d61b22070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8503258d0f6ae9 server_cookie=66e31eb1f65da73c in_seq=0 out_seq=0 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.794+0000 7f33e4ff9640 10 client.15426 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.795+0000 7f33e4ff9640 1 -- 172.21.15.22:0/514691029 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557d61983110 con 0x557d61b1fc20 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.795+0000 7f33e4ff9640 10 client.15426 handle_command_reply: tid=0 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.795+0000 7f34056b8740 1 client.15426 shutdown 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 msgr2=0x557d61aad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f33f8010e00 tx=0x7f33f8027e80 comp rx=0 tx=0).stop 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 shutdown_connections 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557d61b1fc20 0x557d61b22070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557d61aa4d40 0x557d61aa8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f33e4ff9640 0 client.15426 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d61a9a480 0x557d61aa8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 --2- 172.21.15.22:0/514691029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d61a99b60 0x557d61aad4d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 >> 172.21.15.22:0/514691029 conn(0x557d61a960f0 msgr2=0x557d61aa3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 shutdown_connections 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 1 -- 172.21.15.22:0/514691029 wait complete. 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.796+0000 7f34056b8740 20 client.15426 trim_cache size 0 max 16384 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "f2f400fd-c0a7-48c9-94e1-9e9c660f3ee7", 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:29:50.800 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 msgr2=0x7f33e80a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 0x7f33e80a52c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x557d61a96f50 tx=0x7f33f800b390 comp rx=0 tx=0).stop 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 msgr2=0x7f33fc198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f33ec006010 tx=0x7f33ec0042f0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 shutdown_connections 2024-09-11T22:29:50.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33e80a2e00 0x7f33e80a52c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33fc106f20 0x7f33fc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33fc1027a0 0x7f33fc198a40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 --2- 172.21.15.22:0/4288381363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33fc101df0 0x7f33fc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.797+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 >> 172.21.15.22:0/4288381363 conn(0x7f33fc0fd8f0 msgr2=0x7f33fc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.798+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 shutdown_connections 2024-09-11T22:29:50.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:50.798+0000 7f34032df640 1 -- 172.21.15.22:0/4288381363 wait complete. 2024-09-11T22:29:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 -- 172.21.15.22:0/2970660298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520102c80 msgr2=0x7f6520103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2970660298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520102c80 0x7f6520103060 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6510009900 tx=0x7f651002a480 comp rx=0 tx=0).stop 2024-09-11T22:29:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 -- 172.21.15.22:0/2970660298 shutdown_connections 2024-09-11T22:29:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2970660298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f652010c0d0 0x7f652010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2970660298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65201035a0 0x7f652010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2970660298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6520102c80 0x7f6520103060 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 -- 172.21.15.22:0/2970660298 >> 172.21.15.22:0/2970660298 conn(0x7f6520077990 msgr2=0x7f65200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 -- 172.21.15.22:0/2970660298 shutdown_connections 2024-09-11T22:29:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.845+0000 7f6524d8d640 1 -- 172.21.15.22:0/2970660298 wait complete. 2024-09-11T22:29:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 Processor -- start 2024-09-11T22:29:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 -- start start 2024-09-11T22:29:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 0x7f6520198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652010c0d0 0x7f652019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6520111fd0 con 0x7f65201035a0 2024-09-11T22:29:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6520111e50 con 0x7f6520102c80 2024-09-11T22:29:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f6524d8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6520112150 con 0x7f652010c0d0 2024-09-11T22:29:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59152/0 (socket says 172.21.15.22:59152) 2024-09-11T22:29:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f651dd9b640 1 -- 172.21.15.22:0/2198612899 learned_addr learned my addr 172.21.15.22:0/2198612899 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.846+0000 7f651ed9d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652010c0d0 0x7f652019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651e59c640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 0x7f6520198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 -- 172.21.15.22:0/2198612899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652010c0d0 msgr2=0x7f652019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652010c0d0 0x7f652019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 -- 172.21.15.22:0/2198612899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 msgr2=0x7f6520198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 0x7f6520198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 -- 172.21.15.22:0/2198612899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652019d430 con 0x7f65201035a0 2024-09-11T22:29:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651e59c640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 0x7f6520198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f651dd9b640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f650800d750 tx=0x7f650800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f65177fe640 1 -- 172.21.15.22:0/2198612899 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508017070 con 0x7f65201035a0 2024-09-11T22:29:50.856 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f65177fe640 1 -- 172.21.15.22:0/2198612899 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6508005020 con 0x7f65201035a0 2024-09-11T22:29:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652019d720 con 0x7f65201035a0 2024-09-11T22:29:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f65177fe640 1 -- 172.21.15.22:0/2198612899 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508004dd0 con 0x7f65201035a0 2024-09-11T22:29:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.847+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201a4fb0 con 0x7f65201035a0 2024-09-11T22:29:50.870 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.850+0000 7f65177fe640 1 -- 172.21.15.22:0/2198612899 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f65080051d0 con 0x7f65201035a0 2024-09-11T22:29:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 Processor -- start 2024-09-11T22:29:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 -- start start 2024-09-11T22:29:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.871 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555cf63272f0 con 0x555cf63c3410 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555cf62cf270 con 0x555cf63c2af0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f6527c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555cf63232b0 con 0x555cf63cdcb0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f651e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f651e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59168/0 (socket says 172.21.15.22:59168) 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f651e59c640 1 -- 172.21.15.22:0/1798095050 learned_addr learned my addr 172.21.15.22:0/1798095050 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f651ed9d640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.851+0000 7f65177fe640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 0x7f650c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f65177fe640 1 -- 172.21.15.22:0/2198612899 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f65080cef60 con 0x7f65201035a0 2024-09-11T22:29:50.872 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 -- 172.21.15.22:0/1798095050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 msgr2=0x555cf63c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 -- 172.21.15.22:0/1798095050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 msgr2=0x555cf63cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651ed9d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 0x7f650c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 -- 172.21.15.22:0/1798095050 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf62ce340 con 0x555cf63cdcb0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651e59c640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d00a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f65080cc640 tx=0x7f65080048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875abbb60e4abafe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f6514ff9640 1 -- 172.21.15.22:0/1798095050 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508020070 con 0x555cf63cdcb0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f651ed9d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 0x7f650c0a5300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6518005fd0 tx=0x7f6518004ab0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f6514ff9640 1 -- 172.21.15.22:0/1798095050 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65080cce50 con 0x555cf63cdcb0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.852+0000 7f6514ff9640 1 -- 172.21.15.22:0/1798095050 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080d1110 con 0x555cf63cdcb0 2024-09-11T22:29:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- 172.21.15.22:0/1798095050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 msgr2=0x555cf63d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d00a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f65080cc640 tx=0x7f65080048a0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- 172.21.15.22:0/1798095050 shutdown_connections 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d00a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 --2- 172.21.15.22:0/1798095050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- 172.21.15.22:0/1798095050 >> 172.21.15.22:0/1798095050 conn(0x555cf63bf060 msgr2=0x555cf63bf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- 172.21.15.22:0/1798095050 shutdown_connections 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- 172.21.15.22:0/1798095050 wait complete. 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.853+0000 7f6527c04740 1 -- start start 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 Processor -- start 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555cf63d0880 con 0x555cf63c3410 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555cf62b0290 con 0x555cf63c2af0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555cf63d0a00 con 0x555cf63cdcb0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6527c04740 10 client.0 _ll_register_callbacks cb 0x555cf62e1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59170/0 (socket says 172.21.15.22:59170) 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 -- 172.21.15.22:0/699496451 learned_addr learned my addr 172.21.15.22:0/699496451 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651e59c640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651ed9d640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 -- 172.21.15.22:0/699496451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 msgr2=0x555cf63cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 -- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 msgr2=0x555cf63cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 -- 172.21.15.22:0/699496451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf603a210 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651ed9d640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f651dd9b640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f65080977c0 tx=0x7f6508005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bab894e26ef37a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.854+0000 7f6505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508020050 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65080cce50 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f65080b4260 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f65080ccaf0 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 10 client.15438 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555cf6106620 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65080cce50 con 0x555cf63c3410 2024-09-11T22:29:50.876 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f650809f170 con 0x555cf63c3410 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 10 client.15438 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 20 client.15438 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf63dda80 0x555cf63dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 4 client.15438 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.855+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf6334a20 con 0x555cf63dda80 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.856+0000 7f651e59c640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf63dda80 0x555cf63dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.856+0000 7f6505ffb640 10 client.15438 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.856+0000 7f651e59c640 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf63dda80 0x555cf63dfe70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=379b88db29fe9e4a server_cookie=7febc7aa2155c23f in_seq=0 out_seq=0 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6505ffb640 1 -- 172.21.15.22:0/699496451 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cf6334a20 con 0x555cf63dda80 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6505ffb640 10 client.15438 handle_command_reply: tid=0 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 client.15438 shutdown 2024-09-11T22:29:50.877 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 msgr2=0x555cf63cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f65080977c0 tx=0x7f6508005670 comp rx=0 tx=0).stop 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 shutdown_connections 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf63dda80 0x555cf63dfe70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb0d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6505ffb640 0 client.15438 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 --2- 172.21.15.22:0/699496451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 >> 172.21.15.22:0/699496451 conn(0x555cf63bf060 msgr2=0x555cf63c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 shutdown_connections 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 1 -- 172.21.15.22:0/699496451 wait complete. 2024-09-11T22:29:50.878 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.857+0000 7f6527c04740 20 client.15438 trim_cache size 0 max 16384 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 Processor -- start 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 -- start start 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63c2af0 0x555cf63ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63cdcb0 0x555cf63e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ab710 con 0x555cf63c3410 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f65201adf90 con 0x555cf63cdcb0 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f6527c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65201abd80 con 0x555cf63c2af0 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59184/0 (socket says 172.21.15.22:59184) 2024-09-11T22:29:50.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 -- 172.21.15.22:0/927045869 learned_addr learned my addr 172.21.15.22:0/927045869 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651ed9d640 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63cdcb0 0x555cf63e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 -- 172.21.15.22:0/927045869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63c2af0 msgr2=0x555cf63ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651e59c640 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63c2af0 0x555cf63ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63c2af0 0x555cf63ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 -- 172.21.15.22:0/927045869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63cdcb0 msgr2=0x555cf63e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63cdcb0 0x555cf63e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.873+0000 7f651dd9b640 1 -- 172.21.15.22:0/927045869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf63d03e0 con 0x555cf63c3410 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.874+0000 7f651dd9b640 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f650809f590 tx=0x7f6508099870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c47f712403daa93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.874+0000 7f6507fff640 1 -- 172.21.15.22:0/927045869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508020030 con 0x555cf63c3410 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.874+0000 7f6507fff640 1 -- 172.21.15.22:0/927045869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f650807b070 con 0x555cf63c3410 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.874+0000 7f6507fff640 1 -- 172.21.15.22:0/927045869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080a3fd0 con 0x555cf63c3410 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- 172.21.15.22:0/927045869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 msgr2=0x555cf63cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f650809f590 tx=0x7f6508099870 comp rx=0 tx=0).stop 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- 172.21.15.22:0/927045869 shutdown_connections 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63cdcb0 0x555cf63e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63c3410 0x555cf63cb440 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 --2- 172.21.15.22:0/927045869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63c2af0 0x555cf63ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- 172.21.15.22:0/927045869 >> 172.21.15.22:0/927045869 conn(0x555cf63bf060 msgr2=0x555cf63be1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- 172.21.15.22:0/927045869 shutdown_connections 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- 172.21.15.22:0/927045869 wait complete. 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 -- start start 2024-09-11T22:29:50.885 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.875+0000 7f6527c04740 1 Processor -- start 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63d6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ac450 con 0x555cf63d1950 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ad8c0 con 0x555cf63c2af0 2024-09-11T22:29:50.886 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65201acb20 con 0x555cf63cdcb0 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 10 client.0 _ll_register_callbacks cb 0x7f6510009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59188/0 (socket says 172.21.15.22:59188) 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 -- 172.21.15.22:0/1674423588 learned_addr learned my addr 172.21.15.22:0/1674423588 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651e59c640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63d6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.887 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 -- 172.21.15.22:0/1674423588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 msgr2=0x555cf63d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 -- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 msgr2=0x555cf63d6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63d6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 -- 172.21.15.22:0/1674423588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf6447470 con 0x555cf63d1950 2024-09-11T22:29:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651dd9b640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f651ed9d640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f65180120e0 tx=0x7f6518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38493431bb08f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518027020 con 0x555cf63d1950 2024-09-11T22:29:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6518015050 con 0x555cf63d1950 2024-09-11T22:29:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.876+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f650807b070 con 0x555cf63d1950 2024-09-11T22:29:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6518032050 con 0x555cf63d1950 2024-09-11T22:29:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 10 client.15444 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555cf6448660 con 0x555cf63d1950 2024-09-11T22:29:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f650807b070 con 0x555cf63d1950 2024-09-11T22:29:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6518020070 con 0x555cf63d1950 2024-09-11T22:29:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 10 client.15444 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 10 client.15444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 20 client.15444 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf6448e30 0x555cf644b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 4 client.15444 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:29:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cf632ed70 con 0x555cf6448e30 2024-09-11T22:29:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.877+0000 7f651e59c640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf6448e30 0x555cf644b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.878+0000 7f6505ffb640 10 client.15444 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.892 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.878+0000 7f651e59c640 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf6448e30 0x555cf644b250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4366b1880889350c server_cookie=9657e337eeafbbf2 in_seq=0 out_seq=0 2024-09-11T22:29:50.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6505ffb640 1 -- 172.21.15.22:0/1674423588 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cf632ed70 con 0x555cf6448e30 2024-09-11T22:29:50.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6505ffb640 10 client.15444 handle_command_reply: tid=0 2024-09-11T22:29:50.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 client.15444 shutdown 2024-09-11T22:29:50.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 msgr2=0x555cf63d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.895 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f65180120e0 tx=0x7f6518004a40 comp rx=0 tx=0).stop 2024-09-11T22:29:50.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 shutdown_connections 2024-09-11T22:29:50.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cf6448e30 0x555cf644b250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6505ffb640 0 client.15444 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:50.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cf63d1950 0x555cf63d1dd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cf63cdcb0 0x555cf63d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 --2- 172.21.15.22:0/1674423588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cf63c2af0 0x555cf63d6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 >> 172.21.15.22:0/1674423588 conn(0x555cf63bf060 msgr2=0x555cf63cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 shutdown_connections 2024-09-11T22:29:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 1 -- 172.21.15.22:0/1674423588 wait complete. 2024-09-11T22:29:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.885+0000 7f6527c04740 20 client.15444 trim_cache size 0 max 16384 2024-09-11T22:29:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:29:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:29:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:29:50.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:29:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 msgr2=0x7f650c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 0x7f650c0a5300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6518005fd0 tx=0x7f6518004ab0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.900 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 msgr2=0x7f6520198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f650800d750 tx=0x7f650800dc10 comp rx=0 tx=0).stop 2024-09-11T22:29:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 shutdown_connections 2024-09-11T22:29:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f650c0a2e40 0x7f650c0a5300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.901 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f652010c0d0 0x7f652019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65201035a0 0x7f6520198980 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 --2- 172.21.15.22:0/2198612899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6520102c80 0x7f6520198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 >> 172.21.15.22:0/2198612899 conn(0x7f6520077990 msgr2=0x7f65200fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 shutdown_connections 2024-09-11T22:29:50.902 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:29:50.886+0000 7f6524d8d640 1 -- 172.21.15.22:0/2198612899 wait complete. 2024-09-11T22:29:51.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:29:51.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:51 smithi022 ceph-mon[30966]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:51.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:51 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:29:51.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:51.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:51 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:29:51.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:51.871 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:51 smithi169 ceph-mon[35628]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:51 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:29:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:51 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:29:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:51 smithi045 ceph-mon[35556]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:51 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:29:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:51 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:29:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:29:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 -- 172.21.15.22:0/3248897408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8100e20 msgr2=0x7fc7a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 --2- 172.21.15.22:0/3248897408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8100e20 0x7fc7a8101200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009900 tx=0x7fc7a402a480 comp rx=0 tx=0).stop 2024-09-11T22:29:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 -- 172.21.15.22:0/3248897408 shutdown_connections 2024-09-11T22:29:52.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 --2- 172.21.15.22:0/3248897408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a8102ef0 0x7fc7a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 --2- 172.21.15.22:0/3248897408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7a8102570 0x7fc7a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 --2- 172.21.15.22:0/3248897408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8100e20 0x7fc7a8101200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 -- 172.21.15.22:0/3248897408 >> 172.21.15.22:0/3248897408 conn(0x7fc7a80fc7d0 msgr2=0x7fc7a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 -- 172.21.15.22:0/3248897408 shutdown_connections 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 -- 172.21.15.22:0/3248897408 wait complete. 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.392+0000 7fc7af809640 1 Processor -- start 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 -- start start 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a8100e20 0x7fc7a81986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7a8102ef0 0x7fc7a819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81110e0 con 0x7fc7a8102570 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8110f60 con 0x7fc7a8100e20 2024-09-11T22:29:52.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7af809640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a8111260 con 0x7fc7a8102ef0 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59196/0 (socket says 172.21.15.22:59196) 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 -- 172.21.15.22:0/3614611097 learned_addr learned my addr 172.21.15.22:0/3614611097 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 -- 172.21.15.22:0/3614611097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7a8102ef0 msgr2=0x7fc7a819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7a8102ef0 0x7fc7a819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 -- 172.21.15.22:0/3614611097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a8100e20 msgr2=0x7fc7a81986a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a8100e20 0x7fc7a81986a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.393+0000 7fc7acda4640 1 -- 172.21.15.22:0/3614611097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a819d650 con 0x7fc7a8102570 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc7acda4640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc79800fee0 tx=0x7fc798009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc79e7fc640 1 -- 172.21.15.22:0/3614611097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79801c070 con 0x7fc7a8102570 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc79e7fc640 1 -- 172.21.15.22:0/3614611097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc79800b690 con 0x7fc7a8102570 2024-09-11T22:29:52.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc79e7fc640 1 -- 172.21.15.22:0/3614611097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79801f7e0 con 0x7fc7a8102570 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a819d940 con 0x7fc7a8102570 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.394+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a80fcbb0 con 0x7fc7a8102570 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.396+0000 7fc79e7fc640 1 -- 172.21.15.22:0/3614611097 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fc79801f070 con 0x7fc7a8102570 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.397+0000 7fc7b1be2740 1 Processor -- start 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.397+0000 7fc7b1be2740 1 -- start start 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad160680 0x55a2ad162a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad0bb2e0 con 0x55a2ad155dc0 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad062ce0 con 0x55a2ad1554a0 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad0b72a0 con 0x55a2ad160680 2024-09-11T22:29:52.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc79e7fc640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 0x7fc7940a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59202/0 (socket says 172.21.15.22:59202) 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/3635447240 learned_addr learned my addr 172.21.15.22:0/3635447240 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7acda4640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad160680 0x55a2ad162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc79e7fc640 1 -- 172.21.15.22:0/3614611097 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc7980d6a00 con 0x7fc7a8102570 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 0x7fc7940a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/3635447240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad160680 msgr2=0x55a2ad162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad160680 0x55a2ad162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/3635447240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 msgr2=0x55a2ad155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/3635447240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ad047440 con 0x55a2ad155dc0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.398+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc7a402a9a0 tx=0x7fc7a4031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497f918a865b4386 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7937fe640 1 -- 172.21.15.22:0/3635447240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a403e030 con 0x55a2ad155dc0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 0x7fc7940a5390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009270 tx=0x7fc7a0005bd0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7937fe640 1 -- 172.21.15.22:0/3635447240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7a4032d60 con 0x55a2ad155dc0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7937fe640 1 -- 172.21.15.22:0/3635447240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4035040 con 0x55a2ad155dc0 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3635447240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 msgr2=0x55a2ad160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.399+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc7a402a9a0 tx=0x7fc7a4031540 comp rx=0 tx=0).stop 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3635447240 shutdown_connections 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad160680 0x55a2ad162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad155dc0 0x55a2ad160140 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3635447240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3635447240 >> 172.21.15.22:0/3635447240 conn(0x55a2ad151a30 msgr2=0x55a2ad151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3635447240 shutdown_connections 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3635447240 wait complete. 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 -- start start 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.400+0000 7fc7b1be2740 1 Processor -- start 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad160680 0x55a2ad15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad1632f0 con 0x55a2ad1554a0 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad076050 con 0x55a2ad160680 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a2ad163470 con 0x55a2ad155dc0 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7b1be2740 10 client.0 _ll_register_callbacks cb 0x55a2ad0b6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59206/0 (socket says 172.21.15.22:59206) 2024-09-11T22:29:52.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/125416730 learned_addr learned my addr 172.21.15.22:0/125416730 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7adda6640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad160680 0x55a2ad15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7acda4640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/125416730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 msgr2=0x55a2ad15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad160680 msgr2=0x55a2ad15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad160680 0x55a2ad15d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 -- 172.21.15.22:0/125416730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ace2c3c0 con 0x55a2ad1554a0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7acda4640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40096c0 tx=0x7fc7a4031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fe3232c52c09ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.401+0000 7fc790ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4035070 con 0x55a2ad1554a0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc7a40054b0 con 0x55a2ad1554a0 2024-09-11T22:29:52.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a4032d60 con 0x55a2ad1554a0 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7a403e040 con 0x55a2ad1554a0 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 10 client.15456 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a2ad16ec00 con 0x55a2ad1554a0 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7a4032d60 con 0x55a2ad1554a0 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc7a40035f0 con 0x55a2ad1554a0 2024-09-11T22:29:52.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 10 client.15456 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 20 client.15456 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad16ff50 0x55a2ad172340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 4 client.15456 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.402+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2ad0c8850 con 0x55a2ad16ff50 2024-09-11T22:29:52.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.403+0000 7fc7acda4640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad16ff50 0x55a2ad172340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.403+0000 7fc790ff9640 10 client.15456 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.403+0000 7fc7acda4640 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad16ff50 0x55a2ad172340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90673a191093f5e4 server_cookie=ee4dbe81aaf91c82 in_seq=0 out_seq=0 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc790ff9640 1 -- 172.21.15.22:0/125416730 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2ad0c8850 con 0x55a2ad16ff50 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc790ff9640 10 client.15456 handle_command_reply: tid=0 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 client.15456 shutdown 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 msgr2=0x55a2ad15fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40096c0 tx=0x7fc7a4031950 comp rx=0 tx=0).stop 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 shutdown_connections 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad16ff50 0x55a2ad172340 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad160680 0x55a2ad15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/125416730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad1554a0 0x55a2ad15fec0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc790ff9640 0 client.15456 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:52.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 >> 172.21.15.22:0/125416730 conn(0x55a2ad151a30 msgr2=0x55a2ad150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 shutdown_connections 2024-09-11T22:29:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 1 -- 172.21.15.22:0/125416730 wait complete. 2024-09-11T22:29:52.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.404+0000 7fc7b1be2740 20 client.15456 trim_cache size 0 max 16384 2024-09-11T22:29:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.427+0000 7fc7b1be2740 1 Processor -- start 2024-09-11T22:29:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.427+0000 7fc7b1be2740 1 -- start start 2024-09-11T22:29:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.427+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad158900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.427+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81a9700 con 0x55a2ad160680 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81abf60 con 0x55a2ad1554a0 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81a9d50 con 0x55a2ad155dc0 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7acda4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59222/0 (socket says 172.21.15.22:59222) 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 -- 172.21.15.22:0/3988796906 learned_addr learned my addr 172.21.15.22:0/3988796906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 -- 172.21.15.22:0/3988796906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 msgr2=0x55a2ad15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 -- 172.21.15.22:0/3988796906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 msgr2=0x55a2ad158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 -- 172.21.15.22:0/3988796906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2ad151860 con 0x55a2ad160680 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.428+0000 7fc7adda6640 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000d7b0 tx=0x7fc7a0014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164693e88e171335 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc792ffd640 1 -- 172.21.15.22:0/3988796906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a001d930 con 0x55a2ad160680 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc792ffd640 1 -- 172.21.15.22:0/3988796906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7a0016070 con 0x55a2ad160680 2024-09-11T22:29:52.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc792ffd640 1 -- 172.21.15.22:0/3988796906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a001edb0 con 0x55a2ad160680 2024-09-11T22:29:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3988796906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 msgr2=0x55a2ad15a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000d7b0 tx=0x7fc7a0014070 comp rx=0 tx=0).stop 2024-09-11T22:29:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3988796906 shutdown_connections 2024-09-11T22:29:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad15a3d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad155dc0 0x55a2ad15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/3988796906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad1554a0 0x55a2ad158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.429+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3988796906 >> 172.21.15.22:0/3988796906 conn(0x55a2ad151a30 msgr2=0x55a2ad15ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3988796906 shutdown_connections 2024-09-11T22:29:52.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- 172.21.15.22:0/3988796906 wait complete. 2024-09-11T22:29:52.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- start start 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 Processor -- start 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad1554a0 0x55a2ad175460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad155dc0 0x55a2ad170830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81aa420 con 0x55a2ad160680 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81ab890 con 0x55a2ad155dc0 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.430+0000 7fc7b1be2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a81aaaf0 con 0x55a2ad1554a0 2024-09-11T22:29:52.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7b1be2740 10 client.0 _ll_register_callbacks cb 0x7fc7a4031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59228/0 (socket says 172.21.15.22:59228) 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 -- 172.21.15.22:0/2312322535 learned_addr learned my addr 172.21.15.22:0/2312322535 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad1554a0 0x55a2ad175460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7acda4640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad155dc0 0x55a2ad170830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 -- 172.21.15.22:0/2312322535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad1554a0 msgr2=0x55a2ad175460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad1554a0 0x55a2ad175460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 -- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad155dc0 msgr2=0x55a2ad170830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad155dc0 0x55a2ad170830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 -- 172.21.15.22:0/2312322535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2ad171330 con 0x55a2ad160680 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc7adda6640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc7a001d780 tx=0x7fc7a000d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396e99c332a83b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.431+0000 7fc790ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0034020 con 0x55a2ad160680 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc7a000dd70 con 0x55a2ad160680 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a0016070 con 0x55a2ad160680 2024-09-11T22:29:52.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7a003f050 con 0x55a2ad160680 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 10 client.15462 fetch_fsmap learned FSMap version 20 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a2ad1da600 con 0x55a2ad160680 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7a0016070 con 0x55a2ad160680 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc7a001d930 con 0x55a2ad160680 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 10 client.15462 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 20 client.15462 populate_metadata read hostname 'smithi022' 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad1dad40 0x55a2ad1dd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 4 client.15462 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.432+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a2ad15da40 con 0x55a2ad1dad40 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad1dad40 0x55a2ad1dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc7ad5a5640 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad1dad40 0x55a2ad1dd160 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb35ee7b56ca3c1 server_cookie=27a784862f3e101 in_seq=0 out_seq=0 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc790ff9640 10 client.15462 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc790ff9640 1 -- 172.21.15.22:0/2312322535 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a2ad15da40 con 0x55a2ad1dad40 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc790ff9640 10 client.15462 handle_command_reply: tid=0 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.433+0000 7fc7b1be2740 1 client.15462 shutdown 2024-09-11T22:29:52.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 msgr2=0x55a2ad170d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc7a001d780 tx=0x7fc7a000d4e0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 shutdown_connections 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a2ad1dad40 0x55a2ad1dd160 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2ad160680 0x55a2ad170d70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2ad155dc0 0x55a2ad170830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 --2- 172.21.15.22:0/2312322535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a2ad1554a0 0x55a2ad175460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 >> 172.21.15.22:0/2312322535 conn(0x55a2ad151a30 msgr2=0x55a2ad150350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc790ff9640 0 client.15462 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 shutdown_connections 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 1 -- 172.21.15.22:0/2312322535 wait complete. 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.434+0000 7fc7b1be2740 20 client.15462 trim_cache size 0 max 16384 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:29:52.443 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: "f2f400fd-c0a7-48c9-94e1-9e9c660f3ee7": { 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "f2f400fd-c0a7-48c9-94e1-9e9c660f3ee7", 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:29:52.444 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:29:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 msgr2=0x7fc7940a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 0x7fc7940a5390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009270 tx=0x7fc7a0005bd0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 msgr2=0x7fc7a8198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc79800fee0 tx=0x7fc798009da0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 shutdown_connections 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc7940a2ed0 0x7fc7940a5390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7a8102ef0 0x7fc7a819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7a8102570 0x7fc7a8198be0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 --2- 172.21.15.22:0/3614611097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7a8100e20 0x7fc7a81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 >> 172.21.15.22:0/3614611097 conn(0x7fc7a80fc7d0 msgr2=0x7fc7a806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 shutdown_connections 2024-09-11T22:29:52.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:29:52.435+0000 7fc7af809640 1 -- 172.21.15.22:0/3614611097 wait complete. 2024-09-11T22:29:53.154 INFO:tasks.cephfs.filesystem:scrub status for tag:f2f400fd-c0a7-48c9-94e1-9e9c660f3ee7 - {'path': '/', 'tag': 'f2f400fd-c0a7-48c9-94e1-9e9c660f3ee7', 'options': 'recursive,force'} 2024-09-11T22:29:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:53 smithi022 ceph-mon[30966]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:53 smithi169 ceph-mon[35628]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:53 smithi045 ceph-mon[35556]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-11T22:29:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:54 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:29:54.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:54 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:29:54.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:54 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:29:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:55 smithi022 ceph-mon[30966]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:29:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:55 smithi169 ceph-mon[35628]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:29:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:55 smithi045 ceph-mon[35556]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:29:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:57 smithi022 ceph-mon[30966]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:29:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:57 smithi169 ceph-mon[35628]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:29:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:57 smithi045 ceph-mon[35556]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T22:29:59.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:29:59 smithi022 ceph-mon[30966]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T22:29:59.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:29:59 smithi169 ceph-mon[35628]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T22:29:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:29:59 smithi045 ceph-mon[35556]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-11T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:00 smithi169 ceph-mon[35628]: overall HEALTH_OK 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-mon[30966]: overall HEALTH_OK 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:30:00.567+0000 7f69672f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:30:00.567+0000 7f69672f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:30:00.567+0000 7f69672f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:30:00.567+0000 7f69672f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:30:00.902 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:30:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:30:00.567+0000 7f69672f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:30:00.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:00 smithi045 ceph-mon[35556]: overall HEALTH_OK 2024-09-11T22:30:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:01 smithi022 ceph-mon[30966]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:01.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:01 smithi169 ceph-mon[35628]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:01 smithi045 ceph-mon[35556]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:03.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:03 smithi022 ceph-mon[30966]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:03.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:03 smithi022 ceph-mon[30966]: mgrmap e24: x(active, since 60s), standbys: z, y 2024-09-11T22:30:03.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:03 smithi169 ceph-mon[35628]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:03.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:03 smithi169 ceph-mon[35628]: mgrmap e24: x(active, since 60s), standbys: z, y 2024-09-11T22:30:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:03 smithi045 ceph-mon[35556]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-11T22:30:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:03 smithi045 ceph-mon[35556]: mgrmap e24: x(active, since 60s), standbys: z, y 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.978+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3298581059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 msgr2=0x7f1eb01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.978+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3298581059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb01030c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009900 tx=0x7f1ea002a480 comp rx=0 tx=0).stop 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3298581059 shutdown_connections 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3298581059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 0x7f1eb010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3298581059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3298581059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb01030c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3298581059 >> 172.21.15.22:0/3298581059 conn(0x7f1eb0077990 msgr2=0x7f1eb00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3298581059 shutdown_connections 2024-09-11T22:30:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3298581059 wait complete. 2024-09-11T22:30:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 Processor -- start 2024-09-11T22:30:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.979+0000 7f1eb67f1640 1 -- start start 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 0x7f1eb019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0111fd0 con 0x7f1eb0102ce0 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0111e50 con 0x7f1eb0103600 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb67f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0112150 con 0x7f1eb010c0b0 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33382/0 (socket says 172.21.15.22:33382) 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 -- 172.21.15.22:0/3399233943 learned_addr learned my addr 172.21.15.22:0/3399233943 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 0x7f1eb019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 -- 172.21.15.22:0/3399233943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 msgr2=0x7f1eb019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 0x7f1eb019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 -- 172.21.15.22:0/3399233943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 msgr2=0x7f1eb019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaffff640 1 -- 172.21.15.22:0/3399233943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb019f610 con 0x7f1eb0102ce0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.980+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1eaffff640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0006010 tx=0x7f1ea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1ead7fa640 1 -- 172.21.15.22:0/3399233943 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea003f030 con 0x7f1eb0102ce0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb019f8a0 con 0x7f1eb0102ce0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb01a7190 con 0x7f1eb0102ce0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1ead7fa640 1 -- 172.21.15.22:0/3399233943 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea0031a00 con 0x7f1eb0102ce0 2024-09-11T22:30:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.981+0000 7f1ead7fa640 1 -- 172.21.15.22:0/3399233943 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0049060 con 0x7f1eb0102ce0 2024-09-11T22:30:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.984+0000 7f1ead7fa640 1 -- 172.21.15.22:0/3399233943 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f1ea0042030 con 0x7f1eb0102ce0 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.984+0000 7f1eb9663740 1 Processor -- start 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.984+0000 7f1eb9663740 1 -- start start 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fd410 0x556684507770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556684507cb0 0x55668450a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5566844612f0 con 0x5566844fd410 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556684409270 con 0x556684507cb0 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb9663740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55668445d2b0 con 0x5566844fcaf0 2024-09-11T22:30:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:52440/0 (socket says 172.21.15.22:52440) 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/2418895110 learned_addr learned my addr 172.21.15.22:0/2418895110 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556684507cb0 0x55668450a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eaffff640 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fd410 0x556684507770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/2418895110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556684507cb0 msgr2=0x55668450a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556684507cb0 0x55668450a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/2418895110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fd410 msgr2=0x556684507770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fd410 0x556684507770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/2418895110 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556684408340 con 0x5566844fcaf0 2024-09-11T22:30:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.985+0000 7f1ead7fa640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 0x7f1e980a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1ead7fa640 1 -- 172.21.15.22:0/3399233943 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1ea00efa70 con 0x7f1eb0102ce0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1eaffff640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 0x7f1e980a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009f40 tx=0x7f1ea8010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee269af618787387 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1e967fc640 1 -- 172.21.15.22:0/2418895110 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8003b70 con 0x5566844fcaf0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1e967fc640 1 -- 172.21.15.22:0/2418895110 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea8003d10 con 0x5566844fcaf0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.986+0000 7f1e967fc640 1 -- 172.21.15.22:0/2418895110 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8011b60 con 0x5566844fcaf0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- 172.21.15.22:0/2418895110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 msgr2=0x5566844fced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eaffff640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 0x7f1e980a5400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00ed0f0 tx=0x7f1ea00f3580 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009f40 tx=0x7f1ea8010860 comp rx=0 tx=0).stop 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- 172.21.15.22:0/2418895110 shutdown_connections 2024-09-11T22:30:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556684507cb0 0x55668450a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fd410 0x556684507770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 --2- 172.21.15.22:0/2418895110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x5566844fced0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- 172.21.15.22:0/2418895110 >> 172.21.15.22:0/2418895110 conn(0x5566844f9060 msgr2=0x5566844f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- 172.21.15.22:0/2418895110 shutdown_connections 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- 172.21.15.22:0/2418895110 wait complete. 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 -- start start 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.987+0000 7f1eb9663740 1 Processor -- start 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684504b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684505600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55668450a880 con 0x556684507cb0 2024-09-11T22:30:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5566843ea290 con 0x5566844fd410 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55668450aa00 con 0x5566844fcaf0 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb9663740 10 client.0 _ll_register_callbacks cb 0x55668441b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684505600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:42900/0 (socket says 172.21.15.22:42900) 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/3609328109 learned_addr learned my addr 172.21.15.22:0/3609328109 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684504b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/3609328109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 msgr2=0x556684504b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684504b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/3609328109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 msgr2=0x556684505600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684505600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/3609328109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556684174210 con 0x5566844fd410 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400b900 tx=0x7f1ea400bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7354fa2ad2960ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.988+0000 7f1e8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea401b640 con 0x5566844fd410 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea8003d10 con 0x5566844fd410 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1ea401b7e0 con 0x5566844fd410 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ea401b9e0 con 0x5566844fd410 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1eb9663740 10 client.25184 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556684240620 con 0x5566844fd410 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea8003d10 con 0x5566844fd410 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1ea4019020 con 0x5566844fd410 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1eb9663740 10 client.25184 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.989+0000 7f1eb9663740 10 client.25184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb9663740 20 client.25184 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x55668451a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb9663740 4 client.25184 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55668446ea20 con 0x556684517d60 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x55668451a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x55668451a150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676630d0ae868013 server_cookie=3a4a80e5797f71ee in_seq=0 out_seq=0 2024-09-11T22:30:03.998 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.990+0000 7f1e8f7fe640 10 client.25184 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/3609328109 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55668446ea20 con 0x556684517d60 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1e8f7fe640 10 client.25184 handle_command_reply: tid=0 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 client.25184 shutdown 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 msgr2=0x5566845050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400b900 tx=0x7f1ea400bdc0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 shutdown_connections 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x55668451a150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.000 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1e8f7fe640 0 client.25184 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684505600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x5566845050c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 --2- 172.21.15.22:0/3609328109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684504b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.991+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 >> 172.21.15.22:0/3609328109 conn(0x5566844f9060 msgr2=0x5566844fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.992+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 shutdown_connections 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.992+0000 7f1eb9663740 1 -- 172.21.15.22:0/3609328109 wait complete. 2024-09-11T22:30:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:03.992+0000 7f1eb9663740 20 client.25184 trim_cache size 0 max 16384 2024-09-11T22:30:04.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.006+0000 7f1eb9663740 1 Processor -- start 2024-09-11T22:30:04.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.006+0000 7f1eb9663740 1 -- start start 2024-09-11T22:30:04.008 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.006+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.006+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x55668451f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.006+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556684507cb0 0x55668451ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb9663740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00c660 con 0x5566844fcaf0 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb9663740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00eee0 con 0x5566844fd410 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb9663740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00ccd0 con 0x556684507cb0 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33404/0 (socket says 172.21.15.22:33404) 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x55668451f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/948584429 learned_addr learned my addr 172.21.15.22:0/948584429 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/948584429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556684507cb0 msgr2=0x55668451ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:04.009 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556684507cb0 0x55668451ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/948584429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 msgr2=0x556684505430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 -- 172.21.15.22:0/948584429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566844fd240 con 0x5566844fd410 2024-09-11T22:30:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x55668451f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4005fd0 tx=0x7f1ea4011670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bff661b891c8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.007+0000 7f1e95ffb640 1 -- 172.21.15.22:0/948584429 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400b4f0 con 0x5566844fd410 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1e95ffb640 1 -- 172.21.15.22:0/948584429 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea4011830 con 0x5566844fd410 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1e95ffb640 1 -- 172.21.15.22:0/948584429 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40052a0 con 0x5566844fd410 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 -- 172.21.15.22:0/948584429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 msgr2=0x55668451f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x55668451f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4005fd0 tx=0x7f1ea4011670 comp rx=0 tx=0).stop 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 -- 172.21.15.22:0/948584429 shutdown_connections 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556684507cb0 0x55668451ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x55668451f9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 --2- 172.21.15.22:0/948584429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5566844fcaf0 0x556684505430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 -- 172.21.15.22:0/948584429 >> 172.21.15.22:0/948584429 conn(0x5566844f9060 msgr2=0x556684506c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 -- 172.21.15.22:0/948584429 shutdown_connections 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.008+0000 7f1eb9663740 1 -- 172.21.15.22:0/948584429 wait complete. 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 -- start start 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 Processor -- start 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684510500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x556684501930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00d3a0 con 0x556684507cb0 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00e810 con 0x5566844fd410 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00da70 con 0x5566844fcaf0 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb4d8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33416/0 (socket says 172.21.15.22:33416) 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/603158230 learned_addr learned my addr 172.21.15.22:0/603158230 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb9663740 10 client.0 _ll_register_callbacks cb 0x7f1ea4004330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.009+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684510500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x556684501930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/603158230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 msgr2=0x556684510500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684510500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 msgr2=0x556684501930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x556684501930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 -- 172.21.15.22:0/603158230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556684502700 con 0x556684507cb0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb4d8e640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8002230 tx=0x7f1ea8009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a48b6f5aea5d642 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1e8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea801f020 con 0x556684507cb0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1ea80119b0 con 0x556684507cb0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea4011830 con 0x556684507cb0 2024-09-11T22:30:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ea8025040 con 0x556684507cb0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb9663740 10 client.15486 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.010+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556684582a70 con 0x556684507cb0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea4011830 con 0x556684507cb0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1ea802b050 con 0x556684507cb0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 10 client.15486 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 20 client.15486 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x556684584ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 4 client.15486 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556684468d70 con 0x556684517d60 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x556684584ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1eaf7fe640 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x556684584ed0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b48a6551035474 server_cookie=f893274327a4b520 in_seq=0 out_seq=0 2024-09-11T22:30:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.011+0000 7f1e8f7fe640 10 client.15486 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.080+0000 7f1e8f7fe640 1 -- 172.21.15.22:0/603158230 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556684468d70 con 0x556684517d60 2024-09-11T22:30:04.082 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.080+0000 7f1e8f7fe640 10 client.15486 handle_command_reply: tid=0 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.080+0000 7f1eb9663740 1 client.15486 shutdown 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.080+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 msgr2=0x556684501ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.080+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8002230 tx=0x7f1ea8009330 comp rx=0 tx=0).stop 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 shutdown_connections 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556684517d60 0x556684584ed0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556684507cb0 0x556684501ed0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5566844fd410 0x556684501930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 --2- 172.21.15.22:0/603158230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566844fcaf0 0x556684510500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 >> 172.21.15.22:0/603158230 conn(0x5566844f9060 msgr2=0x5566845063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1e8f7fe640 0 client.15486 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 shutdown_connections 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 1 -- 172.21.15.22:0/603158230 wait complete. 2024-09-11T22:30:04.083 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.081+0000 7f1eb9663740 20 client.15486 trim_cache size 0 max 16384 2024-09-11T22:30:04.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:30:04.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:30:04.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:30:04.084 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 msgr2=0x7f1e980a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 0x7f1e980a5400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00ed0f0 tx=0x7f1ea00f3580 comp rx=0 tx=0).stop 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 msgr2=0x7f1eb019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0006010 tx=0x7f1ea00042f0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 shutdown_connections 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f1e980a2f40 0x7f1e980a5400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1eb010c0b0 0x7f1eb019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb0103600 0x7f1eb019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.085 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 --2- 172.21.15.22:0/3399233943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1eb0102ce0 0x7f1eb019a620 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 >> 172.21.15.22:0/3399233943 conn(0x7f1eb0077990 msgr2=0x7f1eb0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 shutdown_connections 2024-09-11T22:30:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:04.082+0000 7f1eb67f1640 1 -- 172.21.15.22:0/3399233943 wait complete. 2024-09-11T22:30:05.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:05 smithi022 ceph-mon[30966]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T22:30:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:05 smithi169 ceph-mon[35628]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T22:30:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:05 smithi045 ceph-mon[35556]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-11T22:30:06.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:06.891 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.474+0000 7f1674771640 1 -- 172.21.15.22:0/1345976152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c100e20 msgr2=0x7f166c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.474+0000 7f1674771640 1 --2- 172.21.15.22:0/1345976152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c100e20 0x7f166c101200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1668009900 tx=0x7f166802a480 comp rx=0 tx=0).stop 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 -- 172.21.15.22:0/1345976152 shutdown_connections 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 --2- 172.21.15.22:0/1345976152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c102ef0 0x7f166c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 --2- 172.21.15.22:0/1345976152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 --2- 172.21.15.22:0/1345976152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c100e20 0x7f166c101200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 -- 172.21.15.22:0/1345976152 >> 172.21.15.22:0/1345976152 conn(0x7f166c0fc7d0 msgr2=0x7f166c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:07.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 -- 172.21.15.22:0/1345976152 shutdown_connections 2024-09-11T22:30:07.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.475+0000 7f1674771640 1 -- 172.21.15.22:0/1345976152 wait complete. 2024-09-11T22:30:07.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 Processor -- start 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 -- start start 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f167250d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1672d0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f167250d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:41296/0 (socket says 172.21.15.22:41296) 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1672d0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49036/0 (socket says 172.21.15.22:49036) 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f167250d640 1 -- 172.21.15.22:0/3050106472 learned_addr learned my addr 172.21.15.22:0/3050106472 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f166c1110a0 con 0x7f166c102ef0 2024-09-11T22:30:07.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f166c110f20 con 0x7f166c100e20 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.476+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f166c111220 con 0x7f166c102570 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f1671d0c640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 -- 172.21.15.22:0/3050106472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 msgr2=0x7f166c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 -- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 msgr2=0x7f166c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c19d370 con 0x7f166c100e20 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f1671d0c640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f1672d0e640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:07.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.477+0000 7f167250d640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1668032fd0 tx=0x7f1668004c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.478+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166803f070 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.478+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1668004460 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.478+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668035030 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.478+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c19d600 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.478+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c19da20 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.479+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c199720 con 0x7f166c100e20 2024-09-11T22:30:07.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.481+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f1668042070 con 0x7f166c100e20 2024-09-11T22:30:07.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.482+0000 7f16637fe640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 0x7f16580a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:07.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.482+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f16680f0030 con 0x7f166c100e20 2024-09-11T22:30:07.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.482+0000 7f1671d0c640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 0x7f16580a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:07.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.483+0000 7f1671d0c640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 0x7f16580a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ff270 tx=0x7f165c005e50 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:07.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.487+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1668049030 con 0x7f166c100e20 2024-09-11T22:30:07.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:07 smithi022 ceph-mon[30966]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:30:07.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.868+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f166c108b50 con 0x7f166c100e20 2024-09-11T22:30:07.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.869+0000 7f16637fe640 1 -- 172.21.15.22:0/3050106472 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f16680bcb20 con 0x7f166c100e20 2024-09-11T22:30:07.870 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:30:07.870 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:30:07.870 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:30:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 msgr2=0x7f16580a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 0x7f16580a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ff270 tx=0x7f165c005e50 comp rx=0 tx=0).stop 2024-09-11T22:30:07.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 msgr2=0x7f166c1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1668032fd0 tx=0x7f1668004c00 comp rx=0 tx=0).stop 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 shutdown_connections 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f16580a2e10 0x7f16580a52d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f166c102ef0 0x7f166c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f166c102570 0x7f166c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 --2- 172.21.15.22:0/3050106472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c100e20 0x7f166c1983c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.871+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 >> 172.21.15.22:0/3050106472 conn(0x7f166c0fc7d0 msgr2=0x7f166c06a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.872+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 shutdown_connections 2024-09-11T22:30:07.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:07.872+0000 7f1674771640 1 -- 172.21.15.22:0/3050106472 wait complete. 2024-09-11T22:30:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:07 smithi169 ceph-mon[35628]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:30:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:07 smithi045 ceph-mon[35556]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:30:08.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:08 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3050106472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:08.497 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 3797d11a --release --await' 2024-09-11T22:30:08.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 3797d11a --release --await 2024-09-11T22:30:08.813 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:08.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:08 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3050106472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:08.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:08 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3050106472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:09.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 -- 172.21.15.22:0/861988183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8101400 msgr2=0x7fc2f810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/861988183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8101400 0x7fc2f810d930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009cd0 tx=0x7fc2f002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 -- 172.21.15.22:0/861988183 shutdown_connections 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/861988183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8101400 0x7fc2f810d930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/861988183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8100a60 0x7fc2f8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/861988183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8106a60 0x7fc2f8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 -- 172.21.15.22:0/861988183 >> 172.21.15.22:0/861988183 conn(0x7fc2f80fc780 msgr2=0x7fc2f80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 -- 172.21.15.22:0/861988183 shutdown_connections 2024-09-11T22:30:09.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.364+0000 7fc2fcea4640 1 -- 172.21.15.22:0/861988183 wait complete. 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.365+0000 7fc2fcea4640 1 Processor -- start 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.365+0000 7fc2fcea4640 1 -- start start 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8101400 0x7fc2f810e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 0x7fc2f810ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8112080 con 0x7fc2f8106a60 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8111f00 con 0x7fc2f8100a60 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2fcea4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8112200 con 0x7fc2f8101400 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 0x7fc2f810ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:41312/0 (socket says 172.21.15.22:41312) 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 -- 172.21.15.22:0/4173802754 learned_addr learned my addr 172.21.15.22:0/4173802754 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8101400 0x7fc2f810e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 -- 172.21.15.22:0/4173802754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8101400 msgr2=0x7fc2f810e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8101400 0x7fc2f810e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 -- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 msgr2=0x7fc2f810ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 0x7fc2f810ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.366+0000 7fc2f659c640 1 -- 172.21.15.22:0/4173802754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f81a6940 con 0x7fc2f8100a60 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 0x7fc2f810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2f659c640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800d950 tx=0x7fc2e800dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2e77fe640 1 -- 172.21.15.22:0/4173802754 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8017030 con 0x7fc2f8100a60 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f81a6c30 con 0x7fc2f8100a60 2024-09-11T22:30:09.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2e77fe640 1 -- 172.21.15.22:0/4173802754 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e8004020 con 0x7fc2f8100a60 2024-09-11T22:30:09.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2e77fe640 1 -- 172.21.15.22:0/4173802754 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80047a0 con 0x7fc2f8100a60 2024-09-11T22:30:09.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.367+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f81a71c0 con 0x7fc2f8100a60 2024-09-11T22:30:09.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2e77fe640 1 -- 172.21.15.22:0/4173802754 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fc2e80041d0 con 0x7fc2f8100a60 2024-09-11T22:30:09.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 Processor -- start 2024-09-11T22:30:09.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 -- start start 2024-09-11T22:30:09.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 0x55e7e9c0d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c17d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c1a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9b72620 con 0x55e7e9c18240 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9b19e50 con 0x55e7e9c0d980 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.370+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9b6e5e0 con 0x55e7e9c0d060 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c17d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c17d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:41322/0 (socket says 172.21.15.22:41322) 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f659c640 1 -- 172.21.15.22:0/3998580427 learned_addr learned my addr 172.21.15.22:0/3998580427 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 0x55e7e9c0d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c1a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2e77fe640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 0x7fc2e00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 -- 172.21.15.22:0/3998580427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 msgr2=0x55e7e9c17d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c17d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 -- 172.21.15.22:0/3998580427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 msgr2=0x55e7e9c1a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2e77fe640 1 -- 172.21.15.22:0/4173802754 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2e80cefd0 con 0x7fc2f8100a60 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c1a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f6d9d640 1 -- 172.21.15.22:0/3998580427 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e9b0ad40 con 0x55e7e9c0d060 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.371+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c1a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.372+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 0x7fc2e00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.372+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 0x55e7e9c0d440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005e30 tx=0x7fc2f0009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace71f1e3fbe1737 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.372+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 0x7fc2e00a52d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0042000 tx=0x7fc2f0044000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2e4ff9640 1 -- 172.21.15.22:0/3998580427 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f004b070 con 0x55e7e9c0d060 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2e4ff9640 1 -- 172.21.15.22:0/3998580427 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2f0036070 con 0x55e7e9c0d060 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2e4ff9640 1 -- 172.21.15.22:0/3998580427 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00456b0 con 0x55e7e9c0d060 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3998580427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 msgr2=0x55e7e9c0d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 0x55e7e9c0d440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005e30 tx=0x7fc2f0009a20 comp rx=0 tx=0).stop 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3998580427 shutdown_connections 2024-09-11T22:30:09.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.373+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c1a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3998580427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d060 0x55e7e9c0d440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3998580427 >> 172.21.15.22:0/3998580427 conn(0x55e7e9c095f0 msgr2=0x55e7e9c099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3998580427 shutdown_connections 2024-09-11T22:30:09.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3998580427 wait complete. 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 -- start start 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.374+0000 7fc2ff27d740 1 Processor -- start 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9c1ae10 con 0x55e7e9c18240 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9afaf10 con 0x55e7e9c0d060 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7e9c1af90 con 0x55e7e9c0d980 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2ff27d740 10 client.0 _ll_register_callbacks cb 0x55e7e9b1edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:39148/0 (socket says 172.21.15.22:39148) 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3814797232 learned_addr learned my addr 172.21.15.22:0/3814797232 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49090/0 (socket says 172.21.15.22:49090) 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 msgr2=0x55e7e9c151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.375+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3814797232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 msgr2=0x55e7e9c15c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3814797232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e9881580 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec010a50 tx=0x7fc2ec010f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5f38c0cd944b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00fbd0 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2f0036070 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2ec00fd70 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec005020 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ff27d740 10 client.25081 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.376+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e7e994b960 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2f0036070 con 0x55e7e9c0d980 2024-09-11T22:30:09.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc2ec0051c0 con 0x55e7e9c0d980 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ff27d740 10 client.25081 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ff27d740 10 client.25081 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ff27d740 20 client.25081 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c2a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.377+0000 7fc2ff27d740 4 client.25081 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.378+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7e9b7fb90 con 0x55e7e9c27ef0 2024-09-11T22:30:09.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.378+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c2a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.378+0000 7fc2ddffb640 10 client.25081 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:09.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.378+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c2a2e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c34da1852e34bd2 server_cookie=8423686250a8a569 in_seq=0 out_seq=0 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3814797232 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7e9b7fb90 con 0x55e7e9c27ef0 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ddffb640 10 client.25081 handle_command_reply: tid=0 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 client.25081 shutdown 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 msgr2=0x55e7e9c15710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec010a50 tx=0x7fc2ec010f10 comp rx=0 tx=0).stop 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 shutdown_connections 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c2a2e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ddffb640 0 client.25081 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c18240 0x55e7e9c15c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c0d980 0x55e7e9c15710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3814797232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 >> 172.21.15.22:0/3814797232 conn(0x55e7e9c095f0 msgr2=0x55e7e9c0f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 shutdown_connections 2024-09-11T22:30:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.379+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3814797232 wait complete. 2024-09-11T22:30:09.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.380+0000 7fc2ff27d740 20 client.25081 trim_cache size 0 max 16384 2024-09-11T22:30:09.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 Processor -- start 2024-09-11T22:30:09.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 -- start start 2024-09-11T22:30:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c300f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c12450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81ada20 con 0x55e7e9c0d060 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81b02a0 con 0x55e7e9c0d980 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81ae090 con 0x55e7e9c18240 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49098/0 (socket says 172.21.15.22:49098) 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 -- 172.21.15.22:0/2705831738 learned_addr learned my addr 172.21.15.22:0/2705831738 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c12450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 -- 172.21.15.22:0/2705831738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 msgr2=0x55e7e9c12450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c12450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 -- 172.21.15.22:0/2705831738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 msgr2=0x55e7e9c300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c300f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f659c640 1 -- 172.21.15.22:0/2705831738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e9c0ce90 con 0x55e7e9c0d060 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.397+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c300f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.398+0000 7fc2f659c640 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8097c60 tx=0x7fc2e80d1420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b358be35c0ff62c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.398+0000 7fc2dffff640 1 -- 172.21.15.22:0/2705831738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80cce60 con 0x55e7e9c0d060 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.398+0000 7fc2dffff640 1 -- 172.21.15.22:0/2705831738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e809b990 con 0x55e7e9c0d060 2024-09-11T22:30:09.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.398+0000 7fc2dffff640 1 -- 172.21.15.22:0/2705831738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8099660 con 0x55e7e9c0d060 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 -- 172.21.15.22:0/2705831738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 msgr2=0x55e7e9c2fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8097c60 tx=0x7fc2e80d1420 comp rx=0 tx=0).stop 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 -- 172.21.15.22:0/2705831738 shutdown_connections 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c12450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d980 0x55e7e9c300f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/2705831738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d060 0x55e7e9c2fbb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 -- 172.21.15.22:0/2705831738 >> 172.21.15.22:0/2705831738 conn(0x55e7e9c095f0 msgr2=0x55e7e9c13aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 -- 172.21.15.22:0/2705831738 shutdown_connections 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.399+0000 7fc2ff27d740 1 -- 172.21.15.22:0/2705831738 wait complete. 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.400+0000 7fc2ff27d740 1 -- start start 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.400+0000 7fc2ff27d740 1 Processor -- start 2024-09-11T22:30:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.400+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.400+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 0x55e7e9c20950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.400+0000 7fc2ff27d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c1d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 0x55e7e9c20950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:41346/0 (socket says 172.21.15.22:41346) 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f659c640 1 -- 172.21.15.22:0/3523985260 learned_addr learned my addr 172.21.15.22:0/3523985260 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2ff27d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81ae760 con 0x55e7e9c0d980 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81afbd0 con 0x55e7e9c0d060 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81aee30 con 0x55e7e9c18240 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f6d9d640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c1d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2ff27d740 10 client.0 _ll_register_callbacks cb 0x7fc2ec010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3523985260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 msgr2=0x55e7e9c1d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c1d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 msgr2=0x55e7e9c20410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f5d9b640 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e9c1da10 con 0x55e7e9c0d980 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.401+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e809b990 con 0x55e7e9c0d980 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2f5d9b640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 0x55e7e9c20950 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0057c0 tx=0x7fc2ec004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1d4f7aa027563c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ddffb640 10 client.15510 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3523985260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec030060 con 0x55e7e9c0d980 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3523985260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2ec00a2d0 con 0x55e7e9c0d980 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3523985260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec004e60 con 0x55e7e9c0d980 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ff27d740 10 client.15510 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:09.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.402+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55e7e9c935b0 con 0x55e7e9c0d980 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3523985260 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc2ec023450 con 0x55e7e9c0d980 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 10 client.15510 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 10 client.15510 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 20 client.15510 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c95b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 4 client.15510 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3797d11a", "release": true, "await": true}] 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3797d11a", "release": true, "await": true}) -- 0x55e7e9b7a0a0 con 0x55e7e9c27ef0 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.403+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c95b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.404+0000 7fc2ddffb640 10 client.15510 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.404+0000 7fc2f659c640 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c95b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05f5218c2944eed server_cookie=608e5b6241eb3b9d in_seq=0 out_seq=0 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ddffb640 1 -- 172.21.15.22:0/3523985260 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e7e9b7a0a0 con 0x55e7e9c27ef0 2024-09-11T22:30:09.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ddffb640 10 client.15510 handle_command_reply: tid=0 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 client.15510 shutdown 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 msgr2=0x55e7e9c20950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 0x55e7e9c20950 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0057c0 tx=0x7fc2ec004a60 comp rx=0 tx=0).stop 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 shutdown_connections 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e7e9c27ef0 0x55e7e9c95b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e9c18240 0x55e7e9c1d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7e9c0d980 0x55e7e9c20950 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 --2- 172.21.15.22:0/3523985260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7e9c0d060 0x55e7e9c20410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 >> 172.21.15.22:0/3523985260 conn(0x55e7e9c095f0 msgr2=0x55e7e9c0eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ddffb640 0 client.15510 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 shutdown_connections 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 1 -- 172.21.15.22:0/3523985260 wait complete. 2024-09-11T22:30:09.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.405+0000 7fc2ff27d740 20 client.15510 trim_cache size 0 max 16384 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 20, 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 4, 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "3797d11a": { 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 4, 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:30:09.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:09.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:09.411 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:09.411 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 msgr2=0x7fc2e00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 0x7fc2e00a52d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0042000 tx=0x7fc2f0044000 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 msgr2=0x7fc2f810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800d950 tx=0x7fc2e800dd50 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 shutdown_connections 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc2e00a2e10 0x7fc2e00a52d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f8106a60 0x7fc2f810ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc2f8101400 0x7fc2f810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 --2- 172.21.15.22:0/4173802754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a60 0x7fc2f810e240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 >> 172.21.15.22:0/4173802754 conn(0x7fc2f80fc780 msgr2=0x7fc2f80fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 shutdown_connections 2024-09-11T22:30:09.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:09.406+0000 7fc2fcea4640 1 -- 172.21.15.22:0/4173802754 wait complete. 2024-09-11T22:30:09.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:09 smithi022 ceph-mon[30966]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:09 smithi169 ceph-mon[35628]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:09 smithi045 ceph-mon[35556]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:10.155 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3797d11a', total seconds elapsed: 28.1 2024-09-11T22:30:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:30:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:10.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:10.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:10.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:30:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:30:11.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:11 smithi022 ceph-mon[30966]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:11.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:11 smithi169 ceph-mon[35628]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:11.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:11 smithi045 ceph-mon[35556]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:13.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:13 smithi022 ceph-mon[30966]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:13 smithi169 ceph-mon[35628]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:13 smithi045 ceph-mon[35556]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-11T22:30:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:15 smithi022 ceph-mon[30966]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:15 smithi169 ceph-mon[35628]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:15 smithi045 ceph-mon[35556]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-11T22:30:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 -- 172.21.15.22:0/2570034342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c102470 msgr2=0x7f826c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 --2- 172.21.15.22:0/2570034342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c102470 0x7f826c10e9a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8264009cd0 tx=0x7f826402a8e0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 -- 172.21.15.22:0/2570034342 shutdown_connections 2024-09-11T22:30:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 --2- 172.21.15.22:0/2570034342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c102470 0x7f826c10e9a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 --2- 172.21.15.22:0/2570034342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 0x7f826c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 --2- 172.21.15.22:0/2570034342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c107b70 0x7f826c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 -- 172.21.15.22:0/2570034342 >> 172.21.15.22:0/2570034342 conn(0x7f826c0fd7d0 msgr2=0x7f826c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 -- 172.21.15.22:0/2570034342 shutdown_connections 2024-09-11T22:30:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.217+0000 7f8270dc0640 1 -- 172.21.15.22:0/2570034342 wait complete. 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 Processor -- start 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 -- start start 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 0x7f826c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c102470 0x7f826c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f826c112040 con 0x7f826c107b70 2024-09-11T22:30:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f826c111ec0 con 0x7f826c101ad0 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f826ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f8270dc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1121c0 con 0x7f826c102470 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f826ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47312/0 (socket says 172.21.15.22:47312) 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.218+0000 7f826ad9d640 1 -- 172.21.15.22:0/1529806037 learned_addr learned my addr 172.21.15.22:0/1529806037 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826a59c640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 0x7f826c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c102470 0x7f826c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 -- 172.21.15.22:0/1529806037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c102470 msgr2=0x7f826c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c102470 0x7f826c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 -- 172.21.15.22:0/1529806037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 msgr2=0x7f826c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 0x7f826c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 -- 172.21.15.22:0/1529806037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c19d280 con 0x7f826c107b70 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f826ad9d640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8264009ca0 tx=0x7f8264032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f825b7fe640 1 -- 172.21.15.22:0/1529806037 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826404c070 con 0x7f826c107b70 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f825b7fe640 1 -- 172.21.15.22:0/1529806037 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8264032d80 con 0x7f826c107b70 2024-09-11T22:30:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f825b7fe640 1 -- 172.21.15.22:0/1529806037 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264004740 con 0x7f826c107b70 2024-09-11T22:30:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.219+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c19d510 con 0x7f826c107b70 2024-09-11T22:30:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.220+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c074420 con 0x7f826c107b70 2024-09-11T22:30:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.223+0000 7f8273c2e740 1 Processor -- start 2024-09-11T22:30:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.223+0000 7f825b7fe640 1 -- 172.21.15.22:0/1529806037 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f826404f070 con 0x7f826c107b70 2024-09-11T22:30:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.223+0000 7f8273c2e740 1 -- start start 2024-09-11T22:30:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a5040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561a4a45b2f0 con 0x561a4a4f6af0 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561a4a403270 con 0x561a4a4f7410 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8273c2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561a4a4572b0 con 0x561a4a501cb0 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:55246/0 (socket says 172.21.15.22:55246) 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47320/0 (socket says 172.21.15.22:47320) 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 -- 172.21.15.22:0/4142428691 learned_addr learned my addr 172.21.15.22:0/4142428691 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 -- 172.21.15.22:0/4142428691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 msgr2=0x561a4a5040a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a5040a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 -- 172.21.15.22:0/4142428691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 msgr2=0x561a4a4f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f826a59c640 1 -- 172.21.15.22:0/4142428691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4a402340 con 0x561a4a4f7410 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f825b7fe640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 0x7f82540a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.224+0000 7f8269d9b640 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f825b7fe640 1 -- 172.21.15.22:0/1529806037 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f82640f3c30 con 0x7f826c107b70 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 0x7f82540a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f826a59c640 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f825c00bc50 tx=0x7f825c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f6d5c514bdb286b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f8258ff9640 1 -- 172.21.15.22:0/4142428691 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c01c480 con 0x561a4a4f7410 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f8258ff9640 1 -- 172.21.15.22:0/4142428691 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f825c01cb20 con 0x561a4a4f7410 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.225+0000 7f8258ff9640 1 -- 172.21.15.22:0/4142428691 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c011d80 con 0x561a4a4f7410 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 -- 172.21.15.22:0/4142428691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 msgr2=0x561a4a501770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 0x7f82540a5400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561a4a4f43e0 tx=0x7f826000b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f825c00bc50 tx=0x7f825c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 -- 172.21.15.22:0/4142428691 shutdown_connections 2024-09-11T22:30:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a5040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f7410 0x561a4a501770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 --2- 172.21.15.22:0/4142428691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f6af0 0x561a4a4f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 -- 172.21.15.22:0/4142428691 >> 172.21.15.22:0/4142428691 conn(0x561a4a4f3060 msgr2=0x561a4a4f3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 -- 172.21.15.22:0/4142428691 shutdown_connections 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.226+0000 7f8273c2e740 1 -- 172.21.15.22:0/4142428691 wait complete. 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8273c2e740 1 -- start start 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8273c2e740 1 Processor -- start 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a4febd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a4ff650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47336/0 (socket says 172.21.15.22:47336) 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f8269d9b640 1 -- 172.21.15.22:0/3100467070 learned_addr learned my addr 172.21.15.22:0/3100467070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.227+0000 7f826a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a4febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561a4a504880 con 0x561a4a4f7410 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561a4a3e4290 con 0x561a4a4f6af0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561a4a504a00 con 0x561a4a501cb0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8273c2e740 10 client.0 _ll_register_callbacks cb 0x561a4a415140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a4ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 -- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 msgr2=0x561a4a4febd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a4febd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 -- 172.21.15.22:0/3100467070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 msgr2=0x561a4a4ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4a16e210 con 0x561a4a501cb0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8269d9b640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f826ad9d640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a4ff650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82640f1250 tx=0x7f82640bfd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d2a755a685c742 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.228+0000 7f8251ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640c8ce0 con 0x561a4a501cb0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f82640c40e0 con 0x561a4a501cb0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f825c01cb20 con 0x561a4a501cb0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f82640c8850 con 0x561a4a501cb0 2024-09-11T22:30:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8273c2e740 10 client.25096 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561a4a23a620 con 0x561a4a501cb0 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.229+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8264036030 con 0x561a4a501cb0 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8264030070 con 0x561a4a501cb0 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 10 client.25096 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 10 client.25096 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 20 client.25096 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a511d00 0x561a4a514160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 4 client.25096 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f825c01cb20 con 0x561a4a511d00 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.230+0000 7f826a59c640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a511d00 0x561a4a514160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.231+0000 7f8251ffb640 10 client.25096 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.231+0000 7f826a59c640 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a511d00 0x561a4a514160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe0b32aaaa54747 server_cookie=8bdfd0a176774e34 in_seq=0 out_seq=0 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.231+0000 7f8251ffb640 1 -- 172.21.15.22:0/3100467070 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f825c01cb20 con 0x561a4a511d00 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.231+0000 7f8251ffb640 10 client.25096 handle_command_reply: tid=0 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.231+0000 7f8273c2e740 1 client.25096 shutdown 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 msgr2=0x561a4a4ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a4ff650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82640f1250 tx=0x7f82640bfd20 comp rx=0 tx=0).stop 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 shutdown_connections 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a511d00 0x561a4a514160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a501cb0 0x561a4a4ff650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8251ffb640 0 client.25096 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 --2- 172.21.15.22:0/3100467070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a4febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 >> 172.21.15.22:0/3100467070 conn(0x561a4a4f3060 msgr2=0x561a4a4f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 shutdown_connections 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 1 -- 172.21.15.22:0/3100467070 wait complete. 2024-09-11T22:30:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.232+0000 7f8273c2e740 20 client.25096 trim_cache size 0 max 16384 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 Processor -- start 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 -- start start 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a4f6af0 0x561a4a4f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 0x561a4a519a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1a9580 con 0x561a4a4f7410 2024-09-11T22:30:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1abde0 con 0x561a4a501cb0 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.260+0000 7f8273c2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1a9bd0 con 0x561a4a4f6af0 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47352/0 (socket says 172.21.15.22:47352) 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 -- 172.21.15.22:0/2299487052 learned_addr learned my addr 172.21.15.22:0/2299487052 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f826a59c640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a4f6af0 0x561a4a4f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f826ad9d640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 0x561a4a519a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 -- 172.21.15.22:0/2299487052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a4f6af0 msgr2=0x561a4a4f95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a4f6af0 0x561a4a4f95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 -- 172.21.15.22:0/2299487052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 msgr2=0x561a4a519a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 0x561a4a519a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 -- 172.21.15.22:0/2299487052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4a4f7240 con 0x561a4a4f7410 2024-09-11T22:30:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f826ad9d640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 0x561a4a519a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8269d9b640 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8260003e90 tx=0x7f8260019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805a1ce336d6d1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.261+0000 7f8253fff640 1 -- 172.21.15.22:0/2299487052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826001ee30 con 0x561a4a4f7410 2024-09-11T22:30:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8253fff640 1 -- 172.21.15.22:0/2299487052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8260005520 con 0x561a4a4f7410 2024-09-11T22:30:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8253fff640 1 -- 172.21.15.22:0/2299487052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260028680 con 0x561a4a4f7410 2024-09-11T22:30:17.267 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 -- 172.21.15.22:0/2299487052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 msgr2=0x561a4a4ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8260003e90 tx=0x7f8260019000 comp rx=0 tx=0).stop 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 -- 172.21.15.22:0/2299487052 shutdown_connections 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a501cb0 0x561a4a519a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a4f7410 0x561a4a4ff480 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 --2- 172.21.15.22:0/2299487052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a4f6af0 0x561a4a4f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.262+0000 7f8273c2e740 1 -- 172.21.15.22:0/2299487052 >> 172.21.15.22:0/2299487052 conn(0x561a4a4f3060 msgr2=0x561a4a500c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.263+0000 7f8273c2e740 1 -- 172.21.15.22:0/2299487052 shutdown_connections 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.263+0000 7f8273c2e740 1 -- 172.21.15.22:0/2299487052 wait complete. 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.263+0000 7f8273c2e740 1 -- start start 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.263+0000 7f8273c2e740 1 Processor -- start 2024-09-11T22:30:17.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.263+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a50a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a511d00 0x561a4a4fbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1aa2a0 con 0x561a4a501cb0 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1ab710 con 0x561a4a4f6af0 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f826c1aa970 con 0x561a4a511d00 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8273c2e740 10 client.0 _ll_register_callbacks cb 0x7f8264032f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47358/0 (socket says 172.21.15.22:47358) 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f826a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a50a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 -- 172.21.15.22:0/1021530693 learned_addr learned my addr 172.21.15.22:0/1021530693 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f826ad9d640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a511d00 0x561a4a4fbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 -- 172.21.15.22:0/1021530693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a511d00 msgr2=0x561a4a4fbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a511d00 0x561a4a4fbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 -- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 msgr2=0x561a4a50a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a50a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.270 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 -- 172.21.15.22:0/1021530693 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4a4fc110 con 0x561a4a501cb0 2024-09-11T22:30:17.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8269d9b640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f826001ec80 tx=0x7f82600056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828472fd81234733 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.264+0000 7f8251ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:17.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260036060 con 0x561a4a501cb0 2024-09-11T22:30:17.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8260005160 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8260005520 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f826001ee30 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8273c2e740 10 client.15528 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561a4a57c7e0 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.265+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8260005360 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f826003baf0 con 0x561a4a501cb0 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 10 client.15528 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 20 client.15528 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a57cdd0 0x561a4a57f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 4 client.15528 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:30:17.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8260005520 con 0x561a4a57cdd0 2024-09-11T22:30:17.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.266+0000 7f826a59c640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a57cdd0 0x561a4a57f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.267+0000 7f826a59c640 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a57cdd0 0x561a4a57f1f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b332d0f5cda10e1d server_cookie=e08a4b30ac7745fa in_seq=0 out_seq=0 2024-09-11T22:30:17.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.268+0000 7f8251ffb640 10 client.15528 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:17.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.270+0000 7f8251ffb640 1 -- 172.21.15.22:0/1021530693 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8260005520 con 0x561a4a57cdd0 2024-09-11T22:30:17.274 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.270+0000 7f8251ffb640 10 client.15528 handle_command_reply: tid=0 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.270+0000 7f8273c2e740 1 client.15528 shutdown 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 msgr2=0x561a4a4fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f826001ec80 tx=0x7f82600056d0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 shutdown_connections 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561a4a57cdd0 0x561a4a57f1f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561a4a511d00 0x561a4a4fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8251ffb640 0 client.15528 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561a4a501cb0 0x561a4a4fb610 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 --2- 172.21.15.22:0/1021530693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561a4a4f6af0 0x561a4a50a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 >> 172.21.15.22:0/1021530693 conn(0x561a4a4f3060 msgr2=0x561a4a4f19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.275 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 shutdown_connections 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 1 -- 172.21.15.22:0/1021530693 wait complete. 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.271+0000 7f8273c2e740 20 client.15528 trim_cache size 0 max 16384 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:30:17.276 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 msgr2=0x7f82540a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 0x7f82540a5400 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561a4a4f43e0 tx=0x7f826000b390 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 msgr2=0x7f826c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8264009ca0 tx=0x7f8264032be0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 shutdown_connections 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82540a2f40 0x7f82540a5400 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f826c107b70 0x7f826c19cb50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f826c102470 0x7f826c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.272+0000 7f8270dc0640 1 --2- 172.21.15.22:0/1529806037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826c101ad0 0x7f826c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.273+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 >> 172.21.15.22:0/1529806037 conn(0x7f826c0fd7d0 msgr2=0x7f826c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.273+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 shutdown_connections 2024-09-11T22:30:17.278 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:17.273+0000 7f8270dc0640 1 -- 172.21.15.22:0/1529806037 wait complete. 2024-09-11T22:30:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:17 smithi022 ceph-mon[30966]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:30:17.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:17 smithi169 ceph-mon[35628]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:30:17.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:17 smithi045 ceph-mon[35556]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 597 B/s wr, 2 op/s 2024-09-11T22:30:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:19 smithi022 ceph-mon[30966]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-11T22:30:19.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:19 smithi169 ceph-mon[35628]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-11T22:30:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:19 smithi045 ceph-mon[35556]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-11T22:30:21.825 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 93% (12058/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-11T22:30:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:21 smithi022 ceph-mon[30966]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:21.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:21 smithi169 ceph-mon[35628]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:21 smithi045 ceph-mon[35556]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T22:30:22.743 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-11T22:30:22.744 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-11T22:30:22.748 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T22:30:22.813 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T22:30:22.816 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:30:22.816 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T22:30:23.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:30:23.415 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:23.652 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T22:30:23.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:23 smithi022 ceph-mon[30966]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:23.766 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T22:30:23.817 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:30:23.819 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:30:23.819 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T22:30:23.860 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:30:23.865 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:30:23.865 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T22:30:23.882 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-11T22:30:23.883 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-11T22:30:23.883 DEBUG:teuthology.orchestra.run.smithi022:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-11T22:30:23.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:23 smithi169 ceph-mon[35628]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:23 smithi045 ceph-mon[35556]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:23.950 INFO:tasks.workunit.client.0.smithi022.stderr:+ KERNEL=linux-4.0.5 2024-09-11T22:30:23.950 INFO:tasks.workunit.client.0.smithi022.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-11T22:30:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 -- 172.21.15.22:0/2533316424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0100e20 msgr2=0x7f44c0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 --2- 172.21.15.22:0/2533316424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0100e20 0x7f44c0101200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009900 tx=0x7f44b002a480 comp rx=0 tx=0).stop 2024-09-11T22:30:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 -- 172.21.15.22:0/2533316424 shutdown_connections 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 --2- 172.21.15.22:0/2533316424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102ef0 0x7f44c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 --2- 172.21.15.22:0/2533316424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0102570 0x7f44c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 --2- 172.21.15.22:0/2533316424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0100e20 0x7f44c0101200 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 -- 172.21.15.22:0/2533316424 >> 172.21.15.22:0/2533316424 conn(0x7f44c00fc7d0 msgr2=0x7f44c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 -- 172.21.15.22:0/2533316424 shutdown_connections 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.072+0000 7f44c601a640 1 -- 172.21.15.22:0/2533316424 wait complete. 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 Processor -- start 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 -- start start 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0100e20 0x7f44c01a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102570 0x7f44c01a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01110f0 con 0x7f44c0102ef0 2024-09-11T22:30:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c0110f70 con 0x7f44c0102570 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44c601a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c0111270 con 0x7f44c0100e20 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47374/0 (socket says 172.21.15.22:47374) 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44bffff640 1 -- 172.21.15.22:0/525827423 learned_addr learned my addr 172.21.15.22:0/525827423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44b7fff640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102570 0x7f44c01a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.073+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0100e20 0x7f44c01a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 -- 172.21.15.22:0/525827423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0100e20 msgr2=0x7f44c01a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0100e20 0x7f44c01a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 -- 172.21.15.22:0/525827423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102570 msgr2=0x7f44c01a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102570 0x7f44c01a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 -- 172.21.15.22:0/525827423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c019f670 con 0x7f44c0102ef0 2024-09-11T22:30:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bffff640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009fd0 tx=0x7f44b800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bd7fa640 1 -- 172.21.15.22:0/525827423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8017070 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bd7fa640 1 -- 172.21.15.22:0/525827423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b8004020 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c019f960 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44bd7fa640 1 -- 172.21.15.22:0/525827423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b80106c0 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.074+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c01ab8c0 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.077+0000 7f44bd7fa640 1 -- 172.21.15.22:0/525827423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f44b80041d0 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.077+0000 7f44bd7fa640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 0x7f44ac0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.077+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 0x7f44ac0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.077+0000 7f44bd7fa640 1 -- 172.21.15.22:0/525827423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f44b80cf350 con 0x7f44c0102ef0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 0x7f44ac0a52d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44b0000c00 tx=0x7f44b0005e80 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 Processor -- start 2024-09-11T22:30:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 -- start start 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965af680 0x5582965b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55829650a2e0 con 0x5582965a4dc0 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5582964b1ce0 con 0x5582965a44a0 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.078+0000 7f44c83f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5582965062a0 con 0x5582965af680 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47388/0 (socket says 172.21.15.22:47388) 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 -- 172.21.15.22:0/680674740 learned_addr learned my addr 172.21.15.22:0/680674740 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44bffff640 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965af680 0x5582965b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 -- 172.21.15.22:0/680674740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965af680 msgr2=0x5582965b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965af680 0x5582965b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 -- 172.21.15.22:0/680674740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 msgr2=0x5582965a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 -- 172.21.15.22:0/680674740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558296496440 con 0x5582965a4dc0 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b7fff640 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f44a800b6c0 tx=0x7f44a800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fe58fd65123692 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b5ffb640 1 -- 172.21.15.22:0/680674740 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8003bd0 con 0x5582965a4dc0 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b5ffb640 1 -- 172.21.15.22:0/680674740 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44a8015070 con 0x5582965a4dc0 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.079+0000 7f44b5ffb640 1 -- 172.21.15.22:0/680674740 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8004e30 con 0x5582965a4dc0 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 -- 172.21.15.22:0/680674740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 msgr2=0x5582965af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f44a800b6c0 tx=0x7f44a800bb80 comp rx=0 tx=0).stop 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 -- 172.21.15.22:0/680674740 shutdown_connections 2024-09-11T22:30:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965af680 0x5582965b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965af140 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 --2- 172.21.15.22:0/680674740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 -- 172.21.15.22:0/680674740 >> 172.21.15.22:0/680674740 conn(0x5582965a0a30 msgr2=0x5582965a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.080+0000 7f44c83f3740 1 -- 172.21.15.22:0/680674740 shutdown_connections 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 -- 172.21.15.22:0/680674740 wait complete. 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 -- start start 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 Processor -- start 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 0x5582965ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5582965b2250 con 0x5582965af680 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5582964c5050 con 0x5582965a44a0 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5582965b23d0 con 0x5582965a4dc0 2024-09-11T22:30:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.081+0000 7f44c83f3740 10 client.0 _ll_register_callbacks cb 0x558296505160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47396/0 (socket says 172.21.15.22:47396) 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 -- 172.21.15.22:0/3589878092 learned_addr learned my addr 172.21.15.22:0/3589878092 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 0x5582965ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 -- 172.21.15.22:0/3589878092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 msgr2=0x5582965ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 0x5582965ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 -- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 msgr2=0x5582965aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 -- 172.21.15.22:0/3589878092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55829627b3c0 con 0x5582965af680 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 0x5582965ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44bffff640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cca80 tx=0x7f44b809b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c9119e6426f335 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f449effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8020040 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f44b8097d90 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44a8015070 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f44b80ccc50 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44c83f3740 10 client.15540 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.082+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582965bdbc0 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44a8015070 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f44b809ab70 con 0x5582965af680 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 10 client.15540 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:24.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 20 client.15540 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965bf080 0x5582965c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 4 client.15540 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558296517850 con 0x5582965bf080 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.083+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965bf080 0x5582965c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.084+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965bf080 0x5582965c14d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f886125d722af896 server_cookie=6d05f61a90aa6b3c in_seq=0 out_seq=0 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.084+0000 7f449effd640 10 client.15540 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.084+0000 7f449effd640 1 -- 172.21.15.22:0/3589878092 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558296517850 con 0x5582965bf080 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.084+0000 7f449effd640 10 client.15540 handle_command_reply: tid=0 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.084+0000 7f44c83f3740 1 client.15540 shutdown 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 msgr2=0x5582965ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cca80 tx=0x7f44b809b600 comp rx=0 tx=0).stop 2024-09-11T22:30:24.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 shutdown_connections 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965bf080 0x5582965c14d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965af680 0x5582965ac760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a4dc0 0x5582965ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3589878092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a44a0 0x5582965aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 >> 172.21.15.22:0/3589878092 conn(0x5582965a0a30 msgr2=0x55829659fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f449effd640 0 client.15540 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 shutdown_connections 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 1 -- 172.21.15.22:0/3589878092 wait complete. 2024-09-11T22:30:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.085+0000 7f44c83f3740 20 client.15540 trim_cache size 0 max 16384 2024-09-11T22:30:24.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.122+0000 7f44c83f3740 1 Processor -- start 2024-09-11T22:30:24.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 -- start start 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a0a30 0x5582965bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b1df0 con 0x5582965a4dc0 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b4670 con 0x5582965a0a30 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44c83f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b2460 con 0x5582965a44a0 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53422/0 (socket says 172.21.15.22:53422) 2024-09-11T22:30:24.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 -- 172.21.15.22:0/2222414918 learned_addr learned my addr 172.21.15.22:0/2222414918 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a0a30 0x5582965bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 -- 172.21.15.22:0/2222414918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 msgr2=0x5582965c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 -- 172.21.15.22:0/2222414918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a0a30 msgr2=0x5582965bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a0a30 0x5582965bb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44bffff640 1 -- 172.21.15.22:0/2222414918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582965a4220 con 0x5582965a4dc0 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.123+0000 7f44b7fff640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.124+0000 7f44bffff640 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44b809b420 tx=0x7f44b80a4460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab3d590be475925 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.124+0000 7f44b57fa640 1 -- 172.21.15.22:0/2222414918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b809fa20 con 0x5582965a4dc0 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.124+0000 7f44b57fa640 1 -- 172.21.15.22:0/2222414918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b80ccdf0 con 0x5582965a4dc0 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.124+0000 7f44b57fa640 1 -- 172.21.15.22:0/2222414918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b80afb90 con 0x5582965a4dc0 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- 172.21.15.22:0/2222414918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 msgr2=0x5582965c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f44b809b420 tx=0x7f44b80a4460 comp rx=0 tx=0).stop 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- 172.21.15.22:0/2222414918 shutdown_connections 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a4dc0 0x5582965c7330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 --2- 172.21.15.22:0/2222414918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a0a30 0x5582965bb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- 172.21.15.22:0/2222414918 >> 172.21.15.22:0/2222414918 conn(0x5582965ac8c0 msgr2=0x5582965aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- 172.21.15.22:0/2222414918 shutdown_connections 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- 172.21.15.22:0/2222414918 wait complete. 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.125+0000 7f44c83f3740 1 -- start start 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 Processor -- start 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 0x5582965b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b2b30 con 0x5582965a0a30 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b3fa0 con 0x5582965a4dc0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c01b3200 con 0x5582965a44a0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44c83f3740 10 client.0 _ll_register_callbacks cb 0x7f44b80044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44bf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53426/0 (socket says 172.21.15.22:53426) 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44bf7fe640 1 -- 172.21.15.22:0/3506425093 learned_addr learned my addr 172.21.15.22:0/3506425093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44bf7fe640 1 -- 172.21.15.22:0/3506425093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 msgr2=0x5582965b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.126+0000 7f44bffff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 0x5582965b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bf7fe640 1 -- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 msgr2=0x5582965b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 0x5582965b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bf7fe640 1 -- 172.21.15.22:0/3506425093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558296629060 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bffff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 0x5582965b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44bf7fe640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009230 tx=0x7f44b002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7423b887d9f6bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f449effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0035040 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f44b00046c0 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44b80ccdf0 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f44b0060020 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44c83f3740 10 client.15546 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55829662a3d0 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.127+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b0004dc0 con 0x5582965a0a30 2024-09-11T22:30:24.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f44b00035f0 con 0x5582965a0a30 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 10 client.15546 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 20 client.15546 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965af680 0x55829662cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 4 client.15546 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:30:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f44b80ccdf0 con 0x5582965af680 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.128+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965af680 0x55829662cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44b7fff640 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965af680 0x55829662cb30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856f6a8395b868ed server_cookie=4c8504e7aff73681 in_seq=0 out_seq=0 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f449effd640 10 client.15546 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f449effd640 1 -- 172.21.15.22:0/3506425093 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f44b80ccdf0 con 0x5582965af680 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f449effd640 10 client.15546 handle_command_reply: tid=0 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 client.15546 shutdown 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 msgr2=0x5582965b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009230 tx=0x7f44b002a480 comp rx=0 tx=0).stop 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 shutdown_connections 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5582965af680 0x55829662cb30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5582965a4dc0 0x5582965b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5582965a44a0 0x5582965b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 --2- 172.21.15.22:0/3506425093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5582965a0a30 0x5582965b3640 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 >> 172.21.15.22:0/3506425093 conn(0x5582965ac8c0 msgr2=0x55829659fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f449effd640 0 client.15546 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 shutdown_connections 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 1 -- 172.21.15.22:0/3506425093 wait complete. 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.129+0000 7f44c83f3740 20 client.15546 trim_cache size 0 max 16384 2024-09-11T22:30:24.135 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:30:24.136 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:30:24.136 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:30:24.136 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:30:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 msgr2=0x7f44ac0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 0x7f44ac0a52d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44b0000c00 tx=0x7f44b0005e80 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 msgr2=0x7f44c019edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009fd0 tx=0x7f44b800b260 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 shutdown_connections 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2e10 0x7f44ac0a52d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c0102ef0 0x7f44c019edb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c0102570 0x7f44c01a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 --2- 172.21.15.22:0/525827423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c0100e20 0x7f44c01a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 >> 172.21.15.22:0/525827423 conn(0x7f44c00fc7d0 msgr2=0x7f44c006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 shutdown_connections 2024-09-11T22:30:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:24.130+0000 7f44c601a640 1 -- 172.21.15.22:0/525827423 wait complete. 2024-09-11T22:30:25.260 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:30:25.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:25.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:25 smithi022 ceph-mon[30966]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:25 smithi169 ceph-mon[35628]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:25 smithi045 ceph-mon[35556]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 -- 172.21.15.22:0/4090300883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 msgr2=0x7f7d8c100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 --2- 172.21.15.22:0/4090300883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c100db0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009900 tx=0x7f7d7c02a410 comp rx=0 tx=0).stop 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 -- 172.21.15.22:0/4090300883 shutdown_connections 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 --2- 172.21.15.22:0/4090300883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 --2- 172.21.15.22:0/4090300883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 0x7f7d8c10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 --2- 172.21.15.22:0/4090300883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c100db0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 -- 172.21.15.22:0/4090300883 >> 172.21.15.22:0/4090300883 conn(0x7f7d8c0fc7d0 msgr2=0x7f7d8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 -- 172.21.15.22:0/4090300883 shutdown_connections 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.026+0000 7f7d9256e640 1 -- 172.21.15.22:0/4090300883 wait complete. 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 Processor -- start 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 -- start start 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 0x7f7d8c1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c114380 con 0x7f7d8c1009d0 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c114200 con 0x7f7d8c10e4f0 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d9256e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c114500 con 0x7f7d8c101380 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53452/0 (socket says 172.21.15.22:53452) 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d8bfff640 1 -- 172.21.15.22:0/514889430 learned_addr learned my addr 172.21.15.22:0/514889430 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.027+0000 7f7d8b7fe640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 0x7f7d8c1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d90b0b640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 -- 172.21.15.22:0/514889430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 msgr2=0x7f7d8c1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 0x7f7d8c1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 -- 172.21.15.22:0/514889430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 msgr2=0x7f7d8c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 -- 172.21.15.22:0/514889430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c19aec0 con 0x7f7d8c1009d0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d90b0b640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d8bfff640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006010 tx=0x7f7d7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c03f030 con 0x7f7d8c1009d0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c19b150 con 0x7f7d8c1009d0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d7c003d00 con 0x7f7d8c1009d0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c035070 con 0x7f7d8c1009d0 2024-09-11T22:30:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.028+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1a7330 con 0x7f7d8c1009d0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.029+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c06a7d0 con 0x7f7d8c1009d0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.030+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f7d7c042030 con 0x7f7d8c1009d0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.031+0000 7f7d897fa640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 0x7f7d780a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.031+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7d7c0efe90 con 0x7f7d8c1009d0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.031+0000 7f7d8b7fe640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 0x7f7d780a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.032+0000 7f7d8b7fe640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 0x7f7d780a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c19bea0 tx=0x7f7d7400b410 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.034+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d7c0bca40 con 0x7f7d8c1009d0 2024-09-11T22:30:26.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.247+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d8c109680 con 0x7f7d8c1009d0 2024-09-11T22:30:26.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.248+0000 7f7d897fa640 1 -- 172.21.15.22:0/514889430 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f7d7c0bc340 con 0x7f7d8c1009d0 2024-09-11T22:30:26.249 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:30:26.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:30:26.249 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 msgr2=0x7f7d780a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 0x7f7d780a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c19bea0 tx=0x7f7d7400b410 comp rx=0 tx=0).stop 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 msgr2=0x7f7d8c1a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006010 tx=0x7f7d7c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 shutdown_connections 2024-09-11T22:30:26.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d780a2e10 0x7f7d780a52d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d8c10e4f0 0x7f7d8c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d8c101380 0x7f7d8c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 --2- 172.21.15.22:0/514889430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d8c1009d0 0x7f7d8c1a0580 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.250+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 >> 172.21.15.22:0/514889430 conn(0x7f7d8c0fc7d0 msgr2=0x7f7d8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.251+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 shutdown_connections 2024-09-11T22:30:26.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:26.251+0000 7f7d9256e640 1 -- 172.21.15.22:0/514889430 wait complete. 2024-09-11T22:30:26.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:26 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/514889430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:26.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:26 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/514889430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:26.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:26 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/514889430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:26.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:30:27.215 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:27.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:27 smithi022 ceph-mon[30966]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:27.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1740260041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 msgr2=0x7f5eb8113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1740260041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8113370 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009900 tx=0x7f5ea802a410 comp rx=0 tx=0).stop 2024-09-11T22:30:27.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1740260041 shutdown_connections 2024-09-11T22:30:27.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1740260041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb8113940 0x7f5eb8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1740260041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8113370 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1740260041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb810a560 0x7f5eb810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1740260041 >> 172.21.15.22:0/1740260041 conn(0x7f5eb806e140 msgr2=0x7f5eb806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1740260041 shutdown_connections 2024-09-11T22:30:27.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.737+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1740260041 wait complete. 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 Processor -- start 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 -- start start 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb810a560 0x7f5eb8070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb8113940 0x7f5eb80712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81197f0 con 0x7f5eb810ae80 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8119670 con 0x7f5eb810a560 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.738+0000 7f5ebcbb1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8119970 con 0x7f5eb8113940 2024-09-11T22:30:27.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53456/0 (socket says 172.21.15.22:53456) 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 -- 172.21.15.22:0/1537879114 learned_addr learned my addr 172.21.15.22:0/1537879114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb8113940 0x7f5eb80712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eb659c640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb810a560 0x7f5eb8070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 -- 172.21.15.22:0/1537879114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb8113940 msgr2=0x7f5eb80712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb8113940 0x7f5eb80712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 -- 172.21.15.22:0/1537879114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb810a560 msgr2=0x7f5eb8070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb810a560 0x7f5eb8070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 -- 172.21.15.22:0/1537879114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb81af240 con 0x7f5eb810ae80 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaffff640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006010 tx=0x7f5ea80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaf7fe640 1 -- 172.21.15.22:0/1537879114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea803f030 con 0x7f5eb810ae80 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaf7fe640 1 -- 172.21.15.22:0/1537879114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea8003d00 con 0x7f5eb810ae80 2024-09-11T22:30:27.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb81af4d0 con 0x7f5eb810ae80 2024-09-11T22:30:27.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5eaf7fe640 1 -- 172.21.15.22:0/1537879114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8035070 con 0x7f5eb810ae80 2024-09-11T22:30:27.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.739+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81af9b0 con 0x7f5eb810ae80 2024-09-11T22:30:27.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.742+0000 7f5eaf7fe640 1 -- 172.21.15.22:0/1537879114 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f5ea8042030 con 0x7f5eb810ae80 2024-09-11T22:30:27.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.742+0000 7f5ebef8a740 1 Processor -- start 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 -- start start 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d565090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 0x56002d565a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d572760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56002d4cb2f0 con 0x56002d566b40 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56002d472cf0 con 0x56002d5655d0 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56002d4c72b0 con 0x56002d570370 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eaf7fe640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 0x7f5e980a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d565090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d565090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53470/0 (socket says 172.21.15.22:53470) 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb6d9d640 1 -- 172.21.15.22:0/43591161 learned_addr learned my addr 172.21.15.22:0/43591161 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:27.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 0x56002d565a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eaffff640 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d572760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eaf7fe640 1 -- 172.21.15.22:0/1537879114 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5ea80efb50 con 0x7f5eb810ae80 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 0x7f5e980a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 -- 172.21.15.22:0/43591161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 msgr2=0x56002d572760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d572760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 -- 172.21.15.22:0/43591161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 msgr2=0x56002d565090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d565090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.743+0000 7f5eb659c640 1 -- 172.21.15.22:0/43591161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002d4573a0 con 0x56002d5655d0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.744+0000 7f5eb659c640 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 0x56002d565a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000bbf0 tx=0x7f5ea00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35985ed276cc942 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.744+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 0x7f5e980a52d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000aa80 tx=0x7f5eb0004a40 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.744+0000 7f5eacff9640 1 -- 172.21.15.22:0/43591161 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0004030 con 0x56002d5655d0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.744+0000 7f5eacff9640 1 -- 172.21.15.22:0/43591161 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea00041d0 con 0x56002d5655d0 2024-09-11T22:30:27.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.744+0000 7f5eacff9640 1 -- 172.21.15.22:0/43591161 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00117a0 con 0x56002d5655d0 2024-09-11T22:30:27.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- 172.21.15.22:0/43591161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 msgr2=0x56002d565a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 0x56002d565a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000bbf0 tx=0x7f5ea00107a0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- 172.21.15.22:0/43591161 shutdown_connections 2024-09-11T22:30:27.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d572760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d5655d0 0x56002d565a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/43591161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d565090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- 172.21.15.22:0/43591161 >> 172.21.15.22:0/43591161 conn(0x56002d52e310 msgr2=0x56002d561c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- 172.21.15.22:0/43591161 shutdown_connections 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- 172.21.15.22:0/43591161 wait complete. 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 -- start start 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.745+0000 7f5ebef8a740 1 Processor -- start 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d56fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 0x56002d56d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56002d573070 con 0x56002d566b40 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56002d486060 con 0x56002d570370 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56002d5731f0 con 0x56002d5655d0 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 10 client.0 _ll_register_callbacks cb 0x56002d1d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53486/0 (socket says 172.21.15.22:53486) 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 -- 172.21.15.22:0/3738876253 learned_addr learned my addr 172.21.15.22:0/3738876253 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 0x56002d56d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d56fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 -- 172.21.15.22:0/3738876253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 msgr2=0x56002d56fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d56fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 -- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 msgr2=0x56002d56d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 0x56002d56d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 -- 172.21.15.22:0/3738876253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002d23c3c0 con 0x56002d566b40 2024-09-11T22:30:27.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 0x56002d56d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d56fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5eaffff640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8005940 tx=0x7f5ea808b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b4f7a87537ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8049040 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5ea803b460 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.746+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea00041d0 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5ea80bba10 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 10 client.15564 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56002d57eaf0 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea00041d0 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5ea80bc310 con 0x56002d566b40 2024-09-11T22:30:27.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 10 client.15564 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 20 client.15564 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d57fee0 0x56002d5822d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 4 client.15564 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.747+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56002d4d8860 con 0x56002d57fee0 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.748+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d57fee0 0x56002d5822d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.748+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d57fee0 0x56002d5822d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=951b4f9b93a3f9f0 server_cookie=c8ca1d17f7530f63 in_seq=0 out_seq=0 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.748+0000 7f5ea5ffb640 10 client.15564 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3738876253 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56002d4d8860 con 0x56002d57fee0 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ea5ffb640 10 client.15564 handle_command_reply: tid=0 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 client.15564 shutdown 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 msgr2=0x56002d56d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8005940 tx=0x7f5ea808b0a0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 shutdown_connections 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d57fee0 0x56002d5822d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d570370 0x56002d56d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d566b40 0x56002d56d000 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3738876253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d56fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 >> 172.21.15.22:0/3738876253 conn(0x56002d52e310 msgr2=0x56002d567960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ea5ffb640 0 client.15564 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 shutdown_connections 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3738876253 wait complete. 2024-09-11T22:30:27.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.749+0000 7f5ebef8a740 20 client.15564 trim_cache size 0 max 16384 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 Processor -- start 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 -- start start 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d57c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d568120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b6240 con 0x56002d5655d0 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b8ac0 con 0x56002d566b40 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b68b0 con 0x56002d570370 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.762+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53490/0 (socket says 172.21.15.22:53490) 2024-09-11T22:30:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 -- 172.21.15.22:0/1515561703 learned_addr learned my addr 172.21.15.22:0/1515561703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d568120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eaffff640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d57c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 -- 172.21.15.22:0/1515561703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 msgr2=0x56002d568120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d568120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 -- 172.21.15.22:0/1515561703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 msgr2=0x56002d57c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d57c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 -- 172.21.15.22:0/1515561703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002d582600 con 0x56002d5655d0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eaffff640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d57c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5eb659c640 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x56002d562ac0 tx=0x7f5ea000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21838fc5029a039f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5ea7fff640 1 -- 172.21.15.22:0/1515561703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0005240 con 0x56002d5655d0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5ea7fff640 1 -- 172.21.15.22:0/1515561703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea00053e0 con 0x56002d5655d0 2024-09-11T22:30:27.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.763+0000 7f5ea7fff640 1 -- 172.21.15.22:0/1515561703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00116b0 con 0x56002d5655d0 2024-09-11T22:30:27.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- 172.21.15.22:0/1515561703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 msgr2=0x56002d566300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x56002d562ac0 tx=0x7f5ea000b390 comp rx=0 tx=0).stop 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- 172.21.15.22:0/1515561703 shutdown_connections 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d570370 0x56002d568120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d57c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/1515561703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d5655d0 0x56002d566300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- 172.21.15.22:0/1515561703 >> 172.21.15.22:0/1515561703 conn(0x56002d52e310 msgr2=0x56002d55ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- 172.21.15.22:0/1515561703 shutdown_connections 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- 172.21.15.22:0/1515561703 wait complete. 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 -- start start 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.764+0000 7f5ebef8a740 1 Processor -- start 2024-09-11T22:30:27.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b6f80 con 0x56002d570370 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b83f0 con 0x56002d566b40 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81b7650 con 0x56002d5655d0 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ebef8a740 10 client.0 _ll_register_callbacks cb 0x7f5ea8005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53500/0 (socket says 172.21.15.22:53500) 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:34374/0 (socket says 172.21.15.22:34374) 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40764/0 (socket says 172.21.15.22:40764) 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 -- 172.21.15.22:0/3511033317 learned_addr learned my addr 172.21.15.22:0/3511033317 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 -- 172.21.15.22:0/3511033317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 msgr2=0x56002d578aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 -- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 msgr2=0x56002d569c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 -- 172.21.15.22:0/3511033317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002d56a880 con 0x56002d570370 2024-09-11T22:30:27.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eaffff640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5eb6d9d640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0019490 tx=0x7f5eb0004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c460d669d1b950eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.765+0000 7f5ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb002a020 con 0x56002d570370 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5eb0019d10 con 0x56002d570370 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea00053e0 con 0x56002d570370 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5eb0035050 con 0x56002d570370 2024-09-11T22:30:27.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 10 client.15570 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56002d5eaa40 con 0x56002d570370 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea00053e0 con 0x56002d570370 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5eb0025680 con 0x56002d570370 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 10 client.15570 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 20 client.15570 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d5eb1b0 0x56002d5ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 4 client.15570 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:30:27.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.766+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56002d4d2d70 con 0x56002d5eb1b0 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d5eb1b0 0x56002d5ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5eb659c640 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d5eb1b0 0x56002d5ed5d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26fc97e786c00ab5 server_cookie=4654df8342e9f39b in_seq=0 out_seq=0 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ea5ffb640 10 client.15570 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ea5ffb640 1 -- 172.21.15.22:0/3511033317 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56002d4d2d70 con 0x56002d5eb1b0 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ea5ffb640 10 client.15570 handle_command_reply: tid=0 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ebef8a740 1 client.15570 shutdown 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 msgr2=0x56002d56a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0019490 tx=0x7f5eb0004b50 comp rx=0 tx=0).stop 2024-09-11T22:30:27.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 shutdown_connections 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.767+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56002d5eb1b0 0x56002d5ed5d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002d570370 0x56002d56a190 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002d566b40 0x56002d569c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 --2- 172.21.15.22:0/3511033317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002d5655d0 0x56002d578aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 >> 172.21.15.22:0/3511033317 conn(0x56002d52e310 msgr2=0x56002d56f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ea5ffb640 0 client.15570 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 shutdown_connections 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 1 -- 172.21.15.22:0/3511033317 wait complete. 2024-09-11T22:30:27.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebef8a740 20 client.15570 trim_cache size 0 max 16384 2024-09-11T22:30:27.777 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:30:27.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 msgr2=0x7f5e980a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 0x7f5e980a52d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000aa80 tx=0x7f5eb0004a40 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 msgr2=0x7f5eb8070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8006010 tx=0x7f5ea80042f0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 shutdown_connections 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5e980a2e10 0x7f5e980a52d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5eb8113940 0x7f5eb80712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eb810ae80 0x7f5eb8070db0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 --2- 172.21.15.22:0/1537879114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eb810a560 0x7f5eb8070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 >> 172.21.15.22:0/1537879114 conn(0x7f5eb806e140 msgr2=0x7f5eb8109470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 shutdown_connections 2024-09-11T22:30:27.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:27.768+0000 7f5ebcbb1640 1 -- 172.21.15.22:0/1537879114 wait complete. 2024-09-11T22:30:27.821 INFO:tasks.workunit.client.0.smithi022.stderr:+ mkdir untar_tar 2024-09-11T22:30:27.825 INFO:tasks.workunit.client.0.smithi022.stderr:+ cd untar_tar 2024-09-11T22:30:27.825 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-11T22:30:27.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:27 smithi169 ceph-mon[35628]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:27.911 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ 2024-09-11T22:30:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:27 smithi045 ceph-mon[35556]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:30:27.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-11T22:30:27.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-11T22:30:27.915 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-11T22:30:27.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-11T22:30:27.917 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-11T22:30:27.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-11T22:30:27.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-11T22:30:27.920 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-11T22:30:27.921 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-11T22:30:27.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-11T22:30:27.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-11T22:30:27.924 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-11T22:30:27.925 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-11T22:30:27.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-11T22:30:27.927 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-11T22:30:27.928 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-11T22:30:27.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-11T22:30:27.930 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-11T22:30:27.931 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-11T22:30:27.932 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-11T22:30:27.933 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-11T22:30:27.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-11T22:30:27.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-11T22:30:27.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-11T22:30:27.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-11T22:30:27.938 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-11T22:30:27.939 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-11T22:30:27.940 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-11T22:30:27.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-11T22:30:27.942 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-11T22:30:27.943 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-11T22:30:27.944 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-11T22:30:27.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-11T22:30:27.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-11T22:30:27.946 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-11T22:30:27.948 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-11T22:30:27.948 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-11T22:30:27.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-11T22:30:27.950 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-11T22:30:27.951 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-11T22:30:27.952 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-11T22:30:27.953 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-11T22:30:27.954 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-11T22:30:27.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-11T22:30:27.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-11T22:30:27.957 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-11T22:30:27.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-11T22:30:27.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-11T22:30:27.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-11T22:30:27.960 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-11T22:30:27.962 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-11T22:30:27.963 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-11T22:30:27.964 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-11T22:30:27.965 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-11T22:30:27.966 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-11T22:30:27.967 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-11T22:30:27.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-11T22:30:27.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-11T22:30:27.970 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-11T22:30:27.971 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-11T22:30:27.972 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-11T22:30:27.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-11T22:30:27.974 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-11T22:30:27.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-11T22:30:27.976 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-11T22:30:27.977 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-11T22:30:27.978 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-11T22:30:27.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-11T22:30:27.980 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-11T22:30:27.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-11T22:30:27.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-11T22:30:27.982 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-11T22:30:27.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-11T22:30:27.984 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-11T22:30:27.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-11T22:30:27.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-11T22:30:27.987 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-11T22:30:27.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-11T22:30:27.989 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-11T22:30:27.990 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-11T22:30:27.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-11T22:30:27.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-11T22:30:27.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-11T22:30:27.994 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-11T22:30:27.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-11T22:30:27.996 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-11T22:30:27.996 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-11T22:30:27.997 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-11T22:30:27.998 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-11T22:30:27.999 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-11T22:30:28.000 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-11T22:30:28.001 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-11T22:30:28.002 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-11T22:30:28.002 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-11T22:30:28.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-11T22:30:28.004 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-11T22:30:28.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-11T22:30:28.006 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-11T22:30:28.007 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-11T22:30:28.008 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-11T22:30:28.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-11T22:30:28.010 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-11T22:30:28.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-11T22:30:28.012 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-11T22:30:28.013 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-11T22:30:28.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-11T22:30:28.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-11T22:30:28.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-11T22:30:28.018 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-11T22:30:28.019 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-11T22:30:28.019 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-11T22:30:28.020 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-11T22:30:28.021 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-11T22:30:28.022 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-11T22:30:28.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-11T22:30:28.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-11T22:30:28.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-11T22:30:28.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-11T22:30:28.026 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-11T22:30:28.027 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-11T22:30:28.028 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-11T22:30:28.028 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-11T22:30:28.029 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-11T22:30:28.030 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-11T22:30:28.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-11T22:30:28.032 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-11T22:30:28.033 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-11T22:30:28.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-11T22:30:28.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-11T22:30:28.035 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-11T22:30:28.036 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-11T22:30:28.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-11T22:30:28.038 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-11T22:30:28.039 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-11T22:30:28.040 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-11T22:30:28.040 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-11T22:30:28.041 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-11T22:30:28.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-11T22:30:28.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-11T22:30:28.044 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-11T22:30:28.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-11T22:30:28.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-11T22:30:28.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-11T22:30:28.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-11T22:30:28.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-11T22:30:28.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-11T22:30:28.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-11T22:30:28.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-11T22:30:28.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-11T22:30:28.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-11T22:30:28.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-11T22:30:28.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-11T22:30:28.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-11T22:30:28.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-11T22:30:28.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-11T22:30:28.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-11T22:30:28.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-11T22:30:28.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-11T22:30:28.060 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-11T22:30:28.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-11T22:30:28.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-11T22:30:28.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-11T22:30:28.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-11T22:30:28.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-11T22:30:28.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-11T22:30:28.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-11T22:30:28.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-11T22:30:28.068 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-11T22:30:28.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-11T22:30:28.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-11T22:30:28.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-11T22:30:28.071 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-11T22:30:28.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-11T22:30:28.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-11T22:30:28.074 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-11T22:30:28.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-11T22:30:28.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-11T22:30:28.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-11T22:30:28.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-11T22:30:28.078 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-11T22:30:28.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-11T22:30:28.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-11T22:30:28.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-11T22:30:28.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-11T22:30:28.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-11T22:30:28.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-11T22:30:28.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-11T22:30:28.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-11T22:30:28.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-11T22:30:28.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-11T22:30:28.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-11T22:30:28.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-11T22:30:28.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-11T22:30:28.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-11T22:30:28.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-11T22:30:28.092 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-11T22:30:28.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-11T22:30:28.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-11T22:30:29.177 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-11T22:30:29.177 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-11T22:30:29.179 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-11T22:30:29.180 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-11T22:30:29.181 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-11T22:30:29.182 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-11T22:30:29.183 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-11T22:30:29.184 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-11T22:30:29.185 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-11T22:30:29.186 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-11T22:30:29.187 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-11T22:30:29.189 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-11T22:30:29.190 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-11T22:30:29.191 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-11T22:30:29.192 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-11T22:30:29.193 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-11T22:30:29.194 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-11T22:30:29.195 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-11T22:30:29.196 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-11T22:30:29.197 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-11T22:30:29.198 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-11T22:30:29.199 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-11T22:30:29.201 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-11T22:30:29.202 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-11T22:30:29.203 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-11T22:30:29.205 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-11T22:30:29.205 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-11T22:30:29.206 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-11T22:30:29.207 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-11T22:30:29.208 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-11T22:30:29.209 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-11T22:30:29.210 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-11T22:30:29.211 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-11T22:30:29.212 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-11T22:30:29.213 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-11T22:30:29.214 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-11T22:30:29.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-11T22:30:29.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-11T22:30:29.217 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-11T22:30:29.218 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-11T22:30:29.219 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-11T22:30:29.220 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-11T22:30:29.221 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-11T22:30:29.222 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-11T22:30:29.223 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-11T22:30:29.224 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-11T22:30:29.225 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-11T22:30:29.226 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-11T22:30:29.227 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-11T22:30:29.228 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-11T22:30:29.229 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-11T22:30:29.230 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-11T22:30:29.231 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-11T22:30:29.232 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-11T22:30:29.233 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-11T22:30:29.234 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-11T22:30:29.235 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-11T22:30:29.236 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-11T22:30:29.237 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-11T22:30:29.238 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-11T22:30:29.239 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-11T22:30:29.240 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-11T22:30:29.241 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-11T22:30:29.242 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/Changes 2024-09-11T22:30:29.243 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-11T22:30:29.244 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-11T22:30:29.245 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-11T22:30:29.246 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-11T22:30:29.247 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-11T22:30:29.248 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-11T22:30:29.249 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-11T22:30:29.250 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-11T22:30:29.251 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-11T22:30:29.251 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-11T22:30:29.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-11T22:30:29.253 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-11T22:30:29.254 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-11T22:30:29.255 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-11T22:30:29.256 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-11T22:30:29.257 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-11T22:30:29.260 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-11T22:30:29.260 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-11T22:30:29.261 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-11T22:30:29.261 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-11T22:30:29.262 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-11T22:30:29.263 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-11T22:30:29.265 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-11T22:30:29.265 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-11T22:30:29.266 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-11T22:30:29.267 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-11T22:30:29.268 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-11T22:30:29.269 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-11T22:30:29.269 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-11T22:30:29.270 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-11T22:30:29.271 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-11T22:30:29.273 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-11T22:30:29.273 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-11T22:30:29.274 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-11T22:30:29.275 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-11T22:30:29.276 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-11T22:30:29.277 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-11T22:30:29.278 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-11T22:30:29.279 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-11T22:30:29.280 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-11T22:30:29.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-11T22:30:29.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-11T22:30:29.282 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-11T22:30:29.283 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-11T22:30:29.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-11T22:30:29.285 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-11T22:30:29.286 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-11T22:30:29.288 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-11T22:30:29.289 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-11T22:30:29.290 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-11T22:30:29.291 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-11T22:30:29.292 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-11T22:30:29.293 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-11T22:30:29.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-11T22:30:29.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-11T22:30:29.295 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-11T22:30:29.296 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-11T22:30:29.297 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-11T22:30:29.299 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-11T22:30:29.301 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-11T22:30:29.302 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-11T22:30:29.303 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-11T22:30:29.304 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-11T22:30:29.305 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-11T22:30:29.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-11T22:30:29.307 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-11T22:30:29.308 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-11T22:30:29.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-11T22:30:29.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-11T22:30:29.310 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-11T22:30:29.311 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-11T22:30:29.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-11T22:30:29.313 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-11T22:30:29.314 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-11T22:30:29.315 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-11T22:30:29.316 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-11T22:30:29.316 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-11T22:30:29.317 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-11T22:30:29.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-11T22:30:29.319 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-11T22:30:29.320 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-11T22:30:29.321 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-11T22:30:29.322 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-11T22:30:29.323 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-11T22:30:29.324 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-11T22:30:29.325 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-11T22:30:29.326 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-11T22:30:29.327 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-11T22:30:29.327 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-11T22:30:29.328 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-11T22:30:29.329 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-11T22:30:29.330 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-11T22:30:29.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-11T22:30:29.332 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-11T22:30:29.333 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-11T22:30:29.333 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-11T22:30:29.334 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-11T22:30:29.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-11T22:30:29.337 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-11T22:30:29.338 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-11T22:30:29.338 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-11T22:30:29.339 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-11T22:30:29.340 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-11T22:30:29.341 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-11T22:30:29.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-11T22:30:29.343 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-11T22:30:29.344 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-11T22:30:29.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-11T22:30:29.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-11T22:30:29.347 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-11T22:30:29.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-11T22:30:29.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-11T22:30:29.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-11T22:30:29.350 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-11T22:30:29.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-11T22:30:29.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-11T22:30:29.353 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-11T22:30:29.354 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-11T22:30:29.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-11T22:30:29.356 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-11T22:30:29.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-11T22:30:29.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-11T22:30:29.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-11T22:30:29.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-11T22:30:29.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-11T22:30:29.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-11T22:30:29.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-11T22:30:29.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-11T22:30:29.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-11T22:30:29.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-11T22:30:29.366 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-11T22:30:29.367 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-11T22:30:29.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-11T22:30:29.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-11T22:30:29.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-11T22:30:29.370 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-11T22:30:29.371 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-11T22:30:29.372 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-11T22:30:29.373 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-11T22:30:29.374 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-11T22:30:29.374 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-11T22:30:29.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-11T22:30:29.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-11T22:30:29.378 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-11T22:30:29.378 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-11T22:30:29.379 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-11T22:30:29.380 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-11T22:30:29.381 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-11T22:30:29.382 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-11T22:30:29.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-11T22:30:29.384 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-11T22:30:29.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-11T22:30:29.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-11T22:30:29.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-11T22:30:29.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-11T22:30:29.388 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-11T22:30:29.389 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-11T22:30:29.390 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-11T22:30:29.391 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-11T22:30:29.392 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-11T22:30:29.393 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-11T22:30:29.394 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-11T22:30:29.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-11T22:30:29.396 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-11T22:30:29.397 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-11T22:30:29.398 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-11T22:30:29.399 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-11T22:30:29.400 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-11T22:30:29.401 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-11T22:30:29.402 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-11T22:30:29.403 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-11T22:30:29.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-11T22:30:29.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-11T22:30:29.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-11T22:30:29.407 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-11T22:30:29.408 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-11T22:30:29.409 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-11T22:30:29.410 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-11T22:30:29.411 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-11T22:30:29.412 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-11T22:30:29.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-11T22:30:29.414 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-11T22:30:29.415 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-11T22:30:29.416 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-11T22:30:29.417 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-11T22:30:29.418 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-11T22:30:29.419 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-11T22:30:29.420 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-11T22:30:29.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-11T22:30:29.422 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-11T22:30:29.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-11T22:30:29.424 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-11T22:30:29.425 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-11T22:30:29.426 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-11T22:30:29.426 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-11T22:30:29.427 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-11T22:30:29.429 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-11T22:30:29.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-11T22:30:29.431 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-11T22:30:29.432 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-11T22:30:29.433 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-11T22:30:29.434 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-11T22:30:29.435 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-11T22:30:29.436 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-11T22:30:29.437 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-11T22:30:29.563 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:30:29.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:30:29.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:29 smithi022 ceph-mon[30966]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-09-11T22:30:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:29 smithi169 ceph-mon[35628]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-09-11T22:30:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:29 smithi045 ceph-mon[35556]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-09-11T22:30:29.911 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:30.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-11T22:30:30.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-11T22:30:30.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-11T22:30:30.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-11T22:30:30.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-11T22:30:30.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-11T22:30:30.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-11T22:30:30.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-11T22:30:30.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-11T22:30:30.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-11T22:30:30.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-11T22:30:30.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-11T22:30:30.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-11T22:30:30.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-11T22:30:30.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-11T22:30:30.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-11T22:30:30.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-11T22:30:30.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-11T22:30:30.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-11T22:30:30.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-11T22:30:30.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-11T22:30:30.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-11T22:30:30.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-11T22:30:30.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-11T22:30:30.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-11T22:30:30.068 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-11T22:30:30.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-11T22:30:30.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-11T22:30:30.071 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-11T22:30:30.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-11T22:30:30.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-11T22:30:30.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-11T22:30:30.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-11T22:30:30.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-11T22:30:30.078 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-11T22:30:30.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-11T22:30:30.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-11T22:30:30.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-11T22:30:30.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-11T22:30:30.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-11T22:30:30.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-11T22:30:30.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-11T22:30:30.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-11T22:30:30.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-11T22:30:30.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-11T22:30:30.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-11T22:30:30.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-11T22:30:30.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-11T22:30:30.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-11T22:30:30.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-11T22:30:30.092 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-11T22:30:30.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/Makefile 2024-09-11T22:30:30.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-11T22:30:30.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-11T22:30:30.095 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-11T22:30:30.096 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-11T22:30:30.096 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-11T22:30:30.097 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-11T22:30:30.098 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-11T22:30:30.099 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-11T22:30:30.100 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-11T22:30:30.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-11T22:30:30.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-11T22:30:30.102 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-11T22:30:30.103 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-11T22:30:30.104 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-11T22:30:30.105 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-11T22:30:30.105 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-11T22:30:30.106 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-11T22:30:30.107 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-11T22:30:30.108 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-11T22:30:30.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-11T22:30:30.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-11T22:30:30.110 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-11T22:30:30.111 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-11T22:30:30.112 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-11T22:30:30.113 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-11T22:30:30.113 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-11T22:30:30.114 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-11T22:30:30.115 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-11T22:30:30.116 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-11T22:30:30.116 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-11T22:30:30.117 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-11T22:30:30.118 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-11T22:30:30.119 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-11T22:30:30.121 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-11T22:30:30.122 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-11T22:30:30.123 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-11T22:30:30.124 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-11T22:30:30.125 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-11T22:30:30.126 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-11T22:30:30.127 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-11T22:30:30.128 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-11T22:30:30.129 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-11T22:30:30.129 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-11T22:30:30.130 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-11T22:30:30.131 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-11T22:30:30.132 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-11T22:30:30.133 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-11T22:30:30.133 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-11T22:30:30.134 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-11T22:30:30.135 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-11T22:30:30.136 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-11T22:30:30.137 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-11T22:30:30.138 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-11T22:30:30.138 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-11T22:30:30.139 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-11T22:30:30.140 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-11T22:30:30.141 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-11T22:30:30.141 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-11T22:30:30.142 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-11T22:30:30.143 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-11T22:30:30.144 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-11T22:30:30.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-11T22:30:30.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-11T22:30:30.146 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-11T22:30:30.147 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-11T22:30:30.148 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/ 2024-09-11T22:30:30.149 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-11T22:30:30.150 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-11T22:30:30.150 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-11T22:30:30.151 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-11T22:30:30.152 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-11T22:30:30.153 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-11T22:30:30.154 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-11T22:30:30.155 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-11T22:30:30.156 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-11T22:30:30.157 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-11T22:30:30.158 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-11T22:30:30.159 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-11T22:30:30.160 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-11T22:30:30.161 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-11T22:30:30.162 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-11T22:30:30.162 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/README 2024-09-11T22:30:30.163 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-11T22:30:30.164 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-11T22:30:30.165 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-11T22:30:30.165 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-11T22:30:30.166 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-11T22:30:30.167 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-11T22:30:30.168 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-11T22:30:30.168 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-11T22:30:30.169 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-11T22:30:30.170 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-11T22:30:30.171 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-11T22:30:30.172 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-11T22:30:30.173 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-11T22:30:30.174 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-11T22:30:30.174 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-11T22:30:30.175 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-11T22:30:30.176 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-11T22:30:30.177 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-11T22:30:30.178 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-11T22:30:30.178 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-11T22:30:30.179 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-11T22:30:30.180 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-11T22:30:30.181 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-11T22:30:30.181 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-11T22:30:30.182 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-11T22:30:30.183 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-11T22:30:30.184 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-11T22:30:30.184 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-11T22:30:30.185 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-11T22:30:30.186 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-11T22:30:30.187 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-11T22:30:30.188 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-11T22:30:30.189 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-11T22:30:30.189 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-11T22:30:30.190 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-11T22:30:30.191 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-11T22:30:30.192 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-11T22:30:30.192 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-11T22:30:30.193 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-11T22:30:30.194 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-11T22:30:30.195 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-11T22:30:30.196 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-11T22:30:30.196 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-11T22:30:30.198 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-11T22:30:30.199 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-11T22:30:30.199 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-11T22:30:30.200 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-11T22:30:30.201 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-11T22:30:30.202 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-11T22:30:30.203 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-11T22:30:30.204 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-11T22:30:30.205 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-11T22:30:30.206 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-11T22:30:30.209 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-11T22:30:30.210 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-11T22:30:30.210 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-11T22:30:30.211 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-11T22:30:30.212 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-11T22:30:30.213 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-11T22:30:30.214 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-11T22:30:30.214 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-11T22:30:30.215 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-11T22:30:30.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-11T22:30:30.246 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-11T22:30:30.247 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-11T22:30:30.248 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-11T22:30:30.249 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-11T22:30:30.251 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-11T22:30:30.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-11T22:30:30.253 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-11T22:30:30.254 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-11T22:30:30.256 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-11T22:30:30.257 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-11T22:30:30.258 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-11T22:30:30.260 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-11T22:30:30.261 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-11T22:30:30.263 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-11T22:30:30.264 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-11T22:30:30.265 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-11T22:30:30.267 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-11T22:30:30.268 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-11T22:30:30.270 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-11T22:30:30.271 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-11T22:30:30.272 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-11T22:30:30.274 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-11T22:30:30.275 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-11T22:30:30.277 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-11T22:30:30.280 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-11T22:30:30.280 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-11T22:30:30.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-11T22:30:30.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-11T22:30:30.282 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-11T22:30:30.283 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-11T22:30:30.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-11T22:30:30.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-11T22:30:30.285 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-11T22:30:30.286 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-11T22:30:30.287 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-11T22:30:30.288 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-11T22:30:30.288 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/ 2024-09-11T22:30:30.289 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-11T22:30:30.290 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-11T22:30:30.291 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-11T22:30:30.291 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-11T22:30:30.292 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-11T22:30:30.293 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-11T22:30:30.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-11T22:30:30.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-11T22:30:30.295 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-11T22:30:30.296 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-11T22:30:30.297 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-11T22:30:30.297 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-11T22:30:30.298 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-11T22:30:30.299 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-11T22:30:30.300 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-11T22:30:30.300 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-11T22:30:30.301 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-11T22:30:30.302 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-11T22:30:30.303 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-11T22:30:30.303 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-11T22:30:30.304 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-11T22:30:30.305 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-11T22:30:30.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-11T22:30:30.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-11T22:30:30.307 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-11T22:30:30.308 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-11T22:30:30.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-11T22:30:30.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-11T22:30:30.310 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-11T22:30:30.311 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-11T22:30:30.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-11T22:30:30.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-11T22:30:30.313 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-11T22:30:30.314 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-11T22:30:30.315 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-11T22:30:30.315 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-11T22:30:30.316 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-11T22:30:30.317 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-11T22:30:30.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-11T22:30:30.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-11T22:30:30.319 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-11T22:30:30.320 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-11T22:30:30.321 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-11T22:30:30.322 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-11T22:30:30.322 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-11T22:30:30.323 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-11T22:30:30.324 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-11T22:30:30.325 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-11T22:30:30.325 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-11T22:30:30.326 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-11T22:30:30.327 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-11T22:30:30.328 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-11T22:30:30.328 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-11T22:30:30.329 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-11T22:30:30.330 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-11T22:30:30.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-11T22:30:30.332 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-11T22:30:30.332 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-11T22:30:30.333 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-11T22:30:30.334 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-11T22:30:30.334 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-11T22:30:30.335 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-11T22:30:30.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-11T22:30:30.337 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-11T22:30:30.338 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-11T22:30:30.338 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/ 2024-09-11T22:30:30.339 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-11T22:30:30.340 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-11T22:30:30.341 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-11T22:30:30.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-11T22:30:30.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-11T22:30:30.343 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/console/ 2024-09-11T22:30:30.344 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-11T22:30:30.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-11T22:30:30.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-11T22:30:30.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-11T22:30:30.347 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-11T22:30:30.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-11T22:30:30.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-11T22:30:30.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-11T22:30:30.350 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-11T22:30:30.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-11T22:30:30.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-11T22:30:30.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-11T22:30:30.353 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-11T22:30:30.354 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-11T22:30:30.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-11T22:30:30.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-11T22:30:30.356 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-11T22:30:30.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-11T22:30:30.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-11T22:30:30.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-11T22:30:30.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-11T22:30:30.360 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-11T22:30:30.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cris/ 2024-09-11T22:30:30.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/cris/README 2024-09-11T22:30:30.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-11T22:30:30.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-11T22:30:30.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-11T22:30:30.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-11T22:30:30.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-11T22:30:30.366 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-11T22:30:30.367 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-11T22:30:30.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-11T22:30:30.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-11T22:30:30.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-11T22:30:30.370 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-11T22:30:30.371 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-11T22:30:30.372 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-11T22:30:30.373 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-11T22:30:30.373 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-11T22:30:30.374 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-11T22:30:30.375 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-11T22:30:30.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-11T22:30:30.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-11T22:30:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 -- 172.21.15.22:0/595142699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 msgr2=0x7f97fc10ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 --2- 172.21.15.22:0/595142699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc10ba80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009900 tx=0x7f97f002a480 comp rx=0 tx=0).stop 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 -- 172.21.15.22:0/595142699 shutdown_connections 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 --2- 172.21.15.22:0/595142699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc10c0d0 0x7f97fc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 --2- 172.21.15.22:0/595142699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc10ba80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 --2- 172.21.15.22:0/595142699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc102c80 0x7f97fc103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 -- 172.21.15.22:0/595142699 >> 172.21.15.22:0/595142699 conn(0x7f97fc077990 msgr2=0x7f97fc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 -- 172.21.15.22:0/595142699 shutdown_connections 2024-09-11T22:30:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 -- 172.21.15.22:0/595142699 wait complete. 2024-09-11T22:30:30.378 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-11T22:30:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.377+0000 7f9801d2c640 1 Processor -- start 2024-09-11T22:30:30.379 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 -- start start 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 0x7f97fc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc10c0d0 0x7f97fc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc111fd0 con 0x7f97fc1035a0 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc111e50 con 0x7f97fc10c0d0 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f9801d2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc112150 con 0x7f97fc102c80 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f97faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 0x7f97fc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f97faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53508/0 (socket says 172.21.15.22:53508) 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f97faffd640 1 -- 172.21.15.22:0/2735600945 learned_addr learned my addr 172.21.15.22:0/2735600945 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.378+0000 7f97fbfff640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc10c0d0 0x7f97fc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2735600945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc10c0d0 msgr2=0x7f97fc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc10c0d0 0x7f97fc19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 msgr2=0x7f97fc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2735600945 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc19d3c0 con 0x7f97fc102c80 2024-09-11T22:30:30.381 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-11T22:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 0x7f97fc198400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00ea20 tx=0x7f97ec00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97f8ff9640 1 -- 172.21.15.22:0/2735600945 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00cd50 con 0x7f97fc102c80 2024-09-11T22:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc19d6b0 con 0x7f97fc102c80 2024-09-11T22:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97f8ff9640 1 -- 172.21.15.22:0/2735600945 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ec0035f0 con 0x7f97fc102c80 2024-09-11T22:30:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f97f8ff9640 1 -- 172.21.15.22:0/2735600945 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec010670 con 0x7f97fc102c80 2024-09-11T22:30:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.379+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc06bc10 con 0x7f97fc102c80 2024-09-11T22:30:30.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-11T22:30:30.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-11T22:30:30.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-11T22:30:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.381+0000 7f97f8ff9640 1 -- 172.21.15.22:0/2735600945 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f97ec0037a0 con 0x7f97fc102c80 2024-09-11T22:30:30.384 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-11T22:30:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.382+0000 7f97f8ff9640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 0x7f97e40a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.382+0000 7f97faffd640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 0x7f97e40a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.382+0000 7f97f8ff9640 1 -- 172.21.15.22:0/2735600945 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f97ec0cf9d0 con 0x7f97fc102c80 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 Processor -- start 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 -- start start 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97faffd640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 0x7f97e40a5380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005ec0 tx=0x7f97f0005a20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.386 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f68875a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f6886ad2f0 con 0x55f6887492d0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f688655270 con 0x55f6887489b0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f9804ac1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f6886a92b0 con 0x55f6887580c0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40790/0 (socket says 172.21.15.22:40790) 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53518/0 (socket says 172.21.15.22:53518) 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2575008961 learned_addr learned my addr 172.21.15.22:0/2575008961 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.383+0000 7f97fbfff640 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f68875a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2575008961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 msgr2=0x55f68875a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f68875a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2575008961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 msgr2=0x55f688757b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 -- 172.21.15.22:0/2575008961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f688654340 con 0x55f6887489b0 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97faffd640 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97ec005c20 tx=0x7f97ec003b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ded2c1c04227b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.389 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-11T22:30:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97e1ffb640 1 -- 172.21.15.22:0/2575008961 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec09c3f0 con 0x55f6887489b0 2024-09-11T22:30:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97e1ffb640 1 -- 172.21.15.22:0/2575008961 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ec09bcf0 con 0x55f6887489b0 2024-09-11T22:30:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.384+0000 7f97e1ffb640 1 -- 172.21.15.22:0/2575008961 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec09b140 con 0x55f6887489b0 2024-09-11T22:30:30.390 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- 172.21.15.22:0/2575008961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 msgr2=0x55f688748d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97ec005c20 tx=0x7f97ec003b30 comp rx=0 tx=0).stop 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- 172.21.15.22:0/2575008961 shutdown_connections 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f68875a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887492d0 0x55f688757b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2575008961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688748d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- 172.21.15.22:0/2575008961 >> 172.21.15.22:0/2575008961 conn(0x55f688745060 msgr2=0x55f688745440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- 172.21.15.22:0/2575008961 shutdown_connections 2024-09-11T22:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- 172.21.15.22:0/2575008961 wait complete. 2024-09-11T22:30:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.385+0000 7f9804ac1740 1 -- start start 2024-09-11T22:30:30.392 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-11T22:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 Processor -- start 2024-09-11T22:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887489b0 0x55f688755110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f688755650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f68875ac30 con 0x55f6887580c0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f688636290 con 0x55f6887492d0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f68875adb0 con 0x55f6887489b0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f9804ac1740 10 client.0 _ll_register_callbacks cb 0x55f688667140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53534/0 (socket says 172.21.15.22:53534) 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 -- 172.21.15.22:0/2439279049 learned_addr learned my addr 172.21.15.22:0/2439279049 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f688755650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887489b0 0x55f688755110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 -- 172.21.15.22:0/2439279049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887489b0 msgr2=0x55f688755110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887489b0 0x55f688755110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 -- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 msgr2=0x55f688755650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f688755650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97fbfff640 1 -- 172.21.15.22:0/2439279049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6883c0210 con 0x55f6887580c0 2024-09-11T22:30:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.386+0000 7f97faffd640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f688755650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:30.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-11T22:30:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97fbfff640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f97f4011d10 tx=0x7f97f400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f68a1aa3f1dd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f400fe60 con 0x55f6887580c0 2024-09-11T22:30:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f97f4004b20 con 0x55f6887580c0 2024-09-11T22:30:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ec09bcf0 con 0x55f6887580c0 2024-09-11T22:30:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f97f4004d20 con 0x55f6887580c0 2024-09-11T22:30:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 10 client.15582 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f68848c620 con 0x55f6887580c0 2024-09-11T22:30:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ec09bcf0 con 0x55f6887580c0 2024-09-11T22:30:30.397 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-11T22:30:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f97f4025480 con 0x55f6887580c0 2024-09-11T22:30:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 10 client.15582 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 20 client.15582 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f688768110 0x55f68876a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 4 client.15582 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.387+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6886baa20 con 0x55f688768110 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.388+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f688768110 0x55f68876a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.388+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f688768110 0x55f68876a500 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92783f09df06b8ad server_cookie=815667ad9a0a10dd in_seq=0 out_seq=0 2024-09-11T22:30:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.388+0000 7f97daffd640 10 client.15582 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.399 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-11T22:30:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f97daffd640 1 -- 172.21.15.22:0/2439279049 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6886baa20 con 0x55f688768110 2024-09-11T22:30:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f97daffd640 10 client.15582 handle_command_reply: tid=0 2024-09-11T22:30:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 client.15582 shutdown 2024-09-11T22:30:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 msgr2=0x55f688755b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f97f4011d10 tx=0x7f97f400f790 comp rx=0 tx=0).stop 2024-09-11T22:30:30.401 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 shutdown_connections 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f688768110 0x55f68876a500 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688755b90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f688755650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 --2- 172.21.15.22:0/2439279049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887489b0 0x55f688755110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 >> 172.21.15.22:0/2439279049 conn(0x55f688745060 msgr2=0x55f68874adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f97daffd640 0 client.15582 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 shutdown_connections 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 1 -- 172.21.15.22:0/2439279049 wait complete. 2024-09-11T22:30:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.389+0000 7f9804ac1740 20 client.15582 trim_cache size 0 max 16384 2024-09-11T22:30:30.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-11T22:30:30.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-11T22:30:30.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-11T22:30:30.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-11T22:30:30.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-11T22:30:30.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-11T22:30:30.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-11T22:30:30.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-11T22:30:30.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-11T22:30:30.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 Processor -- start 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 -- start start 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f68876fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f688770310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0702d0 con 0x55f6887489b0 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc072b50 con 0x55f6887492d0 2024-09-11T22:30:30.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f9804ac1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc070940 con 0x55f6887580c0 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f68876fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53544/0 (socket says 172.21.15.22:53544) 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 -- 172.21.15.22:0/974961854 learned_addr learned my addr 172.21.15.22:0/974961854 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fbfff640 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f688770310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 -- 172.21.15.22:0/974961854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 msgr2=0x55f688770310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f688770310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 -- 172.21.15.22:0/974961854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 msgr2=0x55f68876fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f68876fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97fb7fe640 1 -- 172.21.15.22:0/974961854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f688745c10 con 0x55f6887489b0 2024-09-11T22:30:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.406+0000 7f97faffd640 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f68876fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:30.410 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-11T22:30:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.407+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f97ec01f000 tx=0x7f97ec003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2805e7529714c1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.407+0000 7f97e17fa640 1 -- 172.21.15.22:0/974961854 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec07f070 con 0x55f6887489b0 2024-09-11T22:30:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.407+0000 7f97e17fa640 1 -- 172.21.15.22:0/974961854 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ec0ccf30 con 0x55f6887489b0 2024-09-11T22:30:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.407+0000 7f97e17fa640 1 -- 172.21.15.22:0/974961854 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0cd570 con 0x55f6887489b0 2024-09-11T22:30:30.411 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- 172.21.15.22:0/974961854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 msgr2=0x55f6887559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f97ec01f000 tx=0x7f97ec003ec0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- 172.21.15.22:0/974961854 shutdown_connections 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887580c0 0x55f688770310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887492d0 0x55f68876fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- 172.21.15.22:0/974961854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887489b0 0x55f6887559c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- 172.21.15.22:0/974961854 >> 172.21.15.22:0/974961854 conn(0x55f688745060 msgr2=0x55f688750440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- 172.21.15.22:0/974961854 shutdown_connections 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- 172.21.15.22:0/974961854 wait complete. 2024-09-11T22:30:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- start start 2024-09-11T22:30:30.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-11T22:30:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 Processor -- start 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887492d0 0x55f688760580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688751960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc071010 con 0x55f6887580c0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.408+0000 7f9804ac1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc072480 con 0x55f6887489b0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f9804ac1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0716e0 con 0x55f6887492d0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f9804ac1740 10 client.0 _ll_register_callbacks cb 0x7f97f4009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688751960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40818/0 (socket says 172.21.15.22:40818) 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 -- 172.21.15.22:0/565826988 learned_addr learned my addr 172.21.15.22:0/565826988 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97faffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887492d0 0x55f688760580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.415 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 -- 172.21.15.22:0/565826988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887492d0 msgr2=0x55f688760580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887492d0 0x55f688760580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 -- 172.21.15.22:0/565826988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 msgr2=0x55f688751960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688751960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 -- 172.21.15.22:0/565826988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f688751fa0 con 0x55f6887489b0 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97fb7fe640 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009fd0 tx=0x7f97ec09b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=625243828454f852 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97daffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:30:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec07f050 con 0x55f6887489b0 2024-09-11T22:30:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f97ec0cd2d0 con 0x55f6887489b0 2024-09-11T22:30:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ec0ccf30 con 0x55f6887489b0 2024-09-11T22:30:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.409+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f97ec09c3f0 con 0x55f6887489b0 2024-09-11T22:30:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 10 client.25277 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f6887d26b0 con 0x55f6887489b0 2024-09-11T22:30:30.417 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ec0ccf30 con 0x55f6887489b0 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f97ec07ab10 con 0x55f6887489b0 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 10 client.25277 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 10 client.25277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 20 client.25277 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6887d2930 0x55f6887d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 4 client.25277 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:30:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6886b4d70 con 0x55f6887d2930 2024-09-11T22:30:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.410+0000 7f97faffd640 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6887d2930 0x55f6887d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.419 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-11T22:30:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.411+0000 7f97faffd640 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6887d2930 0x55f6887d4d20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b236c1f589c71f server_cookie=912a36f99057f111 in_seq=0 out_seq=0 2024-09-11T22:30:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:30.411+0000 7f97daffd640 10 client.25277 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.420 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-11T22:30:30.420 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-11T22:30:30.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-11T22:30:30.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-11T22:30:30.424 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-11T22:30:30.426 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-11T22:30:30.427 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-11T22:30:30.428 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-11T22:30:30.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-11T22:30:30.431 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-11T22:30:30.433 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-11T22:30:30.434 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-11T22:30:30.435 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-11T22:30:30.437 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-11T22:30:30.438 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-11T22:30:30.439 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-11T22:30:30.441 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-11T22:30:30.442 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-11T22:30:30.444 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-11T22:30:30.445 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-11T22:30:30.446 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-11T22:30:30.447 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-11T22:30:30.448 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-11T22:30:30.450 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-11T22:30:30.451 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.437+0000 7f6bc67fb640 1 -- 172.21.15.22:0/1767680824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 msgr2=0x7f6bc010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.437+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/1767680824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc010ec50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009cd0 tx=0x7f6bb802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 -- 172.21.15.22:0/1767680824 shutdown_connections 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/1767680824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc010ec50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/1767680824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/1767680824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 0x7f6bc0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 -- 172.21.15.22:0/1767680824 >> 172.21.15.22:0/1767680824 conn(0x7f6bc00fc7d0 msgr2=0x7f6bc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 -- 172.21.15.22:0/1767680824 shutdown_connections 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 -- 172.21.15.22:0/1767680824 wait complete. 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 Processor -- start 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.438+0000 7f6bc67fb640 1 -- start start 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 0x7f6bc0100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01121d0 con 0x7f6bc01082e0 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0112050 con 0x7f6bc0102db0 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0112350 con 0x7f6bc0103760 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 0x7f6bc0100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53566/0 (socket says 172.21.15.22:53566) 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 -- 172.21.15.22:0/622095643 learned_addr learned my addr 172.21.15.22:0/622095643 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 -- 172.21.15.22:0/622095643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 msgr2=0x7f6bc0100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 -- 172.21.15.22:0/622095643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 msgr2=0x7f6bc0100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 0x7f6bc0100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 -- 172.21.15.22:0/622095643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc01a6b20 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc4d98640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005e30 tx=0x7f6bb8003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbd7fa640 1 -- 172.21.15.22:0/622095643 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004040 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc01a6db0 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbd7fa640 1 -- 172.21.15.22:0/622095643 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb80046e0 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.439+0000 7f6bbd7fa640 1 -- 172.21.15.22:0/622095643 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb803a400 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.440+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc01a7310 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bbd7fa640 1 -- 172.21.15.22:0/622095643 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f6bb80306a0 con 0x7f6bc01082e0 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 Processor -- start 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 -- start start 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445a3b60 0x5579445a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 0x5579445b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557944509280 con 0x5579445aed40 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5579444b0b10 con 0x5579445a4480 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.442+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557944505240 con 0x5579445a3b60 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 0x5579445b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40854/0 (socket says 172.21.15.22:40854) 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 0x5579445b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53580/0 (socket says 172.21.15.22:53580) 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 -- 172.21.15.22:0/2661510573 learned_addr learned my addr 172.21.15.22:0/2661510573 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbd7fa640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 0x7f6ba80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445a3b60 0x5579445a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bc4d98640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 0x7f6ba80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 -- 172.21.15.22:0/2661510573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445a3b60 msgr2=0x5579445a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445a3b60 0x5579445a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 -- 172.21.15.22:0/2661510573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 msgr2=0x5579445b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 0x5579445b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 -- 172.21.15.22:0/2661510573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579444bd1f0 con 0x5579445a4480 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbd7fa640 1 -- 172.21.15.22:0/622095643 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6bb802e030 con 0x7f6bc01082e0 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bbffff640 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009cf0 tx=0x7f6bb0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2319fe5ef2ae8a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6ba67fc640 1 -- 172.21.15.22:0/2661510573 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb001e070 con 0x5579445a4480 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6bc4d98640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 0x7f6ba80a5350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80edb10 tx=0x7f6bb80c0040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6ba67fc640 1 -- 172.21.15.22:0/2661510573 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb0009de0 con 0x5579445a4480 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.443+0000 7f6ba67fc640 1 -- 172.21.15.22:0/2661510573 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00196b0 con 0x5579445a4480 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2661510573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 msgr2=0x5579445ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009cf0 tx=0x7f6bb0011810 comp rx=0 tx=0).stop 2024-09-11T22:30:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2661510573 shutdown_connections 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445aed40 0x5579445b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445ae800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2661510573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445a3b60 0x5579445a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2661510573 >> 172.21.15.22:0/2661510573 conn(0x5579445a00f0 msgr2=0x5579445a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2661510573 shutdown_connections 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2661510573 wait complete. 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.444+0000 7f6bc8bd4740 1 -- start start 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 Processor -- start 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5579445b1910 con 0x5579445a4480 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5579444c3f10 con 0x5579445a3b60 2024-09-11T22:30:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5579445b1a90 con 0x5579445aed40 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bc8bd4740 10 client.0 _ll_register_callbacks cb 0x55794448ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53588/0 (socket says 172.21.15.22:53588) 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbffff640 1 -- 172.21.15.22:0/3180636500 learned_addr learned my addr 172.21.15.22:0/3180636500 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3180636500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 msgr2=0x5579445ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.445+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3180636500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 msgr2=0x5579445ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3180636500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794427a6a0 con 0x5579445a3b60 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bbffff640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445abc00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01024a0 tx=0x7f6bb400eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55b265d10fd7519 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004020 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb0009de0 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6bb40041c0 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6bb4027050 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bc8bd4740 10 client.25289 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5579445bd580 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.446+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb0009de0 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6bb4003610 con 0x5579445a3b60 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 10 client.25289 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 10 client.25289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 20 client.25289 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:30.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5579445bea40 0x5579445c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 4 client.25289 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579445167f0 con 0x5579445bea40 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bbffff640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5579445bea40 0x5579445c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6bbffff640 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5579445bea40 0x5579445c0e70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed89e7683b53584 server_cookie=d741845d3faf88d1 in_seq=0 out_seq=0 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.447+0000 7f6b9f7fe640 10 client.25289 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3180636500 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579445167f0 con 0x5579445bea40 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6b9f7fe640 10 client.25289 handle_command_reply: tid=0 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 client.25289 shutdown 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 msgr2=0x5579445abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445abc00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01024a0 tx=0x7f6bb400eb30 comp rx=0 tx=0).stop 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 shutdown_connections 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5579445bea40 0x5579445c0e70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3180636500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445abc00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6b9f7fe640 0 client.25289 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 >> 172.21.15.22:0/3180636500 conn(0x5579445a00f0 msgr2=0x55794459f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 shutdown_connections 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3180636500 wait complete. 2024-09-11T22:30:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.449+0000 7f6bc8bd4740 20 client.25289 trim_cache size 0 max 16384 2024-09-11T22:30:30.463 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-11T22:30:30.463 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-11T22:30:30.463 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-11T22:30:30.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-11T22:30:30.465 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-11T22:30:30.465 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-11T22:30:30.466 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-11T22:30:30.467 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-11T22:30:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 Processor -- start 2024-09-11T22:30:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 -- start start 2024-09-11T22:30:30.468 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-11T22:30:30.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x55794459f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01ada20 con 0x5579445a4480 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b0280 con 0x5579445a3b60 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.467+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01ae070 con 0x5579445aed40 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40884/0 (socket says 172.21.15.22:40884) 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/2744693796 learned_addr learned my addr 172.21.15.22:0/2744693796 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbffff640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x55794459f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/2744693796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 msgr2=0x55794459f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x55794459f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/2744693796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 msgr2=0x5579445ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/2744693796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579445ae4d0 con 0x5579445a3b60 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbffff640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4005ee0 tx=0x7f6bb400e430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aac3e3eb9a6535a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6ba5ffb640 1 -- 172.21.15.22:0/2744693796 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4005030 con 0x5579445a3b60 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6ba5ffb640 1 -- 172.21.15.22:0/2744693796 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb40046c0 con 0x5579445a3b60 2024-09-11T22:30:30.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.468+0000 7f6ba5ffb640 1 -- 172.21.15.22:0/2744693796 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4010880 con 0x5579445a3b60 2024-09-11T22:30:30.471 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2744693796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 msgr2=0x5579445a65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4005ee0 tx=0x7f6bb400e430 comp rx=0 tx=0).stop 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2744693796 shutdown_connections 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x55794459f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a4480 0x5579445ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/2744693796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a3b60 0x5579445a65c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2744693796 >> 172.21.15.22:0/2744693796 conn(0x5579445a00f0 msgr2=0x5579445adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2744693796 shutdown_connections 2024-09-11T22:30:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/2744693796 wait complete. 2024-09-11T22:30:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.469+0000 7f6bc8bd4740 1 -- start start 2024-09-11T22:30:30.473 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-11T22:30:30.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 Processor -- start 2024-09-11T22:30:30.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01ae740 con 0x5579445a3b60 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01afbb0 con 0x5579445a4480 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01aee10 con 0x5579445aed40 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bc8bd4740 10 client.0 _ll_register_callbacks cb 0x7f6bb4013c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53614/0 (socket says 172.21.15.22:53614) 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3311587630 learned_addr learned my addr 172.21.15.22:0/3311587630 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3311587630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 msgr2=0x5579445b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 msgr2=0x5579445b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.470+0000 7f6bbf7fe640 1 -- 172.21.15.22:0/3311587630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579445b32a0 con 0x5579445a3b60 2024-09-11T22:30:30.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6bbf7fe640 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4003ba0 tx=0x7f6bb400eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7df246ed62af11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:30.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:30.476 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4010a50 con 0x5579445a3b60 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6bb4010bf0 con 0x5579445a3b60 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb40046c0 con 0x5579445a3b60 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6bb4043020 con 0x5579445a3b60 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6bc8bd4740 10 client.15606 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557944629630 con 0x5579445a3b60 2024-09-11T22:30:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.471+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb40046c0 con 0x5579445a3b60 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6bb401c070 con 0x5579445a3b60 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 10 client.15606 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 20 client.15606 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557944629c40 0x55794462c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 4 client.15606 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557944510d00 con 0x557944629c40 2024-09-11T22:30:30.478 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-11T22:30:30.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bbffff640 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557944629c40 0x55794462c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:30.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6bbffff640 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557944629c40 0x55794462c030 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44940fc296de62aa server_cookie=f08aeb1a9e7a4e08 in_seq=0 out_seq=0 2024-09-11T22:30:30.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.472+0000 7f6b9f7fe640 10 client.15606 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.479 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-11T22:30:30.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-11T22:30:30.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-11T22:30:30.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-11T22:30:30.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-11T22:30:30.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-11T22:30:30.481 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-11T22:30:30.483 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-11T22:30:30.484 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-11T22:30:30.485 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-11T22:30:30.486 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-11T22:30:30.488 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-11T22:30:30.489 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-11T22:30:30.490 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-11T22:30:30.491 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-11T22:30:30.493 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-11T22:30:30.494 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-11T22:30:30.496 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-11T22:30:30.497 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-11T22:30:30.498 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-11T22:30:30.499 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-11T22:30:30.501 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-11T22:30:30.502 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-11T22:30:30.503 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-11T22:30:30.505 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-11T22:30:30.506 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-11T22:30:30.507 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-11T22:30:30.508 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-11T22:30:30.510 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-11T22:30:30.511 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-11T22:30:30.512 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-11T22:30:30.514 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-11T22:30:30.515 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-11T22:30:30.516 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-11T22:30:30.518 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-11T22:30:30.519 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-11T22:30:30.520 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-11T22:30:30.521 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-11T22:30:30.522 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-11T22:30:30.523 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-11T22:30:30.524 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-11T22:30:30.525 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-11T22:30:30.526 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-11T22:30:30.527 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-11T22:30:30.528 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-11T22:30:30.529 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-11T22:30:30.530 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-11T22:30:30.531 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-11T22:30:30.532 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-11T22:30:30.533 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-11T22:30:30.534 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-11T22:30:30.535 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-11T22:30:30.536 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-11T22:30:30.537 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-11T22:30:30.538 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-11T22:30:30.539 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-11T22:30:30.540 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-11T22:30:30.541 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-11T22:30:30.542 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-11T22:30:30.543 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-11T22:30:30.545 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-11T22:30:30.545 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-11T22:30:30.546 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-11T22:30:30.547 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-11T22:30:30.548 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-11T22:30:30.549 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-11T22:30:30.550 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-11T22:30:30.551 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-11T22:30:30.552 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-11T22:30:30.553 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-11T22:30:30.554 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-11T22:30:30.555 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-11T22:30:30.556 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-11T22:30:30.557 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-11T22:30:30.559 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-11T22:30:30.560 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-11T22:30:30.561 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-11T22:30:30.562 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-11T22:30:30.563 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-11T22:30:30.564 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-11T22:30:30.565 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-11T22:30:30.566 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-11T22:30:30.567 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-11T22:30:30.568 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-11T22:30:30.569 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-11T22:30:30.570 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-11T22:30:30.571 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-11T22:30:30.572 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-11T22:30:30.573 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-11T22:30:30.574 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-11T22:30:30.575 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-11T22:30:30.576 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-11T22:30:30.577 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-11T22:30:30.578 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-11T22:30:30.579 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-11T22:30:30.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-11T22:30:30.581 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-11T22:30:30.582 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-11T22:30:30.583 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-11T22:30:30.584 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-11T22:30:30.585 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-11T22:30:30.586 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-11T22:30:30.587 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-11T22:30:30.588 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-11T22:30:30.589 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-11T22:30:30.590 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-11T22:30:30.591 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-11T22:30:30.592 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-11T22:30:30.593 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-11T22:30:30.594 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-11T22:30:30.595 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-11T22:30:30.596 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-11T22:30:30.597 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-11T22:30:30.598 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-11T22:30:30.599 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-11T22:30:30.600 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-11T22:30:30.601 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-11T22:30:30.602 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-11T22:30:30.603 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-11T22:30:30.604 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-11T22:30:30.605 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-11T22:30:30.606 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-11T22:30:30.607 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-11T22:30:30.608 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-11T22:30:30.610 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-11T22:30:30.610 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-11T22:30:30.611 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-11T22:30:30.612 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-11T22:30:30.613 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-11T22:30:30.615 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-11T22:30:30.616 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-11T22:30:30.617 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-11T22:30:30.618 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-11T22:30:30.619 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-11T22:30:30.620 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-11T22:30:30.621 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-11T22:30:30.622 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-11T22:30:30.623 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-11T22:30:30.624 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-11T22:30:30.625 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-11T22:30:30.626 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-11T22:30:30.627 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-11T22:30:30.628 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-11T22:30:30.629 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-11T22:30:30.630 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-11T22:30:30.631 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-11T22:30:30.632 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-11T22:30:30.633 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-11T22:30:30.634 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-11T22:30:30.635 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-11T22:30:30.636 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-11T22:30:30.637 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-11T22:30:30.638 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-11T22:30:30.639 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-11T22:30:30.640 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-11T22:30:30.641 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-11T22:30:30.642 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-11T22:30:30.643 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-11T22:30:30.644 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-11T22:30:30.645 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-11T22:30:30.646 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-11T22:30:30.647 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-11T22:30:30.648 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-11T22:30:30.649 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-11T22:30:30.650 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-11T22:30:30.651 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-11T22:30:30.652 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-11T22:30:30.654 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-11T22:30:30.654 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-11T22:30:30.655 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-11T22:30:30.657 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-11T22:30:30.657 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-11T22:30:30.658 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-11T22:30:30.659 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-11T22:30:30.660 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-11T22:30:30.661 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-11T22:30:30.662 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-11T22:30:30.663 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-11T22:30:30.664 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-11T22:30:30.665 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-11T22:30:30.666 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-11T22:30:30.667 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-11T22:30:30.668 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-11T22:30:30.670 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-11T22:30:30.671 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-11T22:30:30.672 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-11T22:30:30.673 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-11T22:30:30.674 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-11T22:30:30.675 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-11T22:30:30.676 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-11T22:30:30.677 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-11T22:30:30.678 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-11T22:30:30.679 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-11T22:30:30.680 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-11T22:30:30.681 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-11T22:30:30.682 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-11T22:30:30.683 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-11T22:30:30.684 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-11T22:30:30.685 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-11T22:30:30.686 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-11T22:30:30.687 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-11T22:30:30.688 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-11T22:30:30.689 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-11T22:30:30.690 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-11T22:30:30.691 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-11T22:30:30.692 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-11T22:30:30.693 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-11T22:30:30.694 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-11T22:30:30.695 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-11T22:30:30.696 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-11T22:30:30.697 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-11T22:30:30.698 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-11T22:30:30.699 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-11T22:30:30.701 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-11T22:30:30.702 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-11T22:30:30.703 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-11T22:30:30.704 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-11T22:30:30.705 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-11T22:30:30.706 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-11T22:30:30.707 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-11T22:30:30.708 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-11T22:30:30.709 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-11T22:30:30.710 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-11T22:30:30.711 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-11T22:30:30.712 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-11T22:30:30.713 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-11T22:30:30.714 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-11T22:30:30.715 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-11T22:30:30.716 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-11T22:30:30.717 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-11T22:30:30.718 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-11T22:30:30.719 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-11T22:30:30.720 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-11T22:30:30.721 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-11T22:30:30.722 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-11T22:30:30.723 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-11T22:30:30.724 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-11T22:30:30.725 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-11T22:30:30.726 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-11T22:30:30.727 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-11T22:30:30.728 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-11T22:30:30.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-11T22:30:30.730 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-11T22:30:30.731 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-11T22:30:30.732 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-11T22:30:30.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-11T22:30:30.734 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-11T22:30:30.735 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-11T22:30:30.736 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-11T22:30:30.737 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-11T22:30:30.738 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-11T22:30:30.739 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-11T22:30:30.740 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-11T22:30:30.741 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-11T22:30:30.742 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-11T22:30:30.743 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-11T22:30:30.744 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-11T22:30:30.745 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-11T22:30:30.746 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-11T22:30:30.747 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-11T22:30:30.748 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-11T22:30:30.749 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-11T22:30:30.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-11T22:30:30.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-11T22:30:30.752 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-11T22:30:30.753 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-11T22:30:30.754 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-11T22:30:30.755 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-11T22:30:30.756 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-11T22:30:30.757 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-11T22:30:30.758 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-11T22:30:30.759 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-11T22:30:30.760 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-11T22:30:30.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-11T22:30:30.762 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-11T22:30:30.763 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-11T22:30:30.764 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-11T22:30:30.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-11T22:30:30.766 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-11T22:30:30.767 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-11T22:30:30.768 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-11T22:30:30.769 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-11T22:30:30.770 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-11T22:30:30.771 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-11T22:30:30.772 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-11T22:30:30.773 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-11T22:30:30.774 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-11T22:30:30.775 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-11T22:30:30.776 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-11T22:30:30.777 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-11T22:30:30.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-11T22:30:30.779 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-11T22:30:30.780 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-11T22:30:30.781 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-11T22:30:30.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-11T22:30:30.783 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-11T22:30:30.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-11T22:30:30.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-11T22:30:30.786 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-11T22:30:30.787 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-11T22:30:30.788 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-11T22:30:30.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-11T22:30:30.790 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-11T22:30:30.790 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-11T22:30:30.791 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-11T22:30:30.792 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-11T22:30:30.793 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-11T22:30:30.795 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-11T22:30:30.796 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-11T22:30:30.797 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-11T22:30:30.798 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-11T22:30:30.799 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-11T22:30:30.800 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-11T22:30:30.802 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-11T22:30:30.803 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-11T22:30:30.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6b9f7fe640 1 -- 172.21.15.22:0/3311587630 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557944510d00 con 0x557944629c40 2024-09-11T22:30:30.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6b9f7fe640 10 client.15606 handle_command_reply: tid=0 2024-09-11T22:30:30.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 client.15606 shutdown 2024-09-11T22:30:30.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 msgr2=0x5579445b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4003ba0 tx=0x7f6bb400eab0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 shutdown_connections 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557944629c40 0x55794462c030 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579445aed40 0x5579445b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5579445a4480 0x5579445b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 --2- 172.21.15.22:0/3311587630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5579445a3b60 0x5579445b7340 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6b9f7fe640 0 client.15606 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.803+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 >> 172.21.15.22:0/3311587630 conn(0x5579445a00f0 msgr2=0x55794459f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 shutdown_connections 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc8bd4740 1 -- 172.21.15.22:0/3311587630 wait complete. 2024-09-11T22:30:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc8bd4740 20 client.15606 trim_cache size 0 max 16384 2024-09-11T22:30:30.806 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:30:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:30:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "04334f3e-1d69-405f-9b36-4b08a9da4d6f", 2024-09-11T22:30:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:30:30.806 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:30:30.806 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 msgr2=0x7f6ba80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 0x7f6ba80a5350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80edb10 tx=0x7f6bb80c0040 comp rx=0 tx=0).stop 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.804+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 msgr2=0x7f6bc0101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005e30 tx=0x7f6bb8003f80 comp rx=0 tx=0).stop 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 shutdown_connections 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ba80a2e90 0x7f6ba80a5350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc01082e0 0x7f6bc0101490 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bc0103760 0x7f6bc0100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 --2- 172.21.15.22:0/622095643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc0102db0 0x7f6bc0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 >> 172.21.15.22:0/622095643 conn(0x7f6bc00fc7d0 msgr2=0x7f6bc00fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 shutdown_connections 2024-09-11T22:30:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:30.805+0000 7f6bc67fb640 1 -- 172.21.15.22:0/622095643 wait complete. 2024-09-11T22:30:30.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-11T22:30:30.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-11T22:30:30.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-11T22:30:30.809 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-11T22:30:30.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-11T22:30:30.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-11T22:30:30.812 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-11T22:30:30.814 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-11T22:30:30.816 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-11T22:30:30.817 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-11T22:30:30.818 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-11T22:30:30.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-11T22:30:30.821 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-11T22:30:30.823 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-11T22:30:30.824 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-11T22:30:30.825 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-11T22:30:30.826 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-11T22:30:30.827 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-11T22:30:30.828 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-11T22:30:30.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-11T22:30:30.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-11T22:30:30.831 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-11T22:30:30.832 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-11T22:30:30.834 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-11T22:30:30.835 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-11T22:30:30.836 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-11T22:30:30.838 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-11T22:30:30.842 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-11T22:30:30.843 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-11T22:30:30.844 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-11T22:30:30.846 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-11T22:30:30.847 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-11T22:30:30.849 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-11T22:30:30.850 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-11T22:30:30.852 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-11T22:30:30.853 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-11T22:30:30.854 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-11T22:30:30.855 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-11T22:30:30.856 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-11T22:30:30.857 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-11T22:30:30.858 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-11T22:30:30.859 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-11T22:30:30.860 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-11T22:30:30.861 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-11T22:30:30.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-11T22:30:30.863 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-11T22:30:30.864 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-11T22:30:30.865 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-11T22:30:30.867 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-11T22:30:30.867 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-11T22:30:30.868 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-11T22:30:30.869 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-11T22:30:30.870 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-11T22:30:30.871 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-11T22:30:30.872 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-11T22:30:30.873 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-11T22:30:30.874 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-11T22:30:30.875 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-11T22:30:30.876 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-11T22:30:30.877 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-11T22:30:30.878 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-11T22:30:30.879 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-11T22:30:30.880 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-11T22:30:30.881 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-11T22:30:30.882 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-11T22:30:30.883 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-11T22:30:30.884 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-11T22:30:30.885 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-11T22:30:30.886 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-11T22:30:30.887 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-11T22:30:30.888 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-11T22:30:30.888 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-11T22:30:30.890 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-11T22:30:30.891 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-11T22:30:30.892 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-11T22:30:30.893 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-11T22:30:30.894 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-11T22:30:30.895 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-11T22:30:30.896 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-11T22:30:30.897 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-11T22:30:30.898 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-11T22:30:30.899 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-11T22:30:30.900 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-11T22:30:30.901 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-11T22:30:30.904 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-11T22:30:30.904 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-11T22:30:30.904 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-11T22:30:30.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-11T22:30:30.906 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-11T22:30:30.907 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-11T22:30:30.908 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-11T22:30:30.909 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-11T22:30:30.910 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-11T22:30:30.911 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-11T22:30:30.912 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-11T22:30:30.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-11T22:30:30.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-11T22:30:30.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-11T22:30:30.915 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-11T22:30:30.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-11T22:30:30.917 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-11T22:30:30.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-11T22:30:30.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-11T22:30:30.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-11T22:30:30.920 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-11T22:30:30.921 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-11T22:30:30.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-11T22:30:30.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-11T22:30:30.924 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-11T22:30:30.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-11T22:30:30.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-11T22:30:30.928 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-11T22:30:30.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-11T22:30:30.930 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-11T22:30:30.932 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-11T22:30:30.933 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-11T22:30:30.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-11T22:30:30.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-11T22:30:30.935 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-11T22:30:30.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-11T22:30:30.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-11T22:30:30.938 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-11T22:30:30.939 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-11T22:30:30.940 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-11T22:30:30.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-11T22:30:30.942 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-11T22:30:30.943 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-11T22:30:30.944 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-11T22:30:30.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-11T22:30:30.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-11T22:30:30.950 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-11T22:30:30.951 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-11T22:30:30.953 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-11T22:30:30.954 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-11T22:30:30.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-11T22:30:30.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-11T22:30:30.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-11T22:30:30.957 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-11T22:30:30.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-11T22:30:30.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-11T22:30:30.960 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-11T22:30:30.961 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-11T22:30:30.962 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-11T22:30:30.963 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-11T22:30:30.964 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-11T22:30:30.965 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-11T22:30:30.966 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-11T22:30:30.967 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-11T22:30:30.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-11T22:30:30.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-11T22:30:30.970 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-11T22:30:30.972 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-11T22:30:30.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-11T22:30:30.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-11T22:30:30.974 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-11T22:30:30.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-11T22:30:30.977 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-11T22:30:30.978 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-11T22:30:30.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-11T22:30:30.980 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-11T22:30:30.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-11T22:30:30.982 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-11T22:30:30.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-11T22:30:30.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-11T22:30:30.984 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-11T22:30:30.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-11T22:30:30.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-11T22:30:30.987 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-11T22:30:30.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-11T22:30:30.989 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-11T22:30:30.990 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-11T22:30:30.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-11T22:30:30.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-11T22:30:30.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-11T22:30:30.994 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-11T22:30:30.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-11T22:30:30.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-11T22:30:30.996 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-11T22:30:30.997 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-11T22:30:30.998 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-11T22:30:30.999 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-11T22:30:31.000 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-11T22:30:31.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-11T22:30:31.004 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-11T22:30:31.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-11T22:30:31.006 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-11T22:30:31.007 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-11T22:30:31.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-11T22:30:31.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-11T22:30:31.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-11T22:30:31.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-11T22:30:31.012 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-11T22:30:31.013 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-11T22:30:31.014 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-11T22:30:31.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-11T22:30:31.016 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-11T22:30:31.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-11T22:30:31.018 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-11T22:30:31.020 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-11T22:30:31.021 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-11T22:30:31.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-11T22:30:31.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-11T22:30:31.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-11T22:30:31.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-11T22:30:31.026 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-11T22:30:31.027 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-11T22:30:31.029 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-11T22:30:31.030 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-11T22:30:31.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-11T22:30:31.032 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-11T22:30:31.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-11T22:30:31.035 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-11T22:30:31.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-11T22:30:31.038 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-11T22:30:31.039 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-11T22:30:31.041 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-11T22:30:31.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-11T22:30:31.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-11T22:30:31.044 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-11T22:30:31.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-11T22:30:31.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-11T22:30:31.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-11T22:30:31.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-11T22:30:31.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-11T22:30:31.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-11T22:30:31.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-11T22:30:31.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-11T22:30:31.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-11T22:30:31.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-11T22:30:31.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-11T22:30:31.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-11T22:30:31.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-11T22:30:31.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-11T22:30:31.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-11T22:30:31.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-11T22:30:31.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-11T22:30:31.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-11T22:30:31.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-11T22:30:31.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-11T22:30:31.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-11T22:30:31.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-11T22:30:31.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-11T22:30:31.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-11T22:30:31.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-11T22:30:31.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-11T22:30:31.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-11T22:30:31.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-11T22:30:31.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-11T22:30:31.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-11T22:30:31.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-11T22:30:31.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-11T22:30:31.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-11T22:30:31.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-11T22:30:31.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-11T22:30:31.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-11T22:30:31.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-11T22:30:31.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-11T22:30:31.095 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-11T22:30:31.097 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-11T22:30:31.099 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-11T22:30:31.100 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-11T22:30:31.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-11T22:30:31.103 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-11T22:30:31.105 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-11T22:30:31.106 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-11T22:30:31.108 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-11T22:30:31.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-11T22:30:31.111 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-11T22:30:31.112 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-11T22:30:31.114 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-11T22:30:31.116 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-11T22:30:31.118 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-11T22:30:31.119 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-11T22:30:31.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-11T22:30:31.386 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-11T22:30:31.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-11T22:30:31.388 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-11T22:30:31.390 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-11T22:30:31.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-11T22:30:31.397 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-11T22:30:31.417 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-11T22:30:31.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-11T22:30:31.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-11T22:30:31.433 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-11T22:30:31.436 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-11T22:30:31.443 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-11T22:30:31.446 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-11T22:30:31.455 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-11T22:30:31.457 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-11T22:30:31.462 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-11T22:30:31.471 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-11T22:30:31.474 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-11T22:30:31.477 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-11T22:30:31.484 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-11T22:30:31.487 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-11T22:30:31.488 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-11T22:30:31.490 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-11T22:30:31.491 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-11T22:30:31.494 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-11T22:30:31.495 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-11T22:30:31.496 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-11T22:30:31.497 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-11T22:30:31.510 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-11T22:30:31.510 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-11T22:30:31.510 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-11T22:30:31.517 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-11T22:30:31.518 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-11T22:30:31.519 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-11T22:30:31.521 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-11T22:30:31.521 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-11T22:30:31.523 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-11T22:30:31.524 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-11T22:30:31.525 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-11T22:30:31.526 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-11T22:30:31.527 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-11T22:30:31.529 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-11T22:30:31.530 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-11T22:30:31.531 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-11T22:30:31.533 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-11T22:30:31.534 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-11T22:30:31.536 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-11T22:30:31.537 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-11T22:30:31.538 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-11T22:30:31.539 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-11T22:30:31.540 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-11T22:30:31.541 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-11T22:30:31.542 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-11T22:30:31.543 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-11T22:30:31.544 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-11T22:30:31.545 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-11T22:30:31.546 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-11T22:30:31.547 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-11T22:30:31.548 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-11T22:30:31.549 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-11T22:30:31.551 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-11T22:30:31.551 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-11T22:30:31.553 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-11T22:30:31.554 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-11T22:30:31.555 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-11T22:30:31.556 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-11T22:30:31.557 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-11T22:30:31.558 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-11T22:30:31.559 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-11T22:30:31.561 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-11T22:30:31.562 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-11T22:30:31.563 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-11T22:30:31.564 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-11T22:30:31.565 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-11T22:30:31.566 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-11T22:30:31.567 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-11T22:30:31.568 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-11T22:30:31.569 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-11T22:30:31.570 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-11T22:30:31.571 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-11T22:30:31.572 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-11T22:30:31.573 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-11T22:30:31.574 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-11T22:30:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f97daffd640 1 -- 172.21.15.22:0/565826988 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6886b4d70 con 0x55f6887d2930 2024-09-11T22:30:31.575 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f97daffd640 10 client.25277 handle_command_reply: tid=0 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 client.25277 shutdown 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 msgr2=0x55f688760040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009fd0 tx=0x7f97ec09b6d0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 shutdown_connections 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6887d2930 0x55f6887d4d20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6887580c0 0x55f688751960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6887492d0 0x55f688760580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.576 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 --2- 172.21.15.22:0/565826988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6887489b0 0x55f688760040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f97daffd640 0 client.25277 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 >> 172.21.15.22:0/565826988 conn(0x55f688745060 msgr2=0x55f6887439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.574+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 shutdown_connections 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9804ac1740 1 -- 172.21.15.22:0/565826988 wait complete. 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9804ac1740 20 client.25277 trim_cache size 0 max 16384 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:30:31.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 msgr2=0x7f97e40a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 0x7f97e40a5380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005ec0 tx=0x7f97f0005a20 comp rx=0 tx=0).stop 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 msgr2=0x7f97fc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 0x7f97fc198400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00ea20 tx=0x7f97ec00eee0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 shutdown_connections 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f97e40a2ec0 0x7f97e40a5380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97fc10c0d0 0x7f97fc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97fc1035a0 0x7f97fc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 --2- 172.21.15.22:0/2735600945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97fc102c80 0x7f97fc198400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 >> 172.21.15.22:0/2735600945 conn(0x7f97fc077990 msgr2=0x7f97fc0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.579 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-11T22:30:31.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 shutdown_connections 2024-09-11T22:30:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:31.575+0000 7f9801d2c640 1 -- 172.21.15.22:0/2735600945 wait complete. 2024-09-11T22:30:31.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-11T22:30:31.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-11T22:30:31.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-11T22:30:31.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-11T22:30:31.582 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-11T22:30:31.583 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-11T22:30:31.584 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-11T22:30:31.585 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-11T22:30:31.586 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-11T22:30:31.587 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-11T22:30:31.588 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-11T22:30:31.589 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-11T22:30:31.590 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-11T22:30:31.592 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-11T22:30:31.593 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-11T22:30:31.594 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-11T22:30:31.595 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-11T22:30:31.596 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-11T22:30:31.597 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-11T22:30:31.597 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-11T22:30:31.598 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-11T22:30:31.599 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-11T22:30:31.600 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-11T22:30:31.601 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-11T22:30:31.602 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-11T22:30:31.604 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-11T22:30:31.605 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-11T22:30:31.606 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-11T22:30:31.607 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-11T22:30:31.608 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-11T22:30:31.610 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-11T22:30:31.611 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-11T22:30:31.612 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-11T22:30:31.614 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-11T22:30:31.615 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-11T22:30:31.616 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-11T22:30:31.618 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-11T22:30:31.619 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-11T22:30:31.620 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-11T22:30:31.621 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-11T22:30:31.621 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-11T22:30:31.623 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-11T22:30:31.625 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-11T22:30:31.626 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-11T22:30:31.627 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-11T22:30:31.629 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-11T22:30:31.630 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-11T22:30:31.630 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-11T22:30:31.632 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-11T22:30:31.633 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-11T22:30:31.634 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-11T22:30:31.634 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-11T22:30:31.635 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-11T22:30:31.636 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-11T22:30:31.637 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-11T22:30:31.638 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-11T22:30:31.639 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-11T22:30:31.640 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-11T22:30:31.640 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-11T22:30:31.641 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-11T22:30:31.642 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-11T22:30:31.643 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-11T22:30:31.644 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-11T22:30:31.645 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-11T22:30:31.646 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-11T22:30:31.647 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-11T22:30:31.648 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-11T22:30:31.649 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-11T22:30:31.649 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-11T22:30:31.650 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-11T22:30:31.651 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-11T22:30:31.652 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-11T22:30:31.653 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-11T22:30:31.654 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-11T22:30:31.656 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-11T22:30:31.656 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-11T22:30:31.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:30:31.658 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-11T22:30:31.658 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-11T22:30:31.660 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-11T22:30:31.661 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-11T22:30:31.662 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-11T22:30:31.663 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-11T22:30:31.664 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-11T22:30:31.664 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-11T22:30:31.666 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-11T22:30:31.666 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-11T22:30:31.667 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-11T22:30:31.669 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-11T22:30:31.670 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-11T22:30:31.672 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-11T22:30:31.673 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-11T22:30:31.674 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-11T22:30:31.676 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-11T22:30:31.677 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-11T22:30:31.678 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-11T22:30:31.679 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-11T22:30:31.680 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-11T22:30:31.680 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-11T22:30:31.681 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-11T22:30:31.682 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-11T22:30:31.683 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-11T22:30:31.684 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-11T22:30:31.685 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-11T22:30:31.686 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-11T22:30:31.687 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-11T22:30:31.687 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-11T22:30:31.688 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-11T22:30:31.689 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-11T22:30:31.690 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-11T22:30:31.691 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-11T22:30:31.691 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-11T22:30:31.692 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-11T22:30:31.693 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-11T22:30:31.694 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-11T22:30:31.695 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-11T22:30:31.695 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-11T22:30:31.696 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-11T22:30:31.697 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-11T22:30:31.698 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-11T22:30:31.699 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-11T22:30:31.699 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-11T22:30:31.700 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-11T22:30:31.701 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-11T22:30:31.702 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-11T22:30:31.703 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-11T22:30:31.703 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-11T22:30:31.704 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-11T22:30:31.705 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-11T22:30:31.706 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-11T22:30:31.706 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-11T22:30:31.707 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-11T22:30:31.708 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-11T22:30:31.709 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-11T22:30:31.710 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-11T22:30:31.710 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-11T22:30:31.711 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-11T22:30:31.712 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-11T22:30:31.713 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-11T22:30:31.714 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-11T22:30:31.714 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-11T22:30:31.715 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-11T22:30:31.716 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-11T22:30:31.717 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-11T22:30:31.717 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-11T22:30:31.720 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-11T22:30:31.720 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-11T22:30:31.720 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-11T22:30:31.721 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-11T22:30:31.721 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-11T22:30:31.722 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-11T22:30:31.723 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-11T22:30:31.724 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-11T22:30:31.725 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-11T22:30:31.725 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-11T22:30:31.726 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-11T22:30:31.727 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-11T22:30:31.728 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-11T22:30:31.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-11T22:30:31.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-11T22:30:31.730 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-11T22:30:31.731 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-11T22:30:31.732 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-11T22:30:31.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-11T22:30:31.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-11T22:30:31.734 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-11T22:30:31.735 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-11T22:30:31.736 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-11T22:30:31.737 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-11T22:30:31.737 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-11T22:30:31.738 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-11T22:30:31.739 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-11T22:30:31.740 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-11T22:30:31.741 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-11T22:30:31.742 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-11T22:30:31.742 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-11T22:30:31.743 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-11T22:30:31.744 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-11T22:30:31.745 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-11T22:30:31.746 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-11T22:30:31.747 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-11T22:30:31.747 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-11T22:30:31.748 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-11T22:30:31.749 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-11T22:30:31.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-11T22:30:31.751 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-11T22:30:31.751 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-11T22:30:31.752 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-11T22:30:31.753 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-11T22:30:31.754 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-11T22:30:31.755 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-11T22:30:31.755 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-11T22:30:31.756 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-11T22:30:31.757 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-11T22:30:31.758 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-11T22:30:31.758 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-11T22:30:31.760 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-11T22:30:31.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-11T22:30:31.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-11T22:30:31.762 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-11T22:30:31.762 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-11T22:30:31.763 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-11T22:30:31.764 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-11T22:30:31.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-11T22:30:31.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-11T22:30:31.766 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-11T22:30:31.767 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-11T22:30:31.768 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-11T22:30:31.769 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-11T22:30:31.770 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-11T22:30:31.770 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-11T22:30:31.771 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-11T22:30:31.772 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-11T22:30:31.773 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-11T22:30:31.773 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-11T22:30:31.774 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-11T22:30:31.775 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-11T22:30:31.776 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-11T22:30:31.777 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-11T22:30:31.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-11T22:30:31.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-11T22:30:31.779 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-11T22:30:31.780 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-11T22:30:31.781 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-11T22:30:31.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-11T22:30:31.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-11T22:30:31.783 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-11T22:30:31.784 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-11T22:30:31.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-11T22:30:31.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-11T22:30:31.786 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-11T22:30:31.787 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-11T22:30:31.788 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-11T22:30:31.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-11T22:30:31.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-11T22:30:31.790 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-11T22:30:31.791 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-11T22:30:31.792 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-11T22:30:31.792 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-11T22:30:31.793 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-11T22:30:31.794 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-11T22:30:31.795 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-11T22:30:31.796 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-11T22:30:31.796 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-11T22:30:31.797 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-11T22:30:31.798 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-11T22:30:31.799 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-11T22:30:31.800 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-11T22:30:31.800 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-11T22:30:31.801 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-11T22:30:31.802 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-11T22:30:31.803 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-11T22:30:31.804 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-11T22:30:31.805 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-11T22:30:31.805 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-11T22:30:31.806 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-11T22:30:31.807 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-11T22:30:31.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-11T22:30:31.809 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-11T22:30:31.809 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-11T22:30:31.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-11T22:30:31.811 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-11T22:30:31.812 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-11T22:30:31.813 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-11T22:30:31.813 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-11T22:30:31.814 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-11T22:30:31.815 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-11T22:30:31.816 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-11T22:30:31.816 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-11T22:30:31.817 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-11T22:30:31.818 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-11T22:30:31.819 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-11T22:30:31.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-11T22:30:31.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-11T22:30:31.821 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-11T22:30:31.822 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-11T22:30:31.823 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-11T22:30:31.823 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-11T22:30:31.824 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-11T22:30:31.825 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-11T22:30:31.826 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-11T22:30:31.826 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-11T22:30:31.827 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-11T22:30:31.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-11T22:30:31.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-11T22:30:31.830 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-11T22:30:31.830 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-11T22:30:31.831 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-11T22:30:31.832 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-11T22:30:31.833 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-11T22:30:31.834 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-11T22:30:31.834 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-11T22:30:31.835 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-11T22:30:31.836 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-11T22:30:31.837 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-11T22:30:31.838 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-11T22:30:31.839 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-11T22:30:31.840 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-11T22:30:31.841 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-11T22:30:31.842 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-11T22:30:31.843 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-11T22:30:31.843 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-11T22:30:31.844 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-11T22:30:31.845 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-11T22:30:31.846 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-11T22:30:31.847 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-11T22:30:31.847 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-11T22:30:31.848 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-11T22:30:31.849 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-11T22:30:31.850 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-11T22:30:31.850 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-11T22:30:31.851 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-11T22:30:31.852 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-11T22:30:31.853 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-11T22:30:31.854 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-11T22:30:31.854 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-11T22:30:31.855 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-11T22:30:31.856 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-11T22:30:31.857 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-11T22:30:31.858 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-11T22:30:31.858 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-11T22:30:31.859 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-11T22:30:31.860 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-11T22:30:31.861 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-11T22:30:31.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-11T22:30:31.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-11T22:30:31.863 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-11T22:30:31.864 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-11T22:30:31.865 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-11T22:30:31.866 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-11T22:30:31.866 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-11T22:30:31.867 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-11T22:30:31.868 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-11T22:30:31.869 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-11T22:30:31.870 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-11T22:30:31.870 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-11T22:30:31.871 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-11T22:30:31.872 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-11T22:30:31.873 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-11T22:30:31.873 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-11T22:30:31.874 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-11T22:30:31.875 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-11T22:30:31.876 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-11T22:30:31.877 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-11T22:30:31.877 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-11T22:30:31.878 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-11T22:30:31.879 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-11T22:30:31.880 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-11T22:30:31.881 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-11T22:30:31.881 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-11T22:30:31.882 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-11T22:30:31.883 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-11T22:30:31.884 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-11T22:30:31.884 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-11T22:30:31.885 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-11T22:30:31.886 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-11T22:30:31.887 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-11T22:30:31.888 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-11T22:30:31.888 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-11T22:30:31.889 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-11T22:30:31.890 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-11T22:30:31.891 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-11T22:30:31.891 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-11T22:30:31.892 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-11T22:30:31.893 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-11T22:30:31.894 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-11T22:30:31.895 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-11T22:30:31.895 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-11T22:30:31.896 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-11T22:30:31.897 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-11T22:30:31.898 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-11T22:30:31.898 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-11T22:30:31.899 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-11T22:30:31.900 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-11T22:30:31.901 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-11T22:30:31.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:31 smithi022 ceph-mon[30966]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:31 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:30:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:31 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:31 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:30:31.902 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-11T22:30:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:31 smithi169 ceph-mon[35628]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:31 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:30:31.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:31 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:31.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:31 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:30:31.903 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-11T22:30:31.903 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-11T22:30:31.904 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-11T22:30:31.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-11T22:30:31.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-11T22:30:31.906 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-11T22:30:31.907 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-11T22:30:31.908 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-11T22:30:31.909 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-11T22:30:31.910 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-11T22:30:31.910 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-11T22:30:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:31 smithi045 ceph-mon[35556]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:31 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:30:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:31 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:31 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:30:31.912 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-11T22:30:31.912 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-11T22:30:31.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-11T22:30:31.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-11T22:30:31.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-11T22:30:31.915 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-11T22:30:31.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-11T22:30:31.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-11T22:30:31.917 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-11T22:30:31.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-11T22:30:31.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-11T22:30:31.920 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-11T22:30:31.921 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-11T22:30:31.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-11T22:30:31.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-11T22:30:31.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-11T22:30:31.924 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-11T22:30:31.925 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-11T22:30:31.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-11T22:30:31.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-11T22:30:31.927 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-11T22:30:31.928 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-11T22:30:31.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-11T22:30:31.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-11T22:30:31.930 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-11T22:30:31.931 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-11T22:30:31.931 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:31.932 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-11T22:30:31.933 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-11T22:30:31.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-11T22:30:31.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-11T22:30:31.935 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-11T22:30:31.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-11T22:30:31.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-11T22:30:31.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-11T22:30:31.938 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-11T22:30:31.939 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-11T22:30:31.940 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-11T22:30:31.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-11T22:30:31.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-11T22:30:31.942 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-11T22:30:31.943 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-11T22:30:31.944 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-11T22:30:31.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-11T22:30:31.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-11T22:30:31.946 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-11T22:30:31.947 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-11T22:30:31.948 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-11T22:30:31.948 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-11T22:30:31.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-11T22:30:31.950 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-11T22:30:31.951 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-11T22:30:31.952 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-11T22:30:31.952 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-11T22:30:31.953 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-11T22:30:31.954 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-11T22:30:31.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-11T22:30:31.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-11T22:30:31.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-11T22:30:31.957 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-11T22:30:31.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-11T22:30:31.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-11T22:30:31.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-11T22:30:31.960 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-11T22:30:31.961 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-11T22:30:31.961 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-11T22:30:31.962 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-11T22:30:31.963 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-11T22:30:31.964 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-11T22:30:31.965 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-11T22:30:31.965 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-11T22:30:31.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-11T22:30:31.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-11T22:30:31.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-11T22:30:31.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-11T22:30:31.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-11T22:30:31.970 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-11T22:30:31.971 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-11T22:30:31.972 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-11T22:30:31.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-11T22:30:31.974 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-11T22:30:31.974 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-11T22:30:31.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-11T22:30:31.976 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-11T22:30:31.977 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-11T22:30:31.978 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-11T22:30:31.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-11T22:30:31.980 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-11T22:30:31.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-11T22:30:31.982 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-11T22:30:31.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-11T22:30:31.984 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-11T22:30:31.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-11T22:30:31.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-11T22:30:31.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-11T22:30:31.987 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-11T22:30:31.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-11T22:30:31.989 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-11T22:30:31.990 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-11T22:30:31.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-11T22:30:31.992 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-11T22:30:31.992 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-11T22:30:31.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-11T22:30:31.994 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-11T22:30:31.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-11T22:30:31.997 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-11T22:30:31.998 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-11T22:30:31.999 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-11T22:30:32.000 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-11T22:30:32.001 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-11T22:30:32.002 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-11T22:30:32.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-11T22:30:32.004 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-11T22:30:32.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-11T22:30:32.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-11T22:30:32.006 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-11T22:30:32.007 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-11T22:30:32.008 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-11T22:30:32.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-11T22:30:32.010 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-11T22:30:32.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-11T22:30:32.012 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-11T22:30:32.013 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-11T22:30:32.014 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-11T22:30:32.014 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-11T22:30:32.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-11T22:30:32.016 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-11T22:30:32.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-11T22:30:32.018 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-11T22:30:32.019 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-11T22:30:32.020 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-11T22:30:32.021 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-11T22:30:32.022 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-11T22:30:32.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-11T22:30:32.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-11T22:30:32.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-11T22:30:32.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-11T22:30:32.026 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-11T22:30:32.027 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-11T22:30:32.028 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-11T22:30:32.029 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-11T22:30:32.030 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-11T22:30:32.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-11T22:30:32.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-11T22:30:32.032 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-11T22:30:32.033 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-11T22:30:32.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-11T22:30:32.035 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-11T22:30:32.036 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-11T22:30:32.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-11T22:30:32.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-11T22:30:32.038 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-11T22:30:32.039 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-11T22:30:32.040 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-11T22:30:32.041 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-11T22:30:32.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-11T22:30:32.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-11T22:30:32.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-11T22:30:32.044 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-11T22:30:32.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-11T22:30:32.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-11T22:30:32.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-11T22:30:32.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-11T22:30:32.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-11T22:30:32.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-11T22:30:32.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-11T22:30:32.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-11T22:30:32.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-11T22:30:32.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-11T22:30:32.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-11T22:30:32.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-11T22:30:32.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-11T22:30:32.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-11T22:30:32.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-11T22:30:32.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-11T22:30:32.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-11T22:30:32.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-11T22:30:32.060 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-11T22:30:32.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-11T22:30:32.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-11T22:30:32.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-11T22:30:32.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-11T22:30:32.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-11T22:30:32.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-11T22:30:32.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-11T22:30:32.068 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-11T22:30:32.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-11T22:30:32.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-11T22:30:32.071 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-11T22:30:32.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-11T22:30:32.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-11T22:30:32.074 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-11T22:30:32.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-11T22:30:32.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-11T22:30:32.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-11T22:30:32.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-11T22:30:32.078 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-11T22:30:32.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-11T22:30:32.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-11T22:30:32.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-11T22:30:32.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-11T22:30:32.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-11T22:30:32.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-11T22:30:32.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-11T22:30:32.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-11T22:30:32.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-11T22:30:32.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-11T22:30:32.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-11T22:30:32.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-11T22:30:32.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-11T22:30:32.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-11T22:30:32.092 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-11T22:30:32.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-11T22:30:32.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-11T22:30:32.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-11T22:30:32.095 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-11T22:30:32.096 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-11T22:30:32.097 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-11T22:30:32.098 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-11T22:30:32.099 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-11T22:30:32.099 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-11T22:30:32.100 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-11T22:30:32.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-11T22:30:32.102 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-11T22:30:32.103 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-11T22:30:32.104 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-11T22:30:32.105 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-11T22:30:32.106 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-11T22:30:32.107 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-11T22:30:32.108 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-11T22:30:32.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-11T22:30:32.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-11T22:30:32.110 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-11T22:30:32.111 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-11T22:30:32.112 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-11T22:30:32.113 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-11T22:30:32.114 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-11T22:30:32.115 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-11T22:30:32.116 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-11T22:30:32.117 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-11T22:30:32.118 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-11T22:30:32.118 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-11T22:30:32.119 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-11T22:30:32.120 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-11T22:30:32.121 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-11T22:30:32.122 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-11T22:30:32.123 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-11T22:30:32.123 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-11T22:30:32.124 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-11T22:30:32.125 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-11T22:30:32.126 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-11T22:30:32.127 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-11T22:30:32.128 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-11T22:30:32.129 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-11T22:30:32.130 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-11T22:30:32.131 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-11T22:30:32.132 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-11T22:30:32.133 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-11T22:30:32.133 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-11T22:30:32.134 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-11T22:30:32.135 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-11T22:30:32.136 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-11T22:30:32.137 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-11T22:30:32.138 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-11T22:30:32.139 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-11T22:30:32.140 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-11T22:30:32.141 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-11T22:30:32.142 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-11T22:30:32.143 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-11T22:30:32.144 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-11T22:30:32.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-11T22:30:32.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-11T22:30:32.146 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-11T22:30:32.147 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-11T22:30:32.148 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-11T22:30:32.149 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-11T22:30:32.150 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-11T22:30:32.150 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-11T22:30:32.151 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-11T22:30:32.152 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-11T22:30:32.154 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-11T22:30:32.155 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-11T22:30:32.156 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-11T22:30:32.156 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-11T22:30:32.157 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-11T22:30:32.158 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-11T22:30:32.159 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-11T22:30:32.160 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-11T22:30:32.161 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-11T22:30:32.162 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-11T22:30:32.163 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-11T22:30:32.164 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-11T22:30:32.165 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-11T22:30:32.166 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-11T22:30:32.166 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-11T22:30:32.167 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-11T22:30:32.168 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-11T22:30:32.169 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-11T22:30:32.170 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-11T22:30:32.171 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-11T22:30:32.172 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-11T22:30:32.173 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-11T22:30:32.174 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-11T22:30:32.174 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-11T22:30:32.175 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-11T22:30:32.176 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-11T22:30:32.177 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-11T22:30:32.178 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-11T22:30:32.179 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-11T22:30:32.179 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-11T22:30:32.180 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-11T22:30:32.181 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-11T22:30:32.182 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-11T22:30:32.183 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-11T22:30:32.183 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-11T22:30:32.184 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-11T22:30:32.185 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-11T22:30:32.186 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-11T22:30:32.186 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-11T22:30:32.187 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-11T22:30:32.188 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-11T22:30:32.189 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-11T22:30:32.190 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-11T22:30:32.191 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-11T22:30:32.192 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-11T22:30:32.193 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-11T22:30:32.193 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-11T22:30:32.194 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-11T22:30:32.195 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-11T22:30:32.196 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-11T22:30:32.196 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-11T22:30:32.197 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-11T22:30:32.198 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-11T22:30:32.199 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-11T22:30:32.200 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-11T22:30:32.201 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-11T22:30:32.202 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-11T22:30:32.202 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-11T22:30:32.204 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-11T22:30:32.205 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-11T22:30:32.206 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-11T22:30:32.207 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-11T22:30:32.207 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-11T22:30:32.208 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-11T22:30:32.209 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-11T22:30:32.210 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-11T22:30:32.211 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-11T22:30:32.212 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-11T22:30:32.212 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-11T22:30:32.213 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-11T22:30:32.214 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-11T22:30:32.215 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-11T22:30:32.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-11T22:30:32.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-11T22:30:32.217 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-11T22:30:32.218 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-11T22:30:32.219 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-11T22:30:32.220 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-11T22:30:32.220 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-11T22:30:32.221 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-11T22:30:32.222 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-11T22:30:32.223 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-11T22:30:32.224 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-11T22:30:32.225 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-11T22:30:32.225 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-11T22:30:32.226 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-11T22:30:32.228 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-11T22:30:32.228 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-11T22:30:32.229 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-11T22:30:32.230 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-11T22:30:32.232 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-11T22:30:32.232 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-11T22:30:32.232 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-11T22:30:32.233 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-11T22:30:32.234 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-11T22:30:32.235 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-11T22:30:32.235 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-11T22:30:32.236 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-11T22:30:32.237 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-11T22:30:32.238 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-11T22:30:32.238 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-11T22:30:32.239 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-11T22:30:32.240 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-11T22:30:32.241 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-11T22:30:32.241 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-11T22:30:32.242 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-11T22:30:32.243 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-11T22:30:32.244 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-11T22:30:32.245 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-11T22:30:32.245 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-11T22:30:32.246 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-11T22:30:32.247 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-11T22:30:32.248 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-11T22:30:32.249 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-11T22:30:32.249 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-11T22:30:32.250 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-11T22:30:32.251 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-11T22:30:32.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-11T22:30:32.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-11T22:30:32.253 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-11T22:30:32.254 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-11T22:30:32.255 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-11T22:30:32.256 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-11T22:30:32.256 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-11T22:30:32.257 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-11T22:30:32.258 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-11T22:30:32.258 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-11T22:30:32.259 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-11T22:30:32.260 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-11T22:30:32.261 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-11T22:30:32.262 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-11T22:30:32.263 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-11T22:30:32.263 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-11T22:30:32.264 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-11T22:30:32.265 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-11T22:30:32.266 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-11T22:30:32.266 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-11T22:30:32.267 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-11T22:30:32.268 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-11T22:30:32.269 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-11T22:30:32.270 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-11T22:30:32.271 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-11T22:30:32.271 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-11T22:30:32.272 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-11T22:30:32.273 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-11T22:30:32.274 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-11T22:30:32.275 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-11T22:30:32.275 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-11T22:30:32.276 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-11T22:30:32.277 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-11T22:30:32.278 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-11T22:30:32.279 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-11T22:30:32.280 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-11T22:30:32.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-11T22:30:32.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-11T22:30:32.282 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-11T22:30:32.283 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-11T22:30:32.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-11T22:30:32.285 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-11T22:30:32.286 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-11T22:30:32.287 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-11T22:30:32.287 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-11T22:30:32.288 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-11T22:30:32.289 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-11T22:30:32.290 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-11T22:30:32.291 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-11T22:30:32.292 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-11T22:30:32.292 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-11T22:30:32.293 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-11T22:30:32.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-11T22:30:32.295 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-11T22:30:32.296 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-11T22:30:32.297 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-11T22:30:32.298 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-11T22:30:32.299 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-11T22:30:32.299 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-11T22:30:32.300 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-11T22:30:32.301 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-11T22:30:32.302 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-11T22:30:32.303 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-11T22:30:32.304 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-11T22:30:32.305 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-11T22:30:32.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-11T22:30:32.307 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-11T22:30:32.308 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-11T22:30:32.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-11T22:30:32.310 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-11T22:30:32.310 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-11T22:30:32.311 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-11T22:30:32.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-11T22:30:32.313 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-11T22:30:32.314 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-11T22:30:32.314 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-11T22:30:32.315 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-11T22:30:32.316 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-11T22:30:32.317 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-11T22:30:32.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-11T22:30:32.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-11T22:30:32.319 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-11T22:30:32.320 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-11T22:30:32.321 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-11T22:30:32.322 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-11T22:30:32.323 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-11T22:30:32.328 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-11T22:30:32.329 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-11T22:30:32.330 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-11T22:30:32.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-11T22:30:32.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-11T22:30:32.332 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-11T22:30:32.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-11T22:30:32.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-11T22:30:32.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-11T22:30:32.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-11T22:30:32.337 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-11T22:30:32.337 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-11T22:30:32.338 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-11T22:30:32.339 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-11T22:30:32.340 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-11T22:30:32.340 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-11T22:30:32.341 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-11T22:30:32.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-11T22:30:32.343 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-11T22:30:32.344 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-11T22:30:32.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-11T22:30:32.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-11T22:30:32.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-11T22:30:32.347 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-11T22:30:32.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-11T22:30:32.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-11T22:30:32.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-11T22:30:32.350 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-11T22:30:32.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-11T22:30:32.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-11T22:30:32.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-11T22:30:32.353 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-11T22:30:32.354 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-11T22:30:32.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-11T22:30:32.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-11T22:30:32.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-11T22:30:32.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-11T22:30:32.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-11T22:30:32.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-11T22:30:32.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-11T22:30:32.360 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-11T22:30:32.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-11T22:30:32.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-11T22:30:32.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-11T22:30:32.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-11T22:30:32.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-11T22:30:32.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-11T22:30:32.366 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-11T22:30:32.367 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-11T22:30:32.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 -- 172.21.15.22:0/4239457246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0100e20 msgr2=0x7ffae0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 --2- 172.21.15.22:0/4239457246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0100e20 0x7ffae0101200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009900 tx=0x7ffadc02a480 comp rx=0 tx=0).stop 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 -- 172.21.15.22:0/4239457246 shutdown_connections 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 --2- 172.21.15.22:0/4239457246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102ef0 0x7ffae010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 --2- 172.21.15.22:0/4239457246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 --2- 172.21.15.22:0/4239457246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0100e20 0x7ffae0101200 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 -- 172.21.15.22:0/4239457246 >> 172.21.15.22:0/4239457246 conn(0x7ffae00fc7d0 msgr2=0x7ffae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 -- 172.21.15.22:0/4239457246 shutdown_connections 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.405+0000 7ffae75a1640 1 -- 172.21.15.22:0/4239457246 wait complete. 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 Processor -- start 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 -- start start 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0100e20 0x7ffae0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 0x7ffae019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112180 con 0x7ffae0102ef0 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112000 con 0x7ffae0102570 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.406+0000 7ffae75a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112300 con 0x7ffae0100e20 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 0x7ffae019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40920/0 (socket says 172.21.15.22:40920) 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 -- 172.21.15.22:0/2590322889 learned_addr learned my addr 172.21.15.22:0/2590322889 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae533d640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0100e20 0x7ffae0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 -- 172.21.15.22:0/2590322889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0100e20 msgr2=0x7ffae0198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0100e20 0x7ffae0198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 -- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 msgr2=0x7ffae019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 0x7ffae019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 -- 172.21.15.22:0/2590322889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae019d5b0 con 0x7ffae0102570 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 0x7ffae019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffad000e9f0 tx=0x7ffad000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffad67fc640 1 -- 172.21.15.22:0/2590322889 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad000cd80 con 0x7ffae0102570 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae019d8a0 con 0x7ffae0102570 2024-09-11T22:30:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffad67fc640 1 -- 172.21.15.22:0/2590322889 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad0010930 con 0x7ffae0102570 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffad67fc640 1 -- 172.21.15.22:0/2590322889 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0018b00 con 0x7ffae0102570 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.407+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae01a5180 con 0x7ffae0102570 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 Processor -- start 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffad67fc640 1 -- 172.21.15.22:0/2590322889 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7ffad0018ca0 con 0x7ffae0102570 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 -- start start 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe875b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 0x55dbe875de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbe86b22e0 con 0x55dbe874c380 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dbe8659ce0 con 0x55dbe874cca0 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae997a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dbe86ae2a0 con 0x55dbe875ba90 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53646/0 (socket says 172.21.15.22:53646) 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 -- 172.21.15.22:0/2309450868 learned_addr learned my addr 172.21.15.22:0/2309450868 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae533d640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe875b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 0x55dbe875de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 -- 172.21.15.22:0/2309450868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 msgr2=0x55dbe875de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 0x55dbe875de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 -- 172.21.15.22:0/2309450868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 msgr2=0x55dbe875b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe875b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae5b3e640 1 -- 172.21.15.22:0/2309450868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe863e440 con 0x55dbe874c380 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.411+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 0x55dbe875de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffad67fc640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 0x7ffacc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffad80117e0 tx=0x7ffad8011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fd0a37ad64a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffae533d640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 0x7ffacc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffad67fc640 1 -- 172.21.15.22:0/2590322889 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ffad00cfa80 con 0x7ffae0102570 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffacb7fe640 1 -- 172.21.15.22:0/2309450868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8011310 con 0x55dbe874c380 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffacb7fe640 1 -- 172.21.15.22:0/2309450868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad800f9a0 con 0x55dbe874c380 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.412+0000 7ffacb7fe640 1 -- 172.21.15.22:0/2309450868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8004690 con 0x55dbe874c380 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- 172.21.15.22:0/2309450868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 msgr2=0x55dbe874c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae533d640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 0x7ffacc0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009230 tx=0x7ffadc0058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ffad80117e0 tx=0x7ffad8011ca0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- 172.21.15.22:0/2309450868 shutdown_connections 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe875ba90 0x55dbe875de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe875b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 --2- 172.21.15.22:0/2309450868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe874c760 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- 172.21.15.22:0/2309450868 >> 172.21.15.22:0/2309450868 conn(0x55dbe8748a30 msgr2=0x55dbe8748e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- 172.21.15.22:0/2309450868 shutdown_connections 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- 172.21.15.22:0/2309450868 wait complete. 2024-09-11T22:30:32.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 -- start start 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.413+0000 7ffae997a740 1 Processor -- start 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe875b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe8758720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dbe875e660 con 0x55dbe875ba90 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dbe866d050 con 0x55dbe874cca0 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dbe875e7e0 con 0x55dbe874c380 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae997a740 10 client.0 _ll_register_callbacks cb 0x55dbe86ad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae4b3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe8758720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53650/0 (socket says 172.21.15.22:53650) 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 -- 172.21.15.22:0/3471157767 learned_addr learned my addr 172.21.15.22:0/3471157767 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:32.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae533d640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe875b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 -- 172.21.15.22:0/3471157767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 msgr2=0x55dbe875b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe875b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 -- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 msgr2=0x55dbe8758720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe8758720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 -- 172.21.15.22:0/3471157767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe84233c0 con 0x55dbe875ba90 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe8758720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.414+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffad800f790 tx=0x7ffad8011340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f202cf0f650496 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8003d80 con 0x55dbe875ba90 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ffad8005030 con 0x55dbe875ba90 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad800f9a0 con 0x55dbe875ba90 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffad8005230 con 0x55dbe875ba90 2024-09-11T22:30:32.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 10 client.15618 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dbe876a0e0 con 0x55dbe875ba90 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad800f9a0 con 0x55dbe875ba90 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffad8018020 con 0x55dbe875ba90 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 10 client.15618 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 20 client.15618 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe876b430 0x55dbe876d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 4 client.15618 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.415+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbe86bf850 con 0x55dbe876b430 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.416+0000 7ffae533d640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe876b430 0x55dbe876d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.416+0000 7ffae533d640 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe876b430 0x55dbe876d820 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619dc8417516d229 server_cookie=4645901268d66b87 in_seq=0 out_seq=0 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.416+0000 7ffac8ff9640 10 client.15618 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:32.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffac8ff9640 1 -- 172.21.15.22:0/3471157767 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbe86bf850 con 0x55dbe876b430 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffac8ff9640 10 client.15618 handle_command_reply: tid=0 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 client.15618 shutdown 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 msgr2=0x55dbe8758cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffad800f790 tx=0x7ffad8011340 comp rx=0 tx=0).stop 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 shutdown_connections 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe876b430 0x55dbe876d820 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe875ba90 0x55dbe8758cf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe874cca0 0x55dbe8758720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 --2- 172.21.15.22:0/3471157767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe875b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 >> 172.21.15.22:0/3471157767 conn(0x55dbe8748a30 msgr2=0x55dbe874e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffac8ff9640 0 client.15618 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 shutdown_connections 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 1 -- 172.21.15.22:0/3471157767 wait complete. 2024-09-11T22:30:32.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.418+0000 7ffae997a740 20 client.15618 trim_cache size 0 max 16384 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 Processor -- start 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 -- start start 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8767900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 0x55dbe8773050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01a96c0 con 0x55dbe874c380 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01abf40 con 0x55dbe8748a30 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.437+0000 7ffae997a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01a9d30 con 0x55dbe874cca0 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53662/0 (socket says 172.21.15.22:53662) 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae533d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8767900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 -- 172.21.15.22:0/3462105560 learned_addr learned my addr 172.21.15.22:0/3462105560 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 0x55dbe8773050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 -- 172.21.15.22:0/3462105560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 msgr2=0x55dbe8773050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 0x55dbe8773050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 -- 172.21.15.22:0/3462105560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 msgr2=0x55dbe8767900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8767900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 -- 172.21.15.22:0/3462105560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe87496c0 con 0x55dbe874c380 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae533d640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8767900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 0x55dbe8773050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c6a0 tx=0x7ffad0018520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c17119dcce182e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffacaffd640 1 -- 172.21.15.22:0/3462105560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad009f020 con 0x55dbe874c380 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffacaffd640 1 -- 172.21.15.22:0/3462105560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad009be50 con 0x55dbe874c380 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.438+0000 7ffacaffd640 1 -- 172.21.15.22:0/3462105560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad00d7040 con 0x55dbe874c380 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 -- 172.21.15.22:0/3462105560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 msgr2=0x55dbe8753c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c6a0 tx=0x7ffad0018520 comp rx=0 tx=0).stop 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 -- 172.21.15.22:0/3462105560 shutdown_connections 2024-09-11T22:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874cca0 0x55dbe8773050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874c380 0x55dbe8753c00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 --2- 172.21.15.22:0/3462105560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8767900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 -- 172.21.15.22:0/3462105560 >> 172.21.15.22:0/3462105560 conn(0x55dbe876dc10 msgr2=0x55dbe87534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 -- 172.21.15.22:0/3462105560 shutdown_connections 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.439+0000 7ffae997a740 1 -- 172.21.15.22:0/3462105560 wait complete. 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 -- start start 2024-09-11T22:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 Processor -- start 2024-09-11T22:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe87643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01aa400 con 0x55dbe874cca0 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01ab870 con 0x55dbe8748a30 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01aaad0 con 0x55dbe874c380 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae533d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae997a740 10 client.0 _ll_register_callbacks cb 0x7ffad80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae5b3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53666/0 (socket says 172.21.15.22:53666) 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae533d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40962/0 (socket says 172.21.15.22:40962) 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae5b3e640 1 -- 172.21.15.22:0/4016223864 learned_addr learned my addr 172.21.15.22:0/4016223864 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.440+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe87643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 -- 172.21.15.22:0/4016223864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 msgr2=0x55dbe87643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe87643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 -- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 msgr2=0x55dbe8763e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:32.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 -- 172.21.15.22:0/4016223864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe8755bd0 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae533d640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae4b3c640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe87643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae5b3e640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000f80 tx=0x7ffad8026c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f990f2dd51fb5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8026650 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ffad8003b80 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad009be50 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffad803f050 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae997a740 10 client.15624 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.441+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dbe87d5d00 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad009be50 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffad8018040 con 0x55dbe874cca0 2024-09-11T22:30:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 10 client.15624 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 20 client.15624 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe875ba90 0x55dbe87d83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 4 client.15624 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbe86b9d60 con 0x55dbe875ba90 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae533d640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe875ba90 0x55dbe87d83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffac8ff9640 10 client.15624 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.442+0000 7ffae533d640 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe875ba90 0x55dbe87d83f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab539e36d0245c2e server_cookie=f18569c195b2604f in_seq=0 out_seq=0 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.443+0000 7ffac8ff9640 1 -- 172.21.15.22:0/4016223864 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dbe86b9d60 con 0x55dbe875ba90 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.443+0000 7ffac8ff9640 10 client.15624 handle_command_reply: tid=0 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.443+0000 7ffae997a740 1 client.15624 shutdown 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 msgr2=0x55dbe87553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffad8000f80 tx=0x7ffad8026c30 comp rx=0 tx=0).stop 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 shutdown_connections 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55dbe875ba90 0x55dbe87d83f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dbe874cca0 0x55dbe87553a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dbe874c380 0x55dbe87643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 --2- 172.21.15.22:0/4016223864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dbe8748a30 0x55dbe8763e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 >> 172.21.15.22:0/4016223864 conn(0x55dbe876dc10 msgr2=0x55dbe8747b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffac8ff9640 0 client.15624 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 shutdown_connections 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 1 -- 172.21.15.22:0/4016223864 wait complete. 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae997a740 20 client.15624 trim_cache size 0 max 16384 2024-09-11T22:30:32.449 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "04334f3e-1d69-405f-9b36-4b08a9da4d6f": { 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "04334f3e-1d69-405f-9b36-4b08a9da4d6f", 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:30:32.450 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 msgr2=0x7ffacc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 0x7ffacc0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009230 tx=0x7ffadc0058d0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 msgr2=0x7ffae0198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.444+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffad000e9f0 tx=0x7ffad000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 shutdown_connections 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffacc0a2e10 0x7ffacc0a52d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffae0102ef0 0x7ffae019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae0102570 0x7ffae0198b40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 --2- 172.21.15.22:0/2590322889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0100e20 0x7ffae0198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 >> 172.21.15.22:0/2590322889 conn(0x7ffae00fc7d0 msgr2=0x7ffae01068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 shutdown_connections 2024-09-11T22:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:32.445+0000 7ffae75a1640 1 -- 172.21.15.22:0/2590322889 wait complete. 2024-09-11T22:30:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:32 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:32.726 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-11T22:30:32.727 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-11T22:30:32.728 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-11T22:30:32.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-11T22:30:32.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-11T22:30:32.730 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-11T22:30:32.731 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-11T22:30:32.732 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-11T22:30:32.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-11T22:30:32.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-11T22:30:32.734 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-11T22:30:32.735 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-11T22:30:32.736 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-11T22:30:32.737 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-11T22:30:32.738 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-11T22:30:32.739 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-11T22:30:32.740 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-11T22:30:32.741 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-11T22:30:32.741 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-11T22:30:32.742 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-11T22:30:32.743 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-11T22:30:32.745 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-11T22:30:32.746 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-11T22:30:32.746 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-11T22:30:32.748 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-11T22:30:32.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-11T22:30:32.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-11T22:30:32.751 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-11T22:30:32.752 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-11T22:30:32.753 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-11T22:30:32.754 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-11T22:30:32.755 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-11T22:30:32.756 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-11T22:30:32.757 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-11T22:30:32.758 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-11T22:30:32.759 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-11T22:30:32.760 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-11T22:30:32.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-11T22:30:32.762 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-11T22:30:32.763 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-11T22:30:32.764 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-11T22:30:32.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-11T22:30:32.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-11T22:30:32.766 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-11T22:30:32.767 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-11T22:30:32.768 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-11T22:30:32.769 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-11T22:30:32.770 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-11T22:30:32.771 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-11T22:30:32.772 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-11T22:30:32.773 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-11T22:30:32.774 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-11T22:30:32.775 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-11T22:30:32.776 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-11T22:30:32.777 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-11T22:30:32.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-11T22:30:32.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-11T22:30:32.779 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-11T22:30:32.780 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-11T22:30:32.781 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-11T22:30:32.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-11T22:30:32.783 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-11T22:30:32.784 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-11T22:30:32.784 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-11T22:30:32.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-11T22:30:32.786 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-11T22:30:32.787 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-11T22:30:32.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-11T22:30:32.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-11T22:30:32.790 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-11T22:30:32.791 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-11T22:30:32.792 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-11T22:30:32.793 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-11T22:30:32.794 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-11T22:30:32.795 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-11T22:30:32.797 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-11T22:30:32.797 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-11T22:30:32.798 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-11T22:30:32.799 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-11T22:30:32.800 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-11T22:30:32.801 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-11T22:30:32.802 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-11T22:30:32.803 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-11T22:30:32.803 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-11T22:30:32.804 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-11T22:30:32.805 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-11T22:30:32.806 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-11T22:30:32.807 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-11T22:30:32.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-11T22:30:32.809 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-11T22:30:32.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-11T22:30:32.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-11T22:30:32.811 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-11T22:30:32.813 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-11T22:30:32.813 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-11T22:30:32.814 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-11T22:30:32.815 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-11T22:30:32.816 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-11T22:30:32.817 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-11T22:30:32.818 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-11T22:30:32.819 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-11T22:30:32.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-11T22:30:32.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-11T22:30:32.821 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-11T22:30:32.822 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-11T22:30:32.823 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-11T22:30:32.824 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-11T22:30:32.824 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-11T22:30:32.825 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-11T22:30:32.826 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-11T22:30:32.827 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-11T22:30:32.828 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-11T22:30:32.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-11T22:30:32.830 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-11T22:30:32.831 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-11T22:30:32.832 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-11T22:30:32.832 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-11T22:30:32.833 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-11T22:30:32.834 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-11T22:30:32.835 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/ 2024-09-11T22:30:32.835 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-11T22:30:32.836 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-11T22:30:32.837 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-11T22:30:32.838 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-11T22:30:32.839 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-11T22:30:32.840 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-11T22:30:32.841 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-11T22:30:32.842 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-11T22:30:32.843 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-11T22:30:32.844 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-11T22:30:32.845 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-11T22:30:32.845 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-11T22:30:32.846 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-11T22:30:32.847 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-11T22:30:32.848 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-11T22:30:32.848 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-11T22:30:32.849 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-11T22:30:32.850 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-11T22:30:32.851 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-11T22:30:32.852 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-11T22:30:32.853 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-11T22:30:32.853 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-11T22:30:32.854 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-11T22:30:32.855 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-11T22:30:32.856 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-11T22:30:32.857 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-11T22:30:32.857 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-11T22:30:32.858 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-11T22:30:32.859 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-11T22:30:32.860 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-11T22:30:32.861 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-11T22:30:32.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-11T22:30:32.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-11T22:30:32.863 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-11T22:30:32.864 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-11T22:30:32.865 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-11T22:30:32.866 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-11T22:30:32.867 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-11T22:30:32.868 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-11T22:30:32.869 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-11T22:30:32.870 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-11T22:30:32.871 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-11T22:30:32.872 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-11T22:30:32.873 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-11T22:30:32.874 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-11T22:30:32.875 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-11T22:30:32.876 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-11T22:30:32.877 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-11T22:30:32.878 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-11T22:30:32.879 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-11T22:30:32.879 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-11T22:30:32.880 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-11T22:30:32.881 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-11T22:30:32.883 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-11T22:30:32.883 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-11T22:30:32.885 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-11T22:30:32.885 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-11T22:30:32.886 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-11T22:30:32.887 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-11T22:30:32.888 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-11T22:30:32.889 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-11T22:30:32.890 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-11T22:30:32.890 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-11T22:30:32.891 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-11T22:30:32.892 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-11T22:30:32.893 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-11T22:30:32.894 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-11T22:30:32.895 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-11T22:30:32.896 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-11T22:30:32.897 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-11T22:30:32.897 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-11T22:30:32.898 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-11T22:30:32.899 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-11T22:30:32.900 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-11T22:30:32.901 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-11T22:30:32.901 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-11T22:30:32.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:32 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:32.902 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-11T22:30:32.903 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-11T22:30:32.904 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-11T22:30:32.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-11T22:30:32.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-11T22:30:32.906 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-11T22:30:32.907 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-11T22:30:32.908 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-11T22:30:32.909 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-11T22:30:32.910 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-11T22:30:32.911 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-11T22:30:32.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:32 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:30:32.912 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-11T22:30:32.913 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-11T22:30:32.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-11T22:30:32.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-11T22:30:32.915 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-11T22:30:32.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-11T22:30:32.917 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-11T22:30:32.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-11T22:30:32.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-11T22:30:32.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-11T22:30:32.920 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-11T22:30:32.921 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-11T22:30:32.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-11T22:30:32.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-11T22:30:32.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-11T22:30:32.924 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-11T22:30:32.925 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-11T22:30:32.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-11T22:30:32.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-11T22:30:32.927 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-11T22:30:32.928 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-11T22:30:32.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-11T22:30:32.930 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-11T22:30:32.931 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-11T22:30:32.932 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-11T22:30:32.933 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-11T22:30:32.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-11T22:30:32.935 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-11T22:30:32.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-11T22:30:32.936 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-11T22:30:32.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-11T22:30:32.938 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-11T22:30:32.939 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-11T22:30:32.940 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-11T22:30:32.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-11T22:30:32.942 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-11T22:30:32.943 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-11T22:30:32.944 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-11T22:30:32.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-11T22:30:32.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-11T22:30:32.946 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-11T22:30:32.947 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-11T22:30:32.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-11T22:30:32.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-11T22:30:32.951 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-11T22:30:32.952 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-11T22:30:32.953 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-11T22:30:32.954 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-11T22:30:32.955 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-11T22:30:32.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-11T22:30:32.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-11T22:30:32.957 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-11T22:30:32.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-11T22:30:32.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-11T22:30:32.960 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-11T22:30:32.961 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-11T22:30:32.962 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-11T22:30:32.963 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-11T22:30:32.964 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-11T22:30:32.965 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-11T22:30:32.966 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-11T22:30:32.967 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-11T22:30:32.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-11T22:30:32.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-11T22:30:32.970 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-11T22:30:32.971 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-11T22:30:32.971 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-11T22:30:32.972 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-11T22:30:32.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-11T22:30:32.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-11T22:30:32.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-11T22:30:32.976 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-11T22:30:32.978 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-11T22:30:32.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-11T22:30:32.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-11T22:30:32.980 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-11T22:30:32.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-11T22:30:32.982 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-11T22:30:32.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-11T22:30:32.984 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-11T22:30:32.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/ 2024-09-11T22:30:32.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-11T22:30:32.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-11T22:30:32.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-11T22:30:32.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-11T22:30:32.989 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-11T22:30:32.990 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-11T22:30:32.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-11T22:30:32.992 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-11T22:30:32.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-11T22:30:32.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-11T22:30:32.994 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-11T22:30:32.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-11T22:30:32.996 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-11T22:30:32.997 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-11T22:30:32.998 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-11T22:30:32.999 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-11T22:30:33.000 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-11T22:30:33.001 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-11T22:30:33.002 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-11T22:30:33.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-11T22:30:33.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-11T22:30:33.004 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/ 2024-09-11T22:30:33.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-11T22:30:33.006 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-11T22:30:33.007 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-11T22:30:33.008 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-11T22:30:33.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-11T22:30:33.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-11T22:30:33.010 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-11T22:30:33.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-11T22:30:33.012 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-11T22:30:33.013 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-11T22:30:33.014 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-11T22:30:33.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-11T22:30:33.016 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-11T22:30:33.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-11T22:30:33.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-11T22:30:33.018 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-11T22:30:33.019 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-11T22:30:33.020 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-11T22:30:33.021 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-11T22:30:33.022 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-11T22:30:33.023 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-11T22:30:33.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-11T22:30:33.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-11T22:30:33.025 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-11T22:30:33.026 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-11T22:30:33.027 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-11T22:30:33.028 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-11T22:30:33.029 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-11T22:30:33.030 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-11T22:30:33.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-11T22:30:33.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-11T22:30:33.032 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-11T22:30:33.033 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-11T22:30:33.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-11T22:30:33.035 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-11T22:30:33.036 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-11T22:30:33.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-11T22:30:33.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-11T22:30:33.038 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-11T22:30:33.039 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-11T22:30:33.040 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-11T22:30:33.041 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-11T22:30:33.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-11T22:30:33.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-11T22:30:33.044 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-11T22:30:33.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-11T22:30:33.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-11T22:30:33.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-11T22:30:33.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-11T22:30:33.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-11T22:30:33.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-11T22:30:33.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-11T22:30:33.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-11T22:30:33.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-11T22:30:33.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-11T22:30:33.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-11T22:30:33.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-11T22:30:33.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-11T22:30:33.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-11T22:30:33.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-11T22:30:33.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-11T22:30:33.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-11T22:30:33.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-11T22:30:33.060 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-11T22:30:33.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-11T22:30:33.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-11T22:30:33.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-11T22:30:33.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-11T22:30:33.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-11T22:30:33.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-11T22:30:33.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-11T22:30:33.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-11T22:30:33.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-11T22:30:33.068 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-11T22:30:33.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-11T22:30:33.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-11T22:30:33.071 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-11T22:30:33.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-11T22:30:33.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-11T22:30:33.074 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-11T22:30:33.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-11T22:30:33.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-11T22:30:33.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-11T22:30:33.078 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-11T22:30:33.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-11T22:30:33.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-11T22:30:33.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-11T22:30:33.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-11T22:30:33.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-11T22:30:33.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-11T22:30:33.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-11T22:30:33.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-11T22:30:33.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-11T22:30:33.086 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-11T22:30:33.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-11T22:30:33.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-11T22:30:33.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-11T22:30:33.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-11T22:30:33.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-11T22:30:33.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-11T22:30:33.092 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-11T22:30:33.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-11T22:30:33.093 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-11T22:30:33.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-11T22:30:33.095 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-11T22:30:33.096 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-11T22:30:33.097 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-11T22:30:33.098 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-11T22:30:33.099 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-11T22:30:33.100 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-11T22:30:33.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-11T22:30:33.101 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-11T22:30:33.103 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-11T22:30:33.104 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-11T22:30:33.104 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-11T22:30:33.105 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-11T22:30:33.106 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-11T22:30:33.107 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-11T22:30:33.108 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-11T22:30:33.109 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-11T22:30:33.110 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-11T22:30:33.111 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-11T22:30:33.112 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-11T22:30:33.113 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-11T22:30:33.114 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-11T22:30:33.115 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-11T22:30:33.116 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-11T22:30:33.117 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-11T22:30:33.118 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-11T22:30:33.119 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-11T22:30:33.120 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-11T22:30:33.121 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-11T22:30:33.121 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-11T22:30:33.122 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-11T22:30:33.123 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-11T22:30:33.124 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-11T22:30:33.125 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-11T22:30:33.126 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-11T22:30:33.127 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-11T22:30:33.128 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-11T22:30:33.129 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-11T22:30:33.130 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-11T22:30:33.130 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-11T22:30:33.131 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-11T22:30:33.132 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-11T22:30:33.133 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-11T22:30:33.134 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-11T22:30:33.135 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-11T22:30:33.135 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-11T22:30:33.136 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-11T22:30:33.137 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-11T22:30:33.138 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-11T22:30:33.139 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-11T22:30:33.139 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-11T22:30:33.140 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-11T22:30:33.141 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-11T22:30:33.142 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-11T22:30:33.143 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-11T22:30:33.144 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-11T22:30:33.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-11T22:30:33.145 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-11T22:30:33.146 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-11T22:30:33.147 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-11T22:30:33.148 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-11T22:30:33.149 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-11T22:30:33.150 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-11T22:30:33.152 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-11T22:30:33.152 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-11T22:30:33.152 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-11T22:30:33.153 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-11T22:30:33.155 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-11T22:30:33.156 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-11T22:30:33.157 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-11T22:30:33.158 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-11T22:30:33.159 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-11T22:30:33.159 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-11T22:30:33.160 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-11T22:30:33.161 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-11T22:30:33.162 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-11T22:30:33.163 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-11T22:30:33.164 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-11T22:30:33.165 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-11T22:30:33.166 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-11T22:30:33.167 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-11T22:30:33.167 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-11T22:30:33.168 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-11T22:30:33.169 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-11T22:30:33.170 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-11T22:30:33.171 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-11T22:30:33.171 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-11T22:30:33.172 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-11T22:30:33.173 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-11T22:30:33.236 INFO:tasks.cephfs.filesystem:scrub status for tag:04334f3e-1d69-405f-9b36-4b08a9da4d6f - {'path': '/', 'tag': '04334f3e-1d69-405f-9b36-4b08a9da4d6f', 'options': 'recursive,force'} 2024-09-11T22:30:33.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-11T22:30:33.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-11T22:30:33.343 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-11T22:30:33.344 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-11T22:30:33.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-11T22:30:33.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-11T22:30:33.347 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-11T22:30:33.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ 2024-09-11T22:30:33.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-11T22:30:33.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-11T22:30:33.350 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-11T22:30:33.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-11T22:30:33.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-11T22:30:33.353 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-11T22:30:33.356 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-11T22:30:33.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-11T22:30:33.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-11T22:30:33.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-11T22:30:33.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-11T22:30:33.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-11T22:30:33.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-11T22:30:33.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/init.txt 2024-09-11T22:30:33.360 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-11T22:30:33.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/ 2024-09-11T22:30:33.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-11T22:30:33.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-11T22:30:33.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-11T22:30:33.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-11T22:30:33.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-11T22:30:33.366 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-11T22:30:33.367 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-11T22:30:33.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-11T22:30:33.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-11T22:30:33.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-11T22:30:33.370 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-11T22:30:33.371 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-11T22:30:33.372 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-11T22:30:33.373 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-11T22:30:33.374 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-11T22:30:33.375 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-11T22:30:33.375 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-11T22:30:33.377 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-11T22:30:33.377 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-11T22:30:33.378 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-11T22:30:33.379 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-11T22:30:33.380 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-11T22:30:33.381 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-11T22:30:33.382 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-11T22:30:33.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-11T22:30:33.384 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-11T22:30:33.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-11T22:30:33.386 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-11T22:30:33.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-11T22:30:33.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-11T22:30:33.388 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-11T22:30:33.389 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-11T22:30:33.390 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-11T22:30:33.391 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-11T22:30:33.391 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-11T22:30:33.392 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-11T22:30:33.393 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-11T22:30:33.394 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-11T22:30:33.394 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-11T22:30:33.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-11T22:30:33.396 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-11T22:30:33.397 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-11T22:30:33.398 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-11T22:30:33.399 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-11T22:30:33.400 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-11T22:30:33.400 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-11T22:30:33.402 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-11T22:30:33.403 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-11T22:30:33.403 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-11T22:30:33.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-11T22:30:33.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-11T22:30:33.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-11T22:30:33.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-11T22:30:33.407 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-11T22:30:33.408 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-11T22:30:33.409 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-11T22:30:33.410 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-11T22:30:33.411 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-11T22:30:33.411 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-11T22:30:33.412 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-11T22:30:33.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-11T22:30:33.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-11T22:30:33.414 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-11T22:30:33.415 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-11T22:30:33.416 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-11T22:30:33.417 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-11T22:30:33.418 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-11T22:30:33.419 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-11T22:30:33.419 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-11T22:30:33.420 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-11T22:30:33.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-11T22:30:33.422 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-11T22:30:33.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-11T22:30:33.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-11T22:30:33.424 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-11T22:30:33.425 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-11T22:30:33.426 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/java.txt 2024-09-11T22:30:33.427 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-11T22:30:33.427 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-11T22:30:33.428 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-11T22:30:33.429 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-11T22:30:33.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-11T22:30:33.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-11T22:30:33.431 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-11T22:30:33.432 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-11T22:30:33.433 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-11T22:30:33.434 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-11T22:30:33.435 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-11T22:30:33.436 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-11T22:30:33.437 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-11T22:30:33.438 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-11T22:30:33.439 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-11T22:30:33.441 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-11T22:30:33.441 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-11T22:30:33.442 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-11T22:30:33.443 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-11T22:30:33.444 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-11T22:30:33.445 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-11T22:30:33.445 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-11T22:30:33.447 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-11T22:30:33.448 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-11T22:30:33.449 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-11T22:30:33.449 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-11T22:30:33.450 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-11T22:30:33.451 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-11T22:30:33.452 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-11T22:30:33.454 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-11T22:30:33.454 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-11T22:30:33.454 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-11T22:30:33.455 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-11T22:30:33.456 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-11T22:30:33.457 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-11T22:30:33.458 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-11T22:30:33.459 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-11T22:30:33.460 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-11T22:30:33.460 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-11T22:30:33.461 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/ 2024-09-11T22:30:33.462 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-11T22:30:33.463 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-11T22:30:33.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-11T22:30:33.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-11T22:30:33.465 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-11T22:30:33.466 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-11T22:30:33.467 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-11T22:30:33.467 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-11T22:30:33.468 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-11T22:30:33.469 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-11T22:30:33.470 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-11T22:30:33.471 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-11T22:30:33.472 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/ 2024-09-11T22:30:33.473 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-11T22:30:33.474 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-11T22:30:33.474 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-11T22:30:33.475 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-11T22:30:33.476 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-11T22:30:33.476 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-11T22:30:33.477 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-11T22:30:33.478 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-11T22:30:33.479 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-11T22:30:33.479 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-11T22:30:33.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-11T22:30:33.481 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-11T22:30:33.482 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-11T22:30:33.483 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-11T22:30:33.484 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-11T22:30:33.485 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-11T22:30:33.485 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-11T22:30:33.486 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-11T22:30:33.487 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-11T22:30:33.488 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-11T22:30:33.489 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/md.txt 2024-09-11T22:30:33.490 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-11T22:30:33.491 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-11T22:30:33.569 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-11T22:30:33.570 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-11T22:30:33.572 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-11T22:30:33.573 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/metag/ 2024-09-11T22:30:33.574 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-11T22:30:33.575 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-11T22:30:33.577 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/ 2024-09-11T22:30:33.578 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-11T22:30:33.579 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-11T22:30:33.580 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-11T22:30:33.582 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-11T22:30:33.583 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-11T22:30:33.584 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-11T22:30:33.586 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-11T22:30:33.587 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-11T22:30:33.588 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-11T22:30:33.590 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-11T22:30:33.591 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mips/ 2024-09-11T22:30:33.592 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-11T22:30:33.594 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-11T22:30:33.595 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-11T22:30:33.596 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-11T22:30:33.598 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-11T22:30:33.599 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-11T22:30:33.601 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-11T22:30:33.602 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-11T22:30:33.603 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-11T22:30:33.604 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-11T22:30:33.606 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-11T22:30:33.607 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-11T22:30:33.608 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-11T22:30:33.609 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-11T22:30:33.609 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-11T22:30:33.610 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-11T22:30:33.611 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-11T22:30:33.612 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-11T22:30:33.612 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-11T22:30:33.613 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-11T22:30:33.614 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-11T22:30:33.615 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-11T22:30:33.616 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-11T22:30:33.617 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-11T22:30:33.617 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-11T22:30:33.618 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-11T22:30:33.619 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-11T22:30:33.620 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-11T22:30:33.621 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-11T22:30:33.622 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-11T22:30:33.623 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-11T22:30:33.624 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-11T22:30:33.625 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-11T22:30:33.625 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-11T22:30:33.626 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-11T22:30:33.627 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-11T22:30:33.628 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-11T22:30:33.629 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-11T22:30:33.629 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-11T22:30:33.630 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-11T22:30:33.631 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-11T22:30:33.632 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-11T22:30:33.632 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-11T22:30:33.634 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-11T22:30:33.635 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-11T22:30:33.636 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ 2024-09-11T22:30:33.636 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-11T22:30:33.637 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-11T22:30:33.638 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-11T22:30:33.640 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-11T22:30:33.641 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-11T22:30:33.642 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-11T22:30:33.642 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-11T22:30:33.643 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-11T22:30:33.644 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-11T22:30:33.645 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-11T22:30:33.646 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-11T22:30:33.647 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-11T22:30:33.648 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-11T22:30:33.649 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-11T22:30:33.650 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-11T22:30:33.651 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-11T22:30:33.652 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-11T22:30:33.653 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-11T22:30:33.654 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-11T22:30:33.654 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-11T22:30:33.656 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-11T22:30:33.656 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-11T22:30:33.657 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-11T22:30:33.658 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-11T22:30:33.659 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-11T22:30:33.660 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-11T22:30:33.661 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-11T22:30:33.662 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-11T22:30:33.663 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-11T22:30:33.664 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-11T22:30:33.665 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-11T22:30:33.666 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-11T22:30:33.666 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-11T22:30:33.668 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-11T22:30:33.669 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-11T22:30:33.669 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-11T22:30:33.670 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-11T22:30:33.671 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-11T22:30:33.672 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-11T22:30:33.673 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-11T22:30:33.674 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-11T22:30:33.674 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-11T22:30:33.676 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-11T22:30:33.677 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-11T22:30:33.678 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-11T22:30:33.679 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-11T22:30:33.679 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-11T22:30:33.680 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-11T22:30:33.681 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-11T22:30:33.682 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-11T22:30:33.683 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-11T22:30:33.683 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-11T22:30:33.684 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-11T22:30:33.685 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-11T22:30:33.686 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-11T22:30:33.686 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-11T22:30:33.687 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-11T22:30:33.688 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-11T22:30:33.689 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-11T22:30:33.689 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-11T22:30:33.690 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-11T22:30:33.691 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-11T22:30:33.692 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-11T22:30:33.693 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-11T22:30:33.694 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-11T22:30:33.695 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-11T22:30:33.696 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-11T22:30:33.697 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-11T22:30:33.698 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-11T22:30:33.698 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-11T22:30:33.699 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-11T22:30:33.700 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-11T22:30:33.701 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-11T22:30:33.702 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-11T22:30:33.702 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-11T22:30:33.703 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-11T22:30:33.704 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-11T22:30:33.706 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-11T22:30:33.707 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-11T22:30:33.708 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-11T22:30:33.710 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-11T22:30:33.711 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-11T22:30:33.713 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-11T22:30:33.714 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-11T22:30:33.716 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-11T22:30:33.717 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-11T22:30:33.718 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-11T22:30:33.720 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-11T22:30:33.721 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-11T22:30:33.722 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-11T22:30:33.724 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-11T22:30:33.725 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-11T22:30:33.726 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-11T22:30:33.728 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-11T22:30:33.729 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-11T22:30:33.730 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-11T22:30:33.732 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-11T22:30:33.733 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-11T22:30:33.734 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-11T22:30:33.736 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-11T22:30:33.737 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-11T22:30:33.738 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-11T22:30:33.740 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-11T22:30:33.741 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-11T22:30:33.743 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-11T22:30:33.744 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-11T22:30:33.745 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-11T22:30:33.747 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-11T22:30:33.748 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-11T22:30:33.748 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-11T22:30:33.749 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-11T22:30:33.750 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-11T22:30:33.751 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-11T22:30:33.752 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-11T22:30:33.753 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-11T22:30:33.753 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-11T22:30:33.754 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-11T22:30:33.755 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-11T22:30:33.756 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-11T22:30:33.757 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-11T22:30:33.758 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-11T22:30:33.759 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-11T22:30:33.760 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-11T22:30:33.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-11T22:30:33.761 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-11T22:30:33.763 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-11T22:30:33.763 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-11T22:30:33.764 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-11T22:30:33.765 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-11T22:30:33.766 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-11T22:30:33.767 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-11T22:30:33.768 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-11T22:30:33.769 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-11T22:30:33.770 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-11T22:30:33.771 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-11T22:30:33.772 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-11T22:30:33.773 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-11T22:30:33.774 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-11T22:30:33.775 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-11T22:30:33.776 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-11T22:30:33.777 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-11T22:30:33.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-11T22:30:33.778 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-11T22:30:33.780 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-11T22:30:33.781 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-11T22:30:33.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-11T22:30:33.782 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-11T22:30:33.783 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-11T22:30:33.784 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-11T22:30:33.785 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-11T22:30:33.786 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-11T22:30:33.786 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-11T22:30:33.787 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-11T22:30:33.788 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-11T22:30:33.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-11T22:30:33.789 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-11T22:30:33.790 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-11T22:30:33.791 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-11T22:30:33.792 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-11T22:30:33.793 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-11T22:30:33.794 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/phy/ 2024-09-11T22:30:33.795 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-11T22:30:33.796 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-11T22:30:33.798 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-11T22:30:33.799 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/platform/ 2024-09-11T22:30:33.800 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-11T22:30:33.801 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-11T22:30:33.802 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/ 2024-09-11T22:30:33.803 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-11T22:30:33.805 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-11T22:30:33.806 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-11T22:30:33.807 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-11T22:30:33.808 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-11T22:30:33.809 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-11T22:30:33.810 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-11T22:30:33.811 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-11T22:30:33.812 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-11T22:30:33.813 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-11T22:30:33.814 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-11T22:30:33.815 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-11T22:30:33.816 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-11T22:30:33.817 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-11T22:30:33.818 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-11T22:30:33.819 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-11T22:30:33.820 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-11T22:30:33.821 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-11T22:30:33.822 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-11T22:30:33.823 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-11T22:30:33.824 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-11T22:30:33.826 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-11T22:30:33.827 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-11T22:30:33.828 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-11T22:30:33.829 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-11T22:30:33.831 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-11T22:30:33.832 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-11T22:30:33.833 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-11T22:30:33.834 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-11T22:30:33.836 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-11T22:30:33.837 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-11T22:30:33.838 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-11T22:30:33.839 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-11T22:30:33.840 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-11T22:30:33.841 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-11T22:30:33.843 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-11T22:30:33.848 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-11T22:30:33.849 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-11T22:30:33.851 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-11T22:30:33.852 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-11T22:30:33.853 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-11T22:30:33.854 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-11T22:30:33.855 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-11T22:30:33.857 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-11T22:30:33.858 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-11T22:30:33.859 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-11T22:30:33.860 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pps/ 2024-09-11T22:30:33.861 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-11T22:30:33.862 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-11T22:30:33.864 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-11T22:30:33.865 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-11T22:30:33.866 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-11T22:30:33.867 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-11T22:30:33.869 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-11T22:30:33.870 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-11T22:30:33.871 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-11T22:30:33.872 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-11T22:30:33.873 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-11T22:30:33.875 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pti/ 2024-09-11T22:30:33.876 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-11T22:30:33.877 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-11T22:30:33.878 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-11T22:30:33.880 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-11T22:30:33.881 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-11T22:30:33.882 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-11T22:30:33.883 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-11T22:30:33.885 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-11T22:30:33.886 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-11T22:30:33.887 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-11T22:30:33.889 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-11T22:30:33.890 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-11T22:30:33.891 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-11T22:30:33.892 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-11T22:30:33.894 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-11T22:30:33.895 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-11T22:30:33.896 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-11T22:30:33.898 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-11T22:30:33.899 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-11T22:30:33.901 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-11T22:30:33.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:33 smithi022 ceph-mon[30966]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:33.902 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/ 2024-09-11T22:30:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:33 smithi169 ceph-mon[35628]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:33.903 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-11T22:30:33.905 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-11T22:30:33.906 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-11T22:30:33.907 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-11T22:30:33.908 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-11T22:30:33.910 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-11T22:30:33.911 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-11T22:30:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:33 smithi045 ceph-mon[35556]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-11T22:30:33.912 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-11T22:30:33.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-11T22:30:33.914 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-11T22:30:33.916 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-11T22:30:33.917 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-11T22:30:33.918 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-11T22:30:33.919 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-11T22:30:33.921 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-11T22:30:33.922 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-11T22:30:33.923 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-11T22:30:33.924 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-11T22:30:33.926 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-11T22:30:33.927 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-11T22:30:33.928 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-11T22:30:33.929 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-11T22:30:33.931 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-11T22:30:33.932 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-11T22:30:33.933 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-11T22:30:33.934 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-11T22:30:33.935 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-11T22:30:33.937 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-11T22:30:33.938 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-11T22:30:33.939 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-11T22:30:33.940 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-11T22:30:33.941 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-11T22:30:33.942 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-11T22:30:33.943 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-11T22:30:33.944 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-11T22:30:33.945 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-11T22:30:33.947 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-11T22:30:33.948 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-11T22:30:33.949 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-11T22:30:33.950 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-11T22:30:33.951 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-11T22:30:33.952 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-11T22:30:33.953 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-11T22:30:33.954 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-11T22:30:33.956 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-11T22:30:33.957 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-11T22:30:33.958 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-11T22:30:33.959 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-11T22:30:33.960 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-11T22:30:33.961 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-11T22:30:33.962 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-11T22:30:33.963 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-11T22:30:33.964 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-11T22:30:33.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-11T22:30:33.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-11T22:30:33.968 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-11T22:30:33.969 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-11T22:30:33.970 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-11T22:30:33.972 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-11T22:30:33.973 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-11T22:30:33.974 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-11T22:30:33.975 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-11T22:30:33.977 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-11T22:30:33.978 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-11T22:30:33.979 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-11T22:30:33.980 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-11T22:30:33.981 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-11T22:30:33.983 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-11T22:30:33.984 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-11T22:30:33.985 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-11T22:30:33.986 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-11T22:30:33.988 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-11T22:30:33.989 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-11T22:30:33.990 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-11T22:30:33.991 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-11T22:30:33.993 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-11T22:30:33.994 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-11T22:30:33.995 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-11T22:30:33.996 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-11T22:30:33.997 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-11T22:30:33.999 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-11T22:30:34.000 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-11T22:30:34.001 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-11T22:30:34.003 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-11T22:30:34.004 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-11T22:30:34.005 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/ 2024-09-11T22:30:34.006 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-11T22:30:34.007 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-11T22:30:34.009 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-11T22:30:34.010 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-11T22:30:34.011 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-11T22:30:34.013 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-11T22:30:34.014 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-11T22:30:34.015 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-11T22:30:34.016 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-11T22:30:34.017 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-11T22:30:34.019 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-11T22:30:34.020 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-11T22:30:34.021 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-11T22:30:34.022 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-11T22:30:34.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/ 2024-09-11T22:30:34.024 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-11T22:30:34.026 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-11T22:30:34.027 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-11T22:30:34.028 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-11T22:30:34.029 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-11T22:30:34.031 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-11T22:30:34.032 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-11T22:30:34.033 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-11T22:30:34.034 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-11T22:30:34.036 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sh/ 2024-09-11T22:30:34.037 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-11T22:30:34.038 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-11T22:30:34.039 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-11T22:30:34.040 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/ 2024-09-11T22:30:34.041 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-11T22:30:34.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-11T22:30:34.042 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-11T22:30:34.043 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-11T22:30:34.044 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-11T22:30:34.045 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-11T22:30:34.046 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-11T22:30:34.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-11T22:30:34.047 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-11T22:30:34.048 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-11T22:30:34.049 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-11T22:30:34.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-11T22:30:34.050 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-11T22:30:34.051 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-11T22:30:34.052 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-11T22:30:34.053 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-11T22:30:34.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-11T22:30:34.054 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-11T22:30:34.055 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-11T22:30:34.056 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-11T22:30:34.057 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-11T22:30:34.058 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-11T22:30:34.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-11T22:30:34.059 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-11T22:30:34.060 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-11T22:30:34.061 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-11T22:30:34.062 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-11T22:30:34.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-11T22:30:34.063 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-11T22:30:34.064 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-11T22:30:34.065 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-11T22:30:34.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-11T22:30:34.066 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-11T22:30:34.067 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-11T22:30:34.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-11T22:30:34.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-11T22:30:34.069 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-11T22:30:34.070 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-11T22:30:34.071 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-11T22:30:34.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-11T22:30:34.072 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-11T22:30:34.073 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-11T22:30:34.074 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-11T22:30:34.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-11T22:30:34.075 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-11T22:30:34.076 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-11T22:30:34.077 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-11T22:30:34.078 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-11T22:30:34.079 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-11T22:30:34.080 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-11T22:30:34.081 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-11T22:30:34.082 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-11T22:30:34.083 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-11T22:30:34.084 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-11T22:30:34.085 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-11T22:30:34.087 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-11T22:30:34.088 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-11T22:30:34.089 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-11T22:30:34.090 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-11T22:30:34.091 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-11T22:30:34.092 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-11T22:30:34.094 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-11T22:30:34.095 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-11T22:30:34.202 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/ 2024-09-11T22:30:34.203 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-11T22:30:34.204 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-11T22:30:34.205 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-11T22:30:34.206 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-11T22:30:34.207 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-11T22:30:34.207 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-11T22:30:34.208 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-11T22:30:34.209 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-11T22:30:34.210 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-11T22:30:34.211 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-11T22:30:34.211 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-11T22:30:34.212 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-11T22:30:34.213 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-11T22:30:34.214 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-11T22:30:34.215 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-11T22:30:34.216 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-11T22:30:34.217 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-11T22:30:34.218 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-11T22:30:34.219 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-11T22:30:34.220 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-11T22:30:34.221 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-11T22:30:34.221 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-11T22:30:34.222 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-11T22:30:34.223 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-11T22:30:34.224 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-11T22:30:34.225 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-11T22:30:34.226 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-11T22:30:34.227 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/target/ 2024-09-11T22:30:34.228 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-11T22:30:34.229 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-11T22:30:34.230 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-11T22:30:34.231 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-11T22:30:34.232 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-11T22:30:34.233 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-11T22:30:34.233 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-11T22:30:34.234 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-11T22:30:34.235 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-11T22:30:34.236 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-11T22:30:34.236 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-11T22:30:34.237 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-11T22:30:34.238 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/ 2024-09-11T22:30:34.239 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-11T22:30:34.239 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-11T22:30:34.240 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-11T22:30:34.241 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-11T22:30:34.242 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-11T22:30:34.242 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-11T22:30:34.243 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-11T22:30:34.244 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-11T22:30:34.245 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-11T22:30:34.246 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-11T22:30:34.247 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-11T22:30:34.248 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-11T22:30:34.248 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-11T22:30:34.249 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/ 2024-09-11T22:30:34.250 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-11T22:30:34.251 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-11T22:30:34.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-11T22:30:34.252 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-11T22:30:34.253 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-11T22:30:34.254 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-11T22:30:34.255 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-11T22:30:34.256 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-11T22:30:34.257 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-11T22:30:34.258 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-11T22:30:34.258 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-11T22:30:34.259 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-11T22:30:34.260 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-11T22:30:34.261 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-11T22:30:34.262 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-11T22:30:34.264 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-11T22:30:34.264 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-11T22:30:34.265 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-11T22:30:34.266 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-11T22:30:34.267 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-11T22:30:34.268 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/ 2024-09-11T22:30:34.269 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-11T22:30:34.269 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-11T22:30:34.270 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-11T22:30:34.271 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-11T22:30:34.272 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-11T22:30:34.272 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-11T22:30:34.273 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-11T22:30:34.275 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-11T22:30:34.276 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-11T22:30:34.276 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-11T22:30:34.277 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-11T22:30:34.278 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-11T22:30:34.279 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-11T22:30:34.280 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-11T22:30:34.281 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-11T22:30:34.282 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-11T22:30:34.283 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-11T22:30:34.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-11T22:30:34.284 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-11T22:30:34.285 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-11T22:30:34.286 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-11T22:30:34.287 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-11T22:30:34.288 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-11T22:30:34.289 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-11T22:30:34.290 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-11T22:30:34.291 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-11T22:30:34.292 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-11T22:30:34.293 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-11T22:30:34.294 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-11T22:30:34.295 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-11T22:30:34.296 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-11T22:30:34.297 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-11T22:30:34.298 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-11T22:30:34.299 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-11T22:30:34.300 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-11T22:30:34.301 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-11T22:30:34.302 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-11T22:30:34.303 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-11T22:30:34.304 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-11T22:30:34.305 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-11T22:30:34.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-11T22:30:34.306 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-11T22:30:34.307 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-11T22:30:34.308 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-11T22:30:34.309 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-11T22:30:34.310 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-11T22:30:34.311 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-11T22:30:34.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-11T22:30:34.312 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-11T22:30:34.313 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-11T22:30:34.314 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-11T22:30:34.315 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-11T22:30:34.316 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-11T22:30:34.317 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-11T22:30:34.318 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-11T22:30:34.319 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-11T22:30:34.320 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-11T22:30:34.321 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-11T22:30:34.323 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-11T22:30:34.324 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-11T22:30:34.325 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-11T22:30:34.326 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-11T22:30:34.326 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-11T22:30:34.328 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-11T22:30:34.329 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-11T22:30:34.330 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-11T22:30:34.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-11T22:30:34.331 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-11T22:30:34.332 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-11T22:30:34.333 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-11T22:30:34.334 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-11T22:30:34.334 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-11T22:30:34.335 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-11T22:30:34.336 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-11T22:30:34.337 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-11T22:30:34.339 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-11T22:30:34.340 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-11T22:30:34.341 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-11T22:30:34.341 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-11T22:30:34.342 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-11T22:30:34.343 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-11T22:30:34.344 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-11T22:30:34.345 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-11T22:30:34.346 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-11T22:30:34.347 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-11T22:30:34.348 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-11T22:30:34.349 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-11T22:30:34.350 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-11T22:30:34.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-11T22:30:34.351 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-11T22:30:34.352 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-11T22:30:34.353 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-11T22:30:34.354 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-11T22:30:34.355 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-11T22:30:34.356 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-11T22:30:34.357 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-11T22:30:34.358 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-11T22:30:34.359 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-11T22:30:34.360 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-11T22:30:34.360 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-11T22:30:34.361 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-11T22:30:34.362 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-11T22:30:34.363 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-11T22:30:34.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-11T22:30:34.364 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-11T22:30:34.365 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-11T22:30:34.367 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-11T22:30:34.368 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-11T22:30:34.369 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-11T22:30:34.370 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-11T22:30:34.370 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-11T22:30:34.372 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-11T22:30:34.373 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-11T22:30:34.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-11T22:30:34.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-11T22:30:34.376 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-11T22:30:34.377 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-11T22:30:34.378 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-11T22:30:34.379 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-11T22:30:34.380 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-11T22:30:34.381 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-11T22:30:34.382 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-11T22:30:34.382 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-11T22:30:34.383 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-11T22:30:34.384 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-11T22:30:34.385 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-11T22:30:34.386 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-11T22:30:34.386 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-11T22:30:34.387 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-11T22:30:34.389 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-11T22:30:34.390 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-11T22:30:34.391 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-11T22:30:34.392 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-11T22:30:34.393 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-11T22:30:34.394 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-11T22:30:34.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-11T22:30:34.395 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-11T22:30:34.397 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-11T22:30:34.398 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-11T22:30:34.399 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-11T22:30:34.400 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-11T22:30:34.401 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-11T22:30:34.402 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-11T22:30:34.403 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-11T22:30:34.404 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-11T22:30:34.405 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-11T22:30:34.406 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-11T22:30:34.407 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-11T22:30:34.408 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-11T22:30:34.408 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-11T22:30:34.410 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/ 2024-09-11T22:30:34.411 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-11T22:30:34.412 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-11T22:30:34.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-11T22:30:34.413 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-11T22:30:34.415 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-11T22:30:34.416 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-11T22:30:34.417 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-11T22:30:34.418 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-11T22:30:34.418 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-11T22:30:34.419 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-11T22:30:34.420 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-11T22:30:34.421 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-11T22:30:34.422 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-11T22:30:34.423 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-11T22:30:34.424 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-11T22:30:34.424 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-11T22:30:34.425 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-11T22:30:34.426 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-11T22:30:34.427 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-11T22:30:34.428 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-11T22:30:34.429 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-11T22:30:34.429 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-11T22:30:34.430 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-11T22:30:34.431 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-11T22:30:34.433 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-11T22:30:34.434 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/ 2024-09-11T22:30:34.435 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-11T22:30:34.436 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-11T22:30:34.437 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-11T22:30:34.437 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-11T22:30:34.438 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-11T22:30:34.439 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-11T22:30:34.440 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-11T22:30:34.441 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-11T22:30:34.442 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-11T22:30:34.442 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-11T22:30:34.443 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-11T22:30:34.444 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-11T22:30:34.445 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-11T22:30:34.445 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-11T22:30:34.447 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-11T22:30:34.447 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-11T22:30:34.448 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-11T22:30:34.449 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-11T22:30:34.450 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-11T22:30:34.451 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-11T22:30:34.452 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-11T22:30:34.452 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-11T22:30:34.453 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-11T22:30:34.454 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-11T22:30:34.455 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-11T22:30:34.456 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-11T22:30:34.456 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-11T22:30:34.457 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-11T22:30:34.458 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-11T22:30:34.459 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-11T22:30:34.461 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-11T22:30:34.461 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-11T22:30:34.462 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-11T22:30:34.463 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-11T22:30:34.464 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/ 2024-09-11T22:30:34.465 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-11T22:30:34.466 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-11T22:30:34.467 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-11T22:30:34.468 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-11T22:30:34.469 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-11T22:30:34.470 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-11T22:30:34.471 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-11T22:30:34.471 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-11T22:30:34.472 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-11T22:30:34.474 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-11T22:30:34.474 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-11T22:30:34.475 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-11T22:30:34.476 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-11T22:30:34.477 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-11T22:30:34.478 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-11T22:30:34.479 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-11T22:30:34.479 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-11T22:30:34.480 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-11T22:30:34.481 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-11T22:30:34.482 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-11T22:30:34.483 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-11T22:30:34.484 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-11T22:30:34.485 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-11T22:30:34.487 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-11T22:30:34.488 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-11T22:30:34.489 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-11T22:30:34.490 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-11T22:30:34.490 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-11T22:30:34.491 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-11T22:30:34.492 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-11T22:30:34.493 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-11T22:30:34.494 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-11T22:30:34.494 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-11T22:30:34.495 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-11T22:30:34.496 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-11T22:30:34.497 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-11T22:30:34.498 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-11T22:30:34.498 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-11T22:30:34.499 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-11T22:30:34.500 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-11T22:30:34.501 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-11T22:30:34.502 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-11T22:30:34.504 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-11T22:30:34.506 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-11T22:30:34.507 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-11T22:30:34.510 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-11T22:30:34.512 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-11T22:30:34.513 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-11T22:30:34.514 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-11T22:30:34.516 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-11T22:30:34.517 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-11T22:30:34.518 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-11T22:30:34.520 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-11T22:30:34.521 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-11T22:30:34.523 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-11T22:30:34.524 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-11T22:30:34.525 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-11T22:30:34.527 INFO:tasks.workunit.client.0.smithi022.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-11T22:30:34.863 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:34 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:30:34.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:34 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:30:34.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:34 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:30:35.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:35 smithi022 ceph-mon[30966]: pgmap v49: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 237 op/s 2024-09-11T22:30:35.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:35 smithi022 ceph-mon[30966]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-11T22:30:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:35 smithi169 ceph-mon[35628]: pgmap v49: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 237 op/s 2024-09-11T22:30:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:35 smithi169 ceph-mon[35628]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-11T22:30:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:35 smithi045 ceph-mon[35556]: pgmap v49: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 237 op/s 2024-09-11T22:30:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:35 smithi045 ceph-mon[35556]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-11T22:30:37.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:37 smithi022 ceph-mon[30966]: pgmap v50: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 236 op/s 2024-09-11T22:30:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:37 smithi169 ceph-mon[35628]: pgmap v50: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 236 op/s 2024-09-11T22:30:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:37 smithi045 ceph-mon[35556]: pgmap v50: 97 pgs: 97 active+clean; 90 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 7.5 MiB/s wr, 236 op/s 2024-09-11T22:30:39.445 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-11T22:30:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:39 smithi022 ceph-mon[30966]: pgmap v51: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 7.7 MiB/s wr, 243 op/s 2024-09-11T22:30:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:39 smithi169 ceph-mon[35628]: pgmap v51: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 7.7 MiB/s wr, 243 op/s 2024-09-11T22:30:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:39 smithi045 ceph-mon[35556]: pgmap v51: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 7.7 MiB/s wr, 243 op/s 2024-09-11T22:30:40.448 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar xf doc.tar 2024-09-11T22:30:41.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:41 smithi022 ceph-mon[30966]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:41 smithi169 ceph-mon[35628]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:41.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:41 smithi045 ceph-mon[35556]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:43 smithi022 ceph-mon[30966]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:43.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:43 smithi169 ceph-mon[35628]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:43 smithi045 ceph-mon[35556]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 7.7 MiB/s wr, 241 op/s 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 -- 172.21.15.22:0/3340764936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f810c0f0 msgr2=0x7fa7f810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 --2- 172.21.15.22:0/3340764936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f810c0f0 0x7fa7f810e590 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009ca0 tx=0x7fa7f002a950 comp rx=0 tx=0).stop 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 -- 172.21.15.22:0/3340764936 shutdown_connections 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 --2- 172.21.15.22:0/3340764936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f810c0f0 0x7fa7f810e590 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 --2- 172.21.15.22:0/3340764936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8103640 0x7fa7f810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 --2- 172.21.15.22:0/3340764936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f8102d20 0x7fa7f8103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 -- 172.21.15.22:0/3340764936 >> 172.21.15.22:0/3340764936 conn(0x7fa7f80fc6b0 msgr2=0x7fa7f80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 -- 172.21.15.22:0/3340764936 shutdown_connections 2024-09-11T22:30:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.665+0000 7fa7fc976640 1 -- 172.21.15.22:0/3340764936 wait complete. 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 Processor -- start 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 -- start start 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 0x7fa7f81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f810c0f0 0x7fa7f819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8112010 con 0x7fa7f8103640 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8111e90 con 0x7fa7f810c0f0 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7fc976640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8112190 con 0x7fa7f8102d20 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57018/0 (socket says 172.21.15.22:57018) 2024-09-11T22:30:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 -- 172.21.15.22:0/2814315173 learned_addr learned my addr 172.21.15.22:0/2814315173 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f810c0f0 0x7fa7f819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7f659c640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 0x7fa7f81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 -- 172.21.15.22:0/2814315173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 msgr2=0x7fa7f81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 0x7fa7f81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 -- 172.21.15.22:0/2814315173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f810c0f0 msgr2=0x7fa7f819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f810c0f0 0x7fa7f819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7effff640 1 -- 172.21.15.22:0/2814315173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f819d3d0 con 0x7fa7f8103640 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.666+0000 7fa7f659c640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 0x7fa7f81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7effff640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000e9f0 tx=0x7fa7e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7ef7fe640 1 -- 172.21.15.22:0/2814315173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000cd80 con 0x7fa7f8103640 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7ef7fe640 1 -- 172.21.15.22:0/2814315173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7e0005520 con 0x7fa7f8103640 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f819d6c0 con 0x7fa7f8103640 2024-09-11T22:30:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7ef7fe640 1 -- 172.21.15.22:0/2814315173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0010690 con 0x7fa7f8103640 2024-09-11T22:30:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.667+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81a4f50 con 0x7fa7f8103640 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.669+0000 7fa7ef7fe640 1 -- 172.21.15.22:0/2814315173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa7e00046c0 con 0x7fa7f8103640 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 Processor -- start 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 -- start start 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca3e0172f0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ca3dfbf270 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ca3e0132b0 con 0x55ca3e0b3410 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57022/0 (socket says 172.21.15.22:57022) 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/3650135296 learned_addr learned my addr 172.21.15.22:0/3650135296 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7f659c640 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.670+0000 7fa7ef7fe640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 0x7fa7e40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/3650135296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b3410 msgr2=0x55ca3e0bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/3650135296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 msgr2=0x55ca3e0c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/3650135296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3dfbe340 con 0x55ca3e0b2af0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7effff640 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7ef7fe640 1 -- 172.21.15.22:0/2814315173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7e00cf810 con 0x7fa7f8103640 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 0x7fa7e40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0030040 tx=0x7fa7f00098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c13c7e03d150e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7ecff9640 1 -- 172.21.15.22:0/3650135296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0034040 con 0x55ca3e0b2af0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7ecff9640 1 -- 172.21.15.22:0/3650135296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7f0003e40 con 0x55ca3e0b2af0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.671+0000 7fa7ecff9640 1 -- 172.21.15.22:0/3650135296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0046750 con 0x55ca3e0b2af0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3650135296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 msgr2=0x55ca3e0b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0030040 tx=0x7fa7f00098d0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 0x7fa7e40a52e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7f004b000 tx=0x7fa7f0048000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3650135296 shutdown_connections 2024-09-11T22:30:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3650135296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b2ed0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3650135296 >> 172.21.15.22:0/3650135296 conn(0x55ca3e0af060 msgr2=0x55ca3e0af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3650135296 shutdown_connections 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3650135296 wait complete. 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 -- start start 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.672+0000 7fa7ff7ed740 1 Processor -- start 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca3e0c0880 con 0x55ca3e0b3410 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ca3dfa0290 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ca3e0c0a00 con 0x55ca3e0b2af0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ff7ed740 10 client.0 _ll_register_callbacks cb 0x55ca3dfd1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57032/0 (socket says 172.21.15.22:57032) 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7effff640 1 -- 172.21.15.22:0/2791423422 learned_addr learned my addr 172.21.15.22:0/2791423422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f659c640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/2791423422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 msgr2=0x55ca3e0bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0bab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/2791423422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 msgr2=0x55ca3e0bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/2791423422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3dd2a210 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009ca0 tx=0x7fa7f0046470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e962ea009459a72d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.673+0000 7fa7ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0055040 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca3e024a20 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7f0046a00 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa7f002fe90 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 10 client.25325 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ca3ddf6620 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55ca3e024a20 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa7f0030440 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 10 client.25325 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 10 client.25325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 20 client.25325 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e0cda60 0x55ca3e0cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 4 client.25325 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca3e01ed70 con 0x55ca3e0cda60 2024-09-11T22:30:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.674+0000 7fa7f659c640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e0cda60 0x55ca3e0cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.675+0000 7fa7f659c640 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e0cda60 0x55ca3e0cfe50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b4ce39d9cdaabe server_cookie=50e7ffe51b0380c8 in_seq=0 out_seq=0 2024-09-11T22:30:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.675+0000 7fa7ddffb640 10 client.25325 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ddffb640 1 -- 172.21.15.22:0/2791423422 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca3e01ed70 con 0x55ca3e0cda60 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ddffb640 10 client.25325 handle_command_reply: tid=0 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 client.25325 shutdown 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 msgr2=0x55ca3e0bb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009ca0 tx=0x7fa7f0046470 comp rx=0 tx=0).stop 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 shutdown_connections 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e0cda60 0x55ca3e0cfe50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb5f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ddffb640 0 client.25325 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b3410 0x55ca3e0bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/2791423422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0bab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 >> 172.21.15.22:0/2791423422 conn(0x55ca3e0af060 msgr2=0x55ca3e0ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 shutdown_connections 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/2791423422 wait complete. 2024-09-11T22:30:44.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.678+0000 7fa7ff7ed740 20 client.25325 trim_cache size 0 max 16384 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 Processor -- start 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 -- start start 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81ab7b0 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.695 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81adfe0 con 0x55ca3e0b3410 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81abe20 con 0x55ca3e0b2af0 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57034/0 (socket says 172.21.15.22:57034) 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/1924695617 learned_addr learned my addr 172.21.15.22:0/1924695617 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/1924695617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 msgr2=0x55ca3e0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/1924695617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 msgr2=0x55ca3e0b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 -- 172.21.15.22:0/1924695617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3e0afcf0 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.694+0000 7fa7f6d9d640 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0002230 tx=0x7fa7f002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c7a5f777a840a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.696 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7dffff640 1 -- 172.21.15.22:0/1924695617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0066070 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7dffff640 1 -- 172.21.15.22:0/1924695617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7f002f6e0 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7dffff640 1 -- 172.21.15.22:0/1924695617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0004040 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/1924695617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 msgr2=0x55ca3e0bb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0002230 tx=0x7fa7f002a950 comp rx=0 tx=0).stop 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/1924695617 shutdown_connections 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0bb420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/1924695617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/1924695617 >> 172.21.15.22:0/1924695617 conn(0x55ca3e0af060 msgr2=0x55ca3e0bcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/1924695617 shutdown_connections 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.695+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/1924695617 wait complete. 2024-09-11T22:30:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 -- start start 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 Processor -- start 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81ac4a0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81ad910 con 0x55ca3e0b3410 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81acb70 con 0x55ca3e0bdcb0 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ff7ed740 10 client.0 _ll_register_callbacks cb 0x7fa7e00d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57042/0 (socket says 172.21.15.22:57042) 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 -- 172.21.15.22:0/3267216031 learned_addr learned my addr 172.21.15.22:0/3267216031 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7effff640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 -- 172.21.15.22:0/3267216031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0bdcb0 msgr2=0x55ca3e0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 -- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 msgr2=0x55ca3e0d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 -- 172.21.15.22:0/3267216031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3e0d0ff0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7f659c640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009d80 tx=0x7fa7e8014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7401cbf5f3e59659 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.696+0000 7fa7ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004220 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7e80043c0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7f002f6e0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa7e802c050 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 10 client.15642 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ca3e138080 con 0x55ca3e0b2af0 2024-09-11T22:30:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7f002f6e0 con 0x55ca3e0b2af0 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa7e800f040 con 0x55ca3e0b2af0 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 10 client.15642 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 20 client.15642 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e1387d0 0x55ca3e13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 4 client.15642 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca3df9b900 con 0x55ca3e1387d0 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.697+0000 7fa7effff640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e1387d0 0x55ca3e13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.698+0000 7fa7effff640 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e1387d0 0x55ca3e13ac10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6ed43358a0634a server_cookie=bfda37a79f91e08c in_seq=0 out_seq=0 2024-09-11T22:30:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:44.698+0000 7fa7ddffb640 10 client.15642 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:45.901 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:45 smithi022 ceph-mon[30966]: pgmap v54: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.3 MiB/s wr, 276 op/s 2024-09-11T22:30:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:45 smithi169 ceph-mon[35628]: pgmap v54: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.3 MiB/s wr, 276 op/s 2024-09-11T22:30:45.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:45 smithi045 ceph-mon[35556]: pgmap v54: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.3 MiB/s wr, 276 op/s 2024-09-11T22:30:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ddffb640 1 -- 172.21.15.22:0/3267216031 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca3df9b900 con 0x55ca3e1387d0 2024-09-11T22:30:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ddffb640 10 client.15642 handle_command_reply: tid=0 2024-09-11T22:30:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 client.15642 shutdown 2024-09-11T22:30:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 msgr2=0x55ca3e0d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009d80 tx=0x7fa7e8014840 comp rx=0 tx=0).stop 2024-09-11T22:30:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 shutdown_connections 2024-09-11T22:30:47.578 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ca3e1387d0 0x55ca3e13ac10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca3e0bdcb0 0x55ca3e0d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ddffb640 0 client.15642 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ca3e0b3410 0x55ca3e0d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 --2- 172.21.15.22:0/3267216031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca3e0b2af0 0x55ca3e0d3230 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 >> 172.21.15.22:0/3267216031 conn(0x55ca3e0af060 msgr2=0x55ca3e0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 shutdown_connections 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 1 -- 172.21.15.22:0/3267216031 wait complete. 2024-09-11T22:30:47.579 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.576+0000 7fa7ff7ed740 20 client.15642 trim_cache size 0 max 16384 2024-09-11T22:30:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:30:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:30:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:30:47.580 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 msgr2=0x7fa7e40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 0x7fa7e40a52e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7f004b000 tx=0x7fa7f0048000 comp rx=0 tx=0).stop 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 msgr2=0x7fa7f8198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000e9f0 tx=0x7fa7e000edf0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 shutdown_connections 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa7e40a2e20 0x7fa7e40a52e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7f810c0f0 0x7fa7f819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7f8103640 0x7fa7f8198920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 --2- 172.21.15.22:0/2814315173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7f8102d20 0x7fa7f81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 >> 172.21.15.22:0/2814315173 conn(0x7fa7f80fc6b0 msgr2=0x7fa7f80fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 shutdown_connections 2024-09-11T22:30:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:30:47.577+0000 7fa7fc976640 1 -- 172.21.15.22:0/2814315173 wait complete. 2024-09-11T22:30:47.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:47 smithi022 ceph-mon[30966]: pgmap v55: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 843 KiB/s wr, 41 op/s 2024-09-11T22:30:47.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:47 smithi169 ceph-mon[35628]: pgmap v55: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 843 KiB/s wr, 41 op/s 2024-09-11T22:30:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:47 smithi045 ceph-mon[35556]: pgmap v55: 97 pgs: 97 active+clean; 99 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 843 KiB/s wr, 41 op/s 2024-09-11T22:30:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:49 smithi022 ceph-mon[30966]: pgmap v56: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 901 op/s 2024-09-11T22:30:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:49 smithi169 ceph-mon[35628]: pgmap v56: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 901 op/s 2024-09-11T22:30:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:49 smithi045 ceph-mon[35556]: pgmap v56: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 901 op/s 2024-09-11T22:30:51.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:51 smithi022 ceph-mon[30966]: pgmap v57: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:51 smithi169 ceph-mon[35628]: pgmap v57: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:51 smithi045 ceph-mon[35556]: pgmap v57: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:53 smithi022 ceph-mon[30966]: pgmap v58: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:53 smithi169 ceph-mon[35628]: pgmap v58: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:53 smithi045 ceph-mon[35556]: pgmap v58: 97 pgs: 97 active+clean; 90 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 894 op/s 2024-09-11T22:30:54.072 INFO:tasks.workunit.client.0.smithi022.stderr:+ sync 2024-09-11T22:30:55.656 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-11T22:30:55.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:55 smithi022 ceph-mon[30966]: pgmap v59: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 916 op/s 2024-09-11T22:30:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:55 smithi169 ceph-mon[35628]: pgmap v59: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 916 op/s 2024-09-11T22:30:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:55 smithi045 ceph-mon[35556]: pgmap v59: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 916 op/s 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- 172.21.15.22:0/3742900108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb41810e440 msgr2=0x7fb418110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 --2- 172.21.15.22:0/3742900108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb41810e440 0x7fb418110830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb410009ca0 tx=0x7fb41002a950 comp rx=0 tx=0).stop 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- 172.21.15.22:0/3742900108 shutdown_connections 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 --2- 172.21.15.22:0/3742900108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb41810e440 0x7fb418110830 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 --2- 172.21.15.22:0/3742900108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 0x7fb41810df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 --2- 172.21.15.22:0/3742900108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb418074510 0x7fb4180748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- 172.21.15.22:0/3742900108 >> 172.21.15.22:0/3742900108 conn(0x7fb4180fd8c0 msgr2=0x7fb4180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- 172.21.15.22:0/3742900108 shutdown_connections 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- 172.21.15.22:0/3742900108 wait complete. 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 Processor -- start 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.391+0000 7fb41ecab640 1 -- start start 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 0x7fb41819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41810e440 0x7fb41819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb418114290 con 0x7fb418074510 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb418114110 con 0x7fb41810e440 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ecab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb418114410 con 0x7fb418074e30 2024-09-11T22:30:56.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57030/0 (socket says 172.21.15.22:57030) 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 -- 172.21.15.22:0/4256099566 learned_addr learned my addr 172.21.15.22:0/4256099566 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41d248640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41810e440 0x7fb41819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb417fff640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 0x7fb41819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 -- 172.21.15.22:0/4256099566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 msgr2=0x7fb41819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 0x7fb41819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 -- 172.21.15.22:0/4256099566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41810e440 msgr2=0x7fb41819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41810e440 0x7fb41819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 -- 172.21.15.22:0/4256099566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41819f6a0 con 0x7fb418074510 2024-09-11T22:30:56.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb41ca47640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e9f0 tx=0x7fb40c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.392+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00cd80 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.393+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41819f990 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.393+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb40c010930 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.393+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c018b00 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.393+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4181a7270 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.394+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4180748f0 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.395+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb40c018ca0 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.396+0000 7fb415ffb640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 0x7fb4080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.396+0000 7fb417fff640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 0x7fb4080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.396+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb40c0cf780 con 0x7fb418074510 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.396+0000 7fb417fff640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 0x7fb4080a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb418110280 tx=0x7fb40400b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.400+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb40c09bda0 con 0x7fb418074510 2024-09-11T22:30:56.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.613+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4181a7470 con 0x7fb418074510 2024-09-11T22:30:56.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.614+0000 7fb415ffb640 1 -- 172.21.15.22:0/4256099566 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7fb40c0a00a0 con 0x7fb418074510 2024-09-11T22:30:56.615 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:30:56.615 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:30:56.615 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:30:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.616+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 msgr2=0x7fb4080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.616+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 0x7fb4080a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb418110280 tx=0x7fb40400b390 comp rx=0 tx=0).stop 2024-09-11T22:30:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.616+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 msgr2=0x7fb41819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.616+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00e9f0 tx=0x7fb40c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 shutdown_connections 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb4080a2cf0 0x7fb4080a51b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41810e440 0x7fb41819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb418074e30 0x7fb41819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 --2- 172.21.15.22:0/4256099566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb418074510 0x7fb41819a6f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 >> 172.21.15.22:0/4256099566 conn(0x7fb4180fd8c0 msgr2=0x7fb4180fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 shutdown_connections 2024-09-11T22:30:56.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:56.617+0000 7fb41ecab640 1 -- 172.21.15.22:0/4256099566 wait complete. 2024-09-11T22:30:57.377 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-11T22:30:57.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-11T22:30:57.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:57 smithi022 ceph-mon[30966]: pgmap v60: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 881 op/s 2024-09-11T22:30:57.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:57 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4256099566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:57 smithi169 ceph-mon[35628]: pgmap v60: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 881 op/s 2024-09-11T22:30:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:57 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4256099566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:57 smithi045 ceph-mon[35556]: pgmap v60: 97 pgs: 97 active+clean; 97 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 881 op/s 2024-09-11T22:30:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:57 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4256099566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 -- 172.21.15.22:0/992838149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 msgr2=0x7f15b010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 --2- 172.21.15.22:0/992838149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b010ec40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009930 tx=0x7f15a802a420 comp rx=0 tx=0).stop 2024-09-11T22:30:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 -- 172.21.15.22:0/992838149 shutdown_connections 2024-09-11T22:30:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 --2- 172.21.15.22:0/992838149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b010ec40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 --2- 172.21.15.22:0/992838149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b01036e0 0x7f15b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 --2- 172.21.15.22:0/992838149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b0102d30 0x7f15b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 -- 172.21.15.22:0/992838149 >> 172.21.15.22:0/992838149 conn(0x7f15b00fc7d0 msgr2=0x7f15b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 -- 172.21.15.22:0/992838149 shutdown_connections 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.230+0000 7f15b59ec640 1 -- 172.21.15.22:0/992838149 wait complete. 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 Processor -- start 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 -- start start 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b01036e0 0x7f15b0198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01121e0 con 0x7f15b01082a0 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0112060 con 0x7f15b0102d30 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15b59ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0112360 con 0x7f15b01036e0 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:56436/0 (socket says 172.21.15.22:56436) 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15aeffd640 1 -- 172.21.15.22:0/4094418502 learned_addr learned my addr 172.21.15.22:0/4094418502 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.231+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b01036e0 0x7f15b0198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 -- 172.21.15.22:0/4094418502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b01036e0 msgr2=0x7f15b0198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b01036e0 0x7f15b0198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 -- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 msgr2=0x7f15b019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 -- 172.21.15.22:0/4094418502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b019d5d0 con 0x7f15b0102d30 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15af7fe640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15aeffd640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15a000eb90 tx=0x7f15a000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15b49ea640 1 -- 172.21.15.22:0/4094418502 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004d20 con 0x7f15b0102d30 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15b49ea640 1 -- 172.21.15.22:0/4094418502 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a000ee90 con 0x7f15b0102d30 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b019d8c0 con 0x7f15b0102d30 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15b49ea640 1 -- 172.21.15.22:0/4094418502 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a00108b0 con 0x7f15b0102d30 2024-09-11T22:30:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.232+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b01a51a0 con 0x7f15b0102d30 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.234+0000 7f15b49ea640 1 -- 172.21.15.22:0/4094418502 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f15a0005020 con 0x7f15b0102d30 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 Processor -- start 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 -- start start 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07df620 0x55fea07dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07ee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fea07452a0 con 0x55fea07eed50 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea06ecb10 con 0x55fea07dff40 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fea0741260 con 0x55fea07df620 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15ae7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15ae7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57056/0 (socket says 172.21.15.22:57056) 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15ae7fc640 1 -- 172.21.15.22:0/3188025690 learned_addr learned my addr 172.21.15.22:0/3188025690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15aeffd640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.235+0000 7f15af7fe640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07df620 0x55fea07dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 -- 172.21.15.22:0/3188025690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07df620 msgr2=0x55fea07dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07df620 0x55fea07dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15b49ea640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 0x7f159c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 -- 172.21.15.22:0/3188025690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 msgr2=0x55fea07ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 -- 172.21.15.22:0/3188025690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea04b6b90 con 0x55fea07eed50 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15aeffd640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15af7fe640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 0x7f159c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15b49ea640 1 -- 172.21.15.22:0/4094418502 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f15a00cfac0 con 0x7f15b0102d30 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1598009ba0 tx=0x7f1598011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a3d42158ebef26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15a5ffb640 1 -- 172.21.15.22:0/3188025690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598004230 con 0x55fea07eed50 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15a5ffb640 1 -- 172.21.15.22:0/3188025690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1598009e10 con 0x55fea07eed50 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.236+0000 7f15a5ffb640 1 -- 172.21.15.22:0/3188025690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598004e00 con 0x55fea07eed50 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- 172.21.15.22:0/3188025690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 msgr2=0x55fea07f1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1598009ba0 tx=0x7f1598011810 comp rx=0 tx=0).stop 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15af7fe640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 0x7f159c0a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a8005dd0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- 172.21.15.22:0/3188025690 shutdown_connections 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07eed50 0x55fea07f1140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/3188025690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07df620 0x55fea07dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- 172.21.15.22:0/3188025690 >> 172.21.15.22:0/3188025690 conn(0x55fea07dbcf0 msgr2=0x55fea07dc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- 172.21.15.22:0/3188025690 shutdown_connections 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- 172.21.15.22:0/3188025690 wait complete. 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 -- start start 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.237+0000 7f15b7dc5740 1 Processor -- start 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 0x55fea07ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea07ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fea07f1920 con 0x55fea07dff40 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea06cd6e0 con 0x55fea07df620 2024-09-11T22:30:58.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fea07f1aa0 con 0x55fea07eed50 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15b7dc5740 10 client.0 _ll_register_callbacks cb 0x55fea06f1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15ae7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 0x55fea07ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15ae7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57070/0 (socket says 172.21.15.22:57070) 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15ae7fc640 1 -- 172.21.15.22:0/316286719 learned_addr learned my addr 172.21.15.22:0/316286719 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15af7fe640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea07ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 -- 172.21.15.22:0/316286719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 msgr2=0x55fea07ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea07ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 -- 172.21.15.22:0/316286719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 msgr2=0x55fea07ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 -- 172.21.15.22:0/316286719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea07fae80 con 0x55fea07df620 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f15aeffd640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 0x55fea07ebc60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15a00cd1d0 tx=0x7f15a00099b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe55a038d5c1527f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.238+0000 7f158effd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a009bb10 con 0x55fea07df620 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1598009e10 con 0x55fea07df620 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f15a00cd480 con 0x55fea07df620 2024-09-11T22:30:58.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f15a00bc0d0 con 0x55fea07df620 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 10 client.25349 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fea07fd860 con 0x55fea07df620 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1598009e10 con 0x55fea07df620 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f15a00a47b0 con 0x55fea07df620 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 10 client.25349 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 10 client.25349 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 20 client.25349 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea07fec70 0x55fea0801110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 4 client.25349 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:58.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea07529d0 con 0x55fea07fec70 2024-09-11T22:30:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.239+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea07fec70 0x55fea0801110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.240+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea07fec70 0x55fea0801110 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332d808a93eebf54 server_cookie=da4bb79558d8021f in_seq=0 out_seq=0 2024-09-11T22:30:58.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.240+0000 7f158effd640 10 client.25349 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f158effd640 1 -- 172.21.15.22:0/316286719 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fea07529d0 con 0x55fea07fec70 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f158effd640 10 client.25349 handle_command_reply: tid=0 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 client.25349 shutdown 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 msgr2=0x55fea07ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 0x55fea07ebc60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15a00cd1d0 tx=0x7f15a00099b0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 shutdown_connections 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea07fec70 0x55fea0801110 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea07ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07dff40 0x55fea07ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/316286719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07df620 0x55fea07ebc60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f158effd640 0 client.25349 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 >> 172.21.15.22:0/316286719 conn(0x55fea07dbcf0 msgr2=0x55fea07e1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 shutdown_connections 2024-09-11T22:30:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.242+0000 7f15b7dc5740 1 -- 172.21.15.22:0/316286719 wait complete. 2024-09-11T22:30:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.243+0000 7f15b7dc5740 20 client.25349 trim_cache size 0 max 16384 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 Processor -- start 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 -- start start 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07dff40 0x55fea08069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07eed50 0x55fea0806f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01a9690 con 0x55fea07df620 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01abef0 con 0x55fea07eed50 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01a9ce0 con 0x55fea07dff40 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57074/0 (socket says 172.21.15.22:57074) 2024-09-11T22:30:58.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15aeffd640 1 -- 172.21.15.22:0/2261402790 learned_addr learned my addr 172.21.15.22:0/2261402790 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.260+0000 7f15af7fe640 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07eed50 0x55fea0806f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07dff40 0x55fea08069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 -- 172.21.15.22:0/2261402790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07dff40 msgr2=0x55fea08069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07dff40 0x55fea08069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 -- 172.21.15.22:0/2261402790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07eed50 msgr2=0x55fea0806f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07eed50 0x55fea0806f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 -- 172.21.15.22:0/2261402790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea07e7840 con 0x55fea07df620 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f15a0098430 tx=0x7f15a0005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec81c395c49bce72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15a57fa640 1 -- 172.21.15.22:0/2261402790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a009b930 con 0x55fea07df620 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15a57fa640 1 -- 172.21.15.22:0/2261402790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a009c6d0 con 0x55fea07df620 2024-09-11T22:30:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.261+0000 7f15a57fa640 1 -- 172.21.15.22:0/2261402790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0098640 con 0x55fea07df620 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2261402790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 msgr2=0x55fea07dad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f15a0098430 tx=0x7f15a0005870 comp rx=0 tx=0).stop 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2261402790 shutdown_connections 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07eed50 0x55fea0806f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07dff40 0x55fea08069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2261402790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07dad60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2261402790 >> 172.21.15.22:0/2261402790 conn(0x55fea07dbcf0 msgr2=0x55fea07da650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2261402790 shutdown_connections 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2261402790 wait complete. 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 -- start start 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.262+0000 7f15b7dc5740 1 Processor -- start 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07f3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea0862980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01aa3b0 con 0x55fea07df620 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01ab820 con 0x55fea07dff40 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01aaa80 con 0x55fea07eed50 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 10 client.0 _ll_register_callbacks cb 0x7f15a00d3260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57078/0 (socket says 172.21.15.22:57078) 2024-09-11T22:30:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 -- 172.21.15.22:0/2671538914 learned_addr learned my addr 172.21.15.22:0/2671538914 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15af7fe640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea0862980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 -- 172.21.15.22:0/2671538914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 msgr2=0x55fea0862980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea0862980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 -- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 msgr2=0x55fea07f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 -- 172.21.15.22:0/2671538914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea0862fc0 con 0x55fea07df620 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15af7fe640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea0862980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15aeffd640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f15a00989a0 tx=0x7f15a00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d5e8d49bfab402 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f158effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a007e070 con 0x55fea07df620 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f15a009b420 con 0x55fea07df620 2024-09-11T22:30:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.263+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a009c6d0 con 0x55fea07df620 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f15a009b930 con 0x55fea07df620 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 10 client.15666 fetch_fsmap learned FSMap version 20 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fea0862fc0 con 0x55fea07df620 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a009c6d0 con 0x55fea07df620 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f15a0081020 con 0x55fea07df620 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 10 client.15666 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 10 client.15666 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 20 client.15666 populate_metadata read hostname 'smithi022' 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea086a630 0x55fea086ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 4 client.15666 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x55fea074cd20 con 0x55fea086a630 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.264+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea086a630 0x55fea086ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.265+0000 7f15ae7fc640 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea086a630 0x55fea086ca20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ce9b5bdb3bc66 server_cookie=fdedf8ac2d0dfdf8 in_seq=0 out_seq=0 2024-09-11T22:30:58.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:30:58.265+0000 7f158effd640 10 client.15666 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:30:59.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:30:59 smithi022 ceph-mon[30966]: pgmap v61: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.2 MiB/s wr, 1.62k op/s 2024-09-11T22:30:59.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:30:59 smithi169 ceph-mon[35628]: pgmap v61: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.2 MiB/s wr, 1.62k op/s 2024-09-11T22:30:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:30:59 smithi045 ceph-mon[35556]: pgmap v61: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.2 MiB/s wr, 1.62k op/s 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 -- 172.21.15.22:0/708664255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2984101350 msgr2=0x7f298410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 --2- 172.21.15.22:0/708664255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2984101350 0x7f298410d880 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f297c009930 tx=0x7f297c02a420 comp rx=0 tx=0).stop 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 -- 172.21.15.22:0/708664255 shutdown_connections 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 --2- 172.21.15.22:0/708664255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2984101350 0x7f298410d880 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 --2- 172.21.15.22:0/708664255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841009b0 0x7f2984100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 --2- 172.21.15.22:0/708664255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29841069c0 0x7f2984106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 -- 172.21.15.22:0/708664255 >> 172.21.15.22:0/708664255 conn(0x7f2984077990 msgr2=0x7f29840fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 -- 172.21.15.22:0/708664255 shutdown_connections 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.669+0000 7f298b8e6640 1 -- 172.21.15.22:0/708664255 wait complete. 2024-09-11T22:31:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 Processor -- start 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 -- start start 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2984101350 0x7f2984199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841069c0 0x7f29841a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2984110f20 con 0x7f29841009b0 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2984110da0 con 0x7f29841069c0 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f298b8e6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29841110a0 con 0x7f2984101350 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57094/0 (socket says 172.21.15.22:57094) 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 -- 172.21.15.22:0/1276030265 learned_addr learned my addr 172.21.15.22:0/1276030265 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2988e81640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2984101350 0x7f2984199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989e83640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841069c0 0x7f29841a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 -- 172.21.15.22:0/1276030265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2984101350 msgr2=0x7f2984199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2984101350 0x7f2984199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 -- 172.21.15.22:0/1276030265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841069c0 msgr2=0x7f29841a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841069c0 0x7f29841a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 -- 172.21.15.22:0/1276030265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29841a47b0 con 0x7f29841009b0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.670+0000 7f2989682640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f298000eb90 tx=0x7f298000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.671+0000 7f297a7fc640 1 -- 172.21.15.22:0/1276030265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980004d20 con 0x7f29841009b0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.671+0000 7f297a7fc640 1 -- 172.21.15.22:0/1276030265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f298000ee90 con 0x7f29841009b0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.671+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29841a4980 con 0x7f29841009b0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.671+0000 7f297a7fc640 1 -- 172.21.15.22:0/1276030265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29800108b0 con 0x7f29841009b0 2024-09-11T22:31:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.671+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29841a4e50 con 0x7f29841009b0 2024-09-11T22:31:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.673+0000 7f297a7fc640 1 -- 172.21.15.22:0/1276030265 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2980005020 con 0x7f29841009b0 2024-09-11T22:31:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.673+0000 7f298e67d740 1 Processor -- start 2024-09-11T22:31:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.673+0000 7f298e67d740 1 -- start start 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7ca0410 0x5635f7caa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7caacb0 0x5635f7cad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635f7c042f0 con 0x5635f7caacb0 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5635f7bac270 con 0x5635f7ca0410 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f298e67d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5635f7c002b0 con 0x5635f7c9faf0 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2988e81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7caacb0 0x5635f7cad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:40238/0 (socket says 172.21.15.22:40238) 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 -- 172.21.15.22:0/3655818381 learned_addr learned my addr 172.21.15.22:0/3655818381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989682640 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7ca0410 0x5635f7caa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f297a7fc640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 0x7f29700a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 -- 172.21.15.22:0/3655818381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7ca0410 msgr2=0x5635f7caa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7ca0410 0x5635f7caa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 -- 172.21.15.22:0/3655818381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7caacb0 msgr2=0x5635f7cad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7caacb0 0x5635f7cad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 -- 172.21.15.22:0/3655818381 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f7bab340 con 0x5635f7c9faf0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f297a7fc640 1 -- 172.21.15.22:0/1276030265 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f29800cf990 con 0x7f29841009b0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 0x7f29700a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.674+0000 7f2989e83640 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f297c009930 tx=0x7f297c031420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e7645d93429876 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f296f7fe640 1 -- 172.21.15.22:0/3655818381 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c035040 con 0x5635f7c9faf0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f2989e83640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 0x7f29700a9670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f297c04a000 tx=0x7f297c047000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f296f7fe640 1 -- 172.21.15.22:0/3655818381 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f297c046e00 con 0x5635f7c9faf0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f296f7fe640 1 -- 172.21.15.22:0/3655818381 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c045e60 con 0x5635f7c9faf0 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 -- 172.21.15.22:0/3655818381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 msgr2=0x5635f7c9fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.681 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f297c009930 tx=0x7f297c031420 comp rx=0 tx=0).stop 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 -- 172.21.15.22:0/3655818381 shutdown_connections 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7caacb0 0x5635f7cad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7ca0410 0x5635f7caa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 --2- 172.21.15.22:0/3655818381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7c9faf0 0x5635f7c9fed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 -- 172.21.15.22:0/3655818381 >> 172.21.15.22:0/3655818381 conn(0x5635f7c9c060 msgr2=0x5635f7c9c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 -- 172.21.15.22:0/3655818381 shutdown_connections 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.675+0000 7f298e67d740 1 -- 172.21.15.22:0/3655818381 wait complete. 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 -- start start 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 Processor -- start 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 0x5635f7ca8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7caacb0 0x5635f7ca8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635f7cad880 con 0x5635f7c9faf0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5635f7b8d290 con 0x5635f7caacb0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5635f7cada00 con 0x5635f7ca0410 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f298e67d740 10 client.0 _ll_register_callbacks cb 0x5635f7bbe140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f2989682640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f2989682640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57102/0 (socket says 172.21.15.22:57102) 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f2989682640 1 -- 172.21.15.22:0/1229100636 learned_addr learned my addr 172.21.15.22:0/1229100636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f2988e81640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 0x5635f7ca8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.676+0000 7f2989e83640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7caacb0 0x5635f7ca8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 -- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7caacb0 msgr2=0x5635f7ca8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7caacb0 0x5635f7ca8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 -- 172.21.15.22:0/1229100636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 msgr2=0x5635f7ca7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 -- 172.21.15.22:0/1229100636 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f7917210 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2989682640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f2988e81640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 0x5635f7ca8110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f298406a3f0 tx=0x7f2974012aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6650a7e6593cebad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f296cff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297400f5e0 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f297c046e00 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f297400f780 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f297400f980 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f298e67d740 10 client.25231 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.677+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5635f79e3620 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f297c046e00 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f297401c420 con 0x5635f7ca0410 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 10 client.25231 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 10 client.25231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 20 client.25231 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7cbacd0 0x5635f7cbd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 4 client.25231 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635f7c11a20 con 0x5635f7cbacd0 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f2989682640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7cbacd0 0x5635f7cbd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f296cff9640 10 client.25231 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.678+0000 7f2989682640 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7cbacd0 0x5635f7cbd120 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa7f33f7e05fa9c4 server_cookie=a8ec4283ba573ef9 in_seq=0 out_seq=0 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f296cff9640 1 -- 172.21.15.22:0/1229100636 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635f7c11a20 con 0x5635f7cbacd0 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f296cff9640 10 client.25231 handle_command_reply: tid=0 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 client.25231 shutdown 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 msgr2=0x5635f7ca8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 0x5635f7ca8110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f298406a3f0 tx=0x7f2974012aa0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 shutdown_connections 2024-09-11T22:31:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7cbacd0 0x5635f7cbd120 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7caacb0 0x5635f7ca8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f296cff9640 0 client.25231 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7ca0410 0x5635f7ca8110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 --2- 172.21.15.22:0/1229100636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7c9faf0 0x5635f7ca7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 >> 172.21.15.22:0/1229100636 conn(0x5635f7c9c060 msgr2=0x5635f7ca1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 shutdown_connections 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 1 -- 172.21.15.22:0/1229100636 wait complete. 2024-09-11T22:31:00.687 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.681+0000 7f298e67d740 20 client.25231 trim_cache size 0 max 16384 2024-09-11T22:31:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.695+0000 7f298e67d740 1 Processor -- start 2024-09-11T22:31:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.695+0000 7f298e67d740 1 -- start start 2024-09-11T22:31:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7ca2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7cc29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29841a9540 con 0x5635f7ca0410 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f29841abda0 con 0x5635f7c9faf0 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f298e67d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29841a9b90 con 0x5635f7caacb0 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57104/0 (socket says 172.21.15.22:57104) 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 -- 172.21.15.22:0/2743895079 learned_addr learned my addr 172.21.15.22:0/2743895079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2989682640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7ca2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2989e83640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7cc29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 -- 172.21.15.22:0/2743895079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 msgr2=0x5635f7cc29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7cc29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 -- 172.21.15.22:0/2743895079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 msgr2=0x5635f7ca2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.701 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7ca2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 -- 172.21.15.22:0/2743895079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f7cad410 con 0x5635f7ca0410 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2989e83640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7cc29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f2988e81640 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f297401c8e0 tx=0x7f29740096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5d8a457acd4104 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f296effd640 1 -- 172.21.15.22:0/2743895079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974029030 con 0x5635f7ca0410 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f296effd640 1 -- 172.21.15.22:0/2743895079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f297400f5e0 con 0x5635f7ca0410 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.696+0000 7f296effd640 1 -- 172.21.15.22:0/2743895079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740050b0 con 0x5635f7ca0410 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- 172.21.15.22:0/2743895079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 msgr2=0x5635f7ca8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f297401c8e0 tx=0x7f29740096f0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- 172.21.15.22:0/2743895079 shutdown_connections 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7cc29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca8480 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 --2- 172.21.15.22:0/2743895079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7ca2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- 172.21.15.22:0/2743895079 >> 172.21.15.22:0/2743895079 conn(0x5635f7c9c060 msgr2=0x5635f7ca9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.702 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- 172.21.15.22:0/2743895079 shutdown_connections 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- 172.21.15.22:0/2743895079 wait complete. 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 -- start start 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.697+0000 7f298e67d740 1 Processor -- start 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7cb32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7ca4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29841aa260 con 0x5635f7ca0410 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f29841ab6d0 con 0x5635f7c9faf0 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29841aa930 con 0x5635f7caacb0 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f298e67d740 10 client.0 _ll_register_callbacks cb 0x7f2974009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57108/0 (socket says 172.21.15.22:57108) 2024-09-11T22:31:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 -- 172.21.15.22:0/469660788 learned_addr learned my addr 172.21.15.22:0/469660788 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2989682640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7cb32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2989e83640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7ca4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 -- 172.21.15.22:0/469660788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 msgr2=0x5635f7ca4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7ca4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 -- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 msgr2=0x5635f7cb32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7cb32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 -- 172.21.15.22:0/469660788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f7ca54e0 con 0x5635f7ca0410 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f2988e81640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29740059f0 tx=0x7f2974009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795246382bb8fa86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.698+0000 7f296cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974029070 con 0x5635f7ca0410 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f297400fd30 con 0x5635f7ca0410 2024-09-11T22:31:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f297400f5e0 con 0x5635f7ca0410 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f29740050d0 con 0x5635f7ca0410 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 10 client.15684 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5635f7d25910 con 0x5635f7ca0410 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f297400f5e0 con 0x5635f7ca0410 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f297402e470 con 0x5635f7ca0410 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 10 client.15684 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 20 client.15684 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7d25fd0 0x5635f7d283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 4 client.15684 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635f7c0bd70 con 0x5635f7d25fd0 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.699+0000 7f2989682640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7d25fd0 0x5635f7d283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.700+0000 7f2989682640 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7d25fd0 0x5635f7d283f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=776f48a1f857a795 server_cookie=7f774542e0ed195c in_seq=0 out_seq=0 2024-09-11T22:31:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:00.700+0000 7f296cff9640 10 client.15684 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:00.769 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar c linux-4.0.5 2024-09-11T22:31:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:01 smithi022 ceph-mon[30966]: pgmap v62: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:01.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:01 smithi169 ceph-mon[35628]: pgmap v62: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:01 smithi045 ceph-mon[35556]: pgmap v62: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:03.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.405+0000 7f296cff9640 1 -- 172.21.15.22:0/469660788 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635f7c0bd70 con 0x5635f7d25fd0 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.405+0000 7f296cff9640 10 client.15684 handle_command_reply: tid=0 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.405+0000 7f298e67d740 1 client.15684 shutdown 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 msgr2=0x5635f7ca4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29740059f0 tx=0x7f2974009370 comp rx=0 tx=0).stop 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 shutdown_connections 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5635f7d25fd0 0x5635f7d283f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635f7caacb0 0x5635f7ca4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635f7ca0410 0x5635f7ca4860 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 --2- 172.21.15.22:0/469660788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5635f7c9faf0 0x5635f7cb32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 >> 172.21.15.22:0/469660788 conn(0x5635f7c9c060 msgr2=0x5635f7c9a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f296cff9640 0 client.15684 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 shutdown_connections 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 1 -- 172.21.15.22:0/469660788 wait complete. 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.406+0000 7f298e67d740 20 client.15684 trim_cache size 0 max 16384 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:31:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 msgr2=0x7f29700a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 0x7f29700a9670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f297c04a000 tx=0x7f297c047000 comp rx=0 tx=0).stop 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 msgr2=0x7f29841991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f298000eb90 tx=0x7f298000c6a0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 shutdown_connections 2024-09-11T22:31:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f29700a71b0 0x7f29700a9670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29841069c0 0x7f29841a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2984101350 0x7f2984199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 --2- 172.21.15.22:0/1276030265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29841009b0 0x7f29841991f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 >> 172.21.15.22:0/1276030265 conn(0x7f2984077990 msgr2=0x7f2984103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:03.410 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 shutdown_connections 2024-09-11T22:31:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:03.407+0000 7f298b8e6640 1 -- 172.21.15.22:0/1276030265 wait complete. 2024-09-11T22:31:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f158effd640 1 -- 172.21.15.22:0/2671538914 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55fea074cd20 con 0x55fea086a630 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f158effd640 10 client.15666 handle_command_reply: tid=0 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 client.15666 shutdown 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 msgr2=0x55fea07f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f15a00989a0 tx=0x7f15a00099b0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 shutdown_connections 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55fea086a630 0x55fea086ca20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fea07eed50 0x55fea0862980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f158effd640 0 client.15666 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:03.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea07dff40 0x55fea07f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 --2- 172.21.15.22:0/2671538914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fea07df620 0x55fea07f32f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 >> 172.21.15.22:0/2671538914 conn(0x55fea07dbcf0 msgr2=0x55fea07e18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 shutdown_connections 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 1 -- 172.21.15.22:0/2671538914 wait complete. 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b7dc5740 20 client.15666 trim_cache size 0 max 16384 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 20, 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:31:03.593 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 6, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "a8bf226a": { 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 6, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 133.4, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:31:03.594 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:03.595 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 msgr2=0x7f159c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 0x7f159c0a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a8005dd0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 msgr2=0x7f15b0198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15a000eb90 tx=0x7f15a000c6a0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 shutdown_connections 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f159c0a2cf0 0x7f159c0a51b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b01082a0 0x7f15b019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15b01036e0 0x7f15b0198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 --2- 172.21.15.22:0/4094418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b0102d30 0x7f15b0198620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.591+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 >> 172.21.15.22:0/4094418502 conn(0x7f15b00fc7d0 msgr2=0x7f15b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.592+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 shutdown_connections 2024-09-11T22:31:03.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:03.592+0000 7f15b59ec640 1 -- 172.21.15.22:0/4094418502 wait complete. 2024-09-11T22:31:03.786 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:03 smithi022 ceph-mon[30966]: pgmap v63: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:03.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:03 smithi169 ceph-mon[35628]: pgmap v63: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:03 smithi045 ceph-mon[35556]: pgmap v63: 97 pgs: 97 active+clean; 160 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.0 MiB/s wr, 762 op/s 2024-09-11T22:31:03.914 INFO:tasks.workunit.client.0.smithi022.stderr:+ rm -rf linux-4.0.5 2024-09-11T22:31:04.438 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a8bf226a', quiesce took 8.8 seconds. Will release after: 4.6 2024-09-11T22:31:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 -- 172.21.15.22:0/3738169244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc101de0 msgr2=0x7f92cc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 --2- 172.21.15.22:0/3738169244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc101de0 0x7f92cc1021c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009900 tx=0x7f92c802a410 comp rx=0 tx=0).stop 2024-09-11T22:31:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 -- 172.21.15.22:0/3738169244 shutdown_connections 2024-09-11T22:31:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 --2- 172.21.15.22:0/3738169244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 0x7f92cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 --2- 172.21.15.22:0/3738169244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc102790 0x7f92cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 --2- 172.21.15.22:0/3738169244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc101de0 0x7f92cc1021c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 -- 172.21.15.22:0/3738169244 >> 172.21.15.22:0/3738169244 conn(0x7f92cc0fd8c0 msgr2=0x7f92cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 -- 172.21.15.22:0/3738169244 shutdown_connections 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 -- 172.21.15.22:0/3738169244 wait complete. 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.606+0000 7f92d396c640 1 Processor -- start 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 -- start start 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 0x7f92cc19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 0x7f92cc19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112090 con 0x7f92cc102790 2024-09-11T22:31:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc111f10 con 0x7f92cc106f10 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d396c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112210 con 0x7f92cc101de0 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57524/0 (socket says 172.21.15.22:57524) 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 -- 172.21.15.22:0/1595465520 learned_addr learned my addr 172.21.15.22:0/1595465520 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d1f09640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 0x7f92cc19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d1708640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 0x7f92cc19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 -- 172.21.15.22:0/1595465520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 msgr2=0x7f92cc19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 0x7f92cc19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 -- 172.21.15.22:0/1595465520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 msgr2=0x7f92cc19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 0x7f92cc19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 -- 172.21.15.22:0/1595465520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc19f700 con 0x7f92cc102790 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d1708640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 0x7f92cc19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.607+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c970 tx=0x7f92bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.608+0000 7f92c27fc640 1 -- 172.21.15.22:0/1595465520 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc007bb0 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.608+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc19f9f0 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.608+0000 7f92c27fc640 1 -- 172.21.15.22:0/1595465520 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92bc007d50 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.608+0000 7f92c27fc640 1 -- 172.21.15.22:0/1595465520 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00f4b0 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.608+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1a72d0 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.610+0000 7f92c27fc640 1 -- 172.21.15.22:0/1595465520 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f92bc0046c0 con 0x7f92cc102790 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.610+0000 7f92d5d45740 1 Processor -- start 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.610+0000 7f92d5d45740 1 -- start start 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1c11222e0 con 0x55d1c11c7680 2024-09-11T22:31:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1c10c9ce0 con 0x55d1c11bc4a0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d5d45740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d1c111e2a0 con 0x55d1c11bcdc0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:58880/0 (socket says 172.21.15.22:58880) 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57528/0 (socket says 172.21.15.22:57528) 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 -- 172.21.15.22:0/2431880204 learned_addr learned my addr 172.21.15.22:0/2431880204 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1708640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92c27fc640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 0x7f92b80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 -- 172.21.15.22:0/2431880204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 msgr2=0x55d1c11c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 -- 172.21.15.22:0/2431880204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 msgr2=0x55d1c11c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 -- 172.21.15.22:0/2431880204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c10ae440 con 0x55d1c11bc4a0 2024-09-11T22:31:04.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d0f07640 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92c27fc640 1 -- 172.21.15.22:0/1595465520 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f92bc0cf280 con 0x7f92cc102790 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 0x7f92b80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.611+0000 7f92d1f09640 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c400af50 tx=0x7f92c400f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c7f6382cd0832 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d1f09640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 0x7f92b80a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92c4020000 tx=0x7f92c401c030 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92b77fe640 1 -- 172.21.15.22:0/2431880204 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004b40 con 0x55d1c11bc4a0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92b77fe640 1 -- 172.21.15.22:0/2431880204 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92c4004da0 con 0x55d1c11bc4a0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92b77fe640 1 -- 172.21.15.22:0/2431880204 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4019660 con 0x55d1c11bc4a0 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 -- 172.21.15.22:0/2431880204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 msgr2=0x55d1c11bc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c400af50 tx=0x7f92c400f850 comp rx=0 tx=0).stop 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 -- 172.21.15.22:0/2431880204 shutdown_connections 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 --2- 172.21.15.22:0/2431880204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11bc880 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 -- 172.21.15.22:0/2431880204 >> 172.21.15.22:0/2431880204 conn(0x55d1c11b8a30 msgr2=0x55d1c11b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.612+0000 7f92d5d45740 1 -- 172.21.15.22:0/2431880204 shutdown_connections 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 -- 172.21.15.22:0/2431880204 wait complete. 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 -- start start 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 Processor -- start 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d1c11ca250 con 0x55d1c11bc4a0 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1c10dd050 con 0x55d1c11bcdc0 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d1c11ca3d0 con 0x55d1c11c7680 2024-09-11T22:31:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d5d45740 10 client.0 _ll_register_callbacks cb 0x55d1c111d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.613+0000 7f92d1708640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57544/0 (socket says 172.21.15.22:57544) 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 -- 172.21.15.22:0/304905973 learned_addr learned my addr 172.21.15.22:0/304905973 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d0f07640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1f09640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 -- 172.21.15.22:0/304905973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 msgr2=0x55d1c11c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 -- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bcdc0 msgr2=0x55d1c11c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 -- 172.21.15.22:0/304905973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c0e933c0 con 0x55d1c11bc4a0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d1708640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009900 tx=0x7f92c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f9be142e788d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c8035040 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f92c8005020 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92c4004da0 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f92c8005220 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d5d45740 10 client.15696 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.614+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d1c11d5c90 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92c4004da0 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f92c8003790 con 0x55d1c11bc4a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 10 client.15696 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 20 client.15696 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c11d70a0 0x55d1c11d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 4 client.15696 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1c112f850 con 0x55d1c11d70a0 2024-09-11T22:31:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.615+0000 7f92d0f07640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c11d70a0 0x55d1c11d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.616+0000 7f92d0f07640 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c11d70a0 0x55d1c11d94b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81bb71e16b775ea7 server_cookie=63a34680da47d117 in_seq=0 out_seq=0 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.616+0000 7f92b4ff9640 10 client.15696 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.616+0000 7f92b4ff9640 1 -- 172.21.15.22:0/304905973 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1c112f850 con 0x55d1c11d70a0 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.616+0000 7f92b4ff9640 10 client.15696 handle_command_reply: tid=0 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 client.15696 shutdown 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 msgr2=0x55d1c11c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009900 tx=0x7f92c8004270 comp rx=0 tx=0).stop 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 shutdown_connections 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c11d70a0 0x55d1c11d94b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bcdc0 0x55d1c11c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92b4ff9640 0 client.15696 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 --2- 172.21.15.22:0/304905973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bc4a0 0x55d1c11c7060 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 >> 172.21.15.22:0/304905973 conn(0x55d1c11b8a30 msgr2=0x55d1c11be710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 shutdown_connections 2024-09-11T22:31:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 1 -- 172.21.15.22:0/304905973 wait complete. 2024-09-11T22:31:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.617+0000 7f92d5d45740 20 client.15696 trim_cache size 0 max 16384 2024-09-11T22:31:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.634+0000 7f92d5d45740 1 Processor -- start 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.634+0000 7f92d5d45740 1 -- start start 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.634+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d5d45740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1adab0 con 0x55d1c11bcdc0 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d5d45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1b0330 con 0x55d1c11bc4a0 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d5d45740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1ae120 con 0x55d1c11c7680 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57556/0 (socket says 172.21.15.22:57556) 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 -- 172.21.15.22:0/1457320733 learned_addr learned my addr 172.21.15.22:0/1457320733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d1708640 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d1f09640 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 -- 172.21.15.22:0/1457320733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 msgr2=0x55d1c11df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11df2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 -- 172.21.15.22:0/1457320733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 msgr2=0x55d1c11d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 -- 172.21.15.22:0/1457320733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1c11c32c0 con 0x55d1c11bcdc0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92d0f07640 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f92bc098160 tx=0x7f92bc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3082ef97097aae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92b6ffd640 1 -- 172.21.15.22:0/1457320733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc01d040 con 0x55d1c11bcdc0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92b6ffd640 1 -- 172.21.15.22:0/1457320733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92bc0cf040 con 0x55d1c11bcdc0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.635+0000 7f92b6ffd640 1 -- 172.21.15.22:0/1457320733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ccc40 con 0x55d1c11bcdc0 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- 172.21.15.22:0/1457320733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 msgr2=0x55d1c11ded80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f92bc098160 tx=0x7f92bc086040 comp rx=0 tx=0).stop 2024-09-11T22:31:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- 172.21.15.22:0/1457320733 shutdown_connections 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11c7680 0x55d1c11df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11bcdc0 0x55d1c11ded80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 --2- 172.21.15.22:0/1457320733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- 172.21.15.22:0/1457320733 >> 172.21.15.22:0/1457320733 conn(0x55d1c11b8a30 msgr2=0x55d1c11bf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- 172.21.15.22:0/1457320733 shutdown_connections 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- 172.21.15.22:0/1457320733 wait complete. 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 -- start start 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.636+0000 7f92d5d45740 1 Processor -- start 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1ae7f0 con 0x55d1c11c7680 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1afc60 con 0x55d1c11bc4a0 2024-09-11T22:31:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1aeec0 con 0x55d1c11bcdc0 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d5d45740 10 client.0 _ll_register_callbacks cb 0x7f92c8031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1708640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57562/0 (socket says 172.21.15.22:57562) 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 -- 172.21.15.22:0/476613345 learned_addr learned my addr 172.21.15.22:0/476613345 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d0f07640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 -- 172.21.15.22:0/476613345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 msgr2=0x55d1c11cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 -- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 msgr2=0x55d1c11cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1f09640 1 -- 172.21.15.22:0/476613345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1c1240e50 con 0x55d1c11c7680 2024-09-11T22:31:04.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.637+0000 7f92d1708640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d1f09640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92c4004a80 tx=0x7f92c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd797fd8718e9438 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4004b40 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f92c401ac60 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92bc0cf040 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f92c401ae60 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 10 client.15702 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d1c1242140 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92bc0cf040 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f92c4023070 con 0x55d1c11c7680 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 10 client.15702 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:04.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 20 client.15702 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c1242720 0x55d1c1244b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 4 client.15702 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.638+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1c1129d60 con 0x55d1c1242720 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92d1708640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c1242720 0x55d1c1244b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92d1708640 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c1242720 0x55d1c1244b40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13cd400ac11a7a25 server_cookie=da1f23617c1e8ee9 in_seq=0 out_seq=0 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92b4ff9640 10 client.15702 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92b4ff9640 1 -- 172.21.15.22:0/476613345 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d1c1129d60 con 0x55d1c1242720 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92b4ff9640 10 client.15702 handle_command_reply: tid=0 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92d5d45740 1 client.15702 shutdown 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 msgr2=0x55d1c11cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.639+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92c4004a80 tx=0x7f92c4004ab0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 shutdown_connections 2024-09-11T22:31:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d1c1242720 0x55d1c1244b40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d1c11c7680 0x55d1c11cbef0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1c11bcdc0 0x55d1c11cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 --2- 172.21.15.22:0/476613345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1c11bc4a0 0x55d1c11cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92b4ff9640 0 client.15702 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 >> 172.21.15.22:0/476613345 conn(0x55d1c11b8a30 msgr2=0x55d1c11c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 shutdown_connections 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 1 -- 172.21.15.22:0/476613345 wait complete. 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d5d45740 20 client.15702 trim_cache size 0 max 16384 2024-09-11T22:31:04.651 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:04.652 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:31:04.652 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:31:04.652 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 msgr2=0x7f92b80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 0x7f92b80a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92c4020000 tx=0x7f92c401c030 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 msgr2=0x7f92cc19ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.640+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c970 tx=0x7f92bc00ce30 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 shutdown_connections 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f92b80a2cf0 0x7f92b80a51b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92cc106f10 0x7f92cc19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92cc102790 0x7f92cc19ac90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 --2- 172.21.15.22:0/1595465520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92cc101de0 0x7f92cc19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 >> 172.21.15.22:0/1595465520 conn(0x7f92cc0fd8c0 msgr2=0x7f92cc0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 shutdown_connections 2024-09-11T22:31:04.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:04.641+0000 7f92d396c640 1 -- 172.21.15.22:0/1595465520 wait complete. 2024-09-11T22:31:05.372 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:31:05.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:31:05.632 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:05.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:05 smithi022 ceph-mon[30966]: pgmap v64: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 1.50k op/s 2024-09-11T22:31:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:05 smithi169 ceph-mon[35628]: pgmap v64: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 1.50k op/s 2024-09-11T22:31:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:05 smithi045 ceph-mon[35556]: pgmap v64: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 1.50k op/s 2024-09-11T22:31:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.086+0000 7f821d923640 1 -- 172.21.15.22:0/3936907270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 msgr2=0x7f82181031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.086+0000 7f821d923640 1 --2- 172.21.15.22:0/3936907270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f82181031d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8210009ca0 tx=0x7f821002a950 comp rx=0 tx=0).stop 2024-09-11T22:31:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.086+0000 7f821d923640 1 -- 172.21.15.22:0/3936907270 shutdown_connections 2024-09-11T22:31:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.086+0000 7f821d923640 1 --2- 172.21.15.22:0/3936907270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821810c190 0x7f821810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 --2- 172.21.15.22:0/3936907270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8218103710 0x7f821810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 --2- 172.21.15.22:0/3936907270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f82181031d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 -- 172.21.15.22:0/3936907270 >> 172.21.15.22:0/3936907270 conn(0x7f82180fc7d0 msgr2=0x7f82180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 -- 172.21.15.22:0/3936907270 shutdown_connections 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 -- 172.21.15.22:0/3936907270 wait complete. 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 Processor -- start 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.087+0000 7f821d923640 1 -- start start 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 0x7f8218198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821810c190 0x7f821819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8218112100 con 0x7f8218102df0 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8218111f80 con 0x7f821810c190 2024-09-11T22:31:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8218112280 con 0x7f8218103710 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57594/0 (socket says 172.21.15.22:57594) 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 -- 172.21.15.22:0/4104016090 learned_addr learned my addr 172.21.15.22:0/4104016090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f82167fc640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 0x7f8218198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f82177fe640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821810c190 0x7f821819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 -- 172.21.15.22:0/4104016090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 msgr2=0x7f8218198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 0x7f8218198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 -- 172.21.15.22:0/4104016090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821810c190 msgr2=0x7f821819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821810c190 0x7f821819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 -- 172.21.15.22:0/4104016090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821819d530 con 0x7f8218102df0 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f82167fc640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 0x7f8218198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f8216ffd640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8210005cc0 tx=0x7f821002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210034040 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8210003e40 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.088+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821819d7c0 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.089+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210039430 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.089+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181a5100 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.090+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82181031d0 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.091+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8210037020 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.092+0000 7f821c921640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 0x7f82040a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.092+0000 7f82167fc640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 0x7f82040a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.092+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f82100f03e0 con 0x7f8218102df0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.092+0000 7f82167fc640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 0x7f82040a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82000058c0 tx=0x7f8200005850 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.096+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82100bd160 con 0x7f8218102df0 2024-09-11T22:31:06.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.307+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8218107270 con 0x7f8218102df0 2024-09-11T22:31:06.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.308+0000 7f821c921640 1 -- 172.21.15.22:0/4104016090 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7f82100bca60 con 0x7f8218102df0 2024-09-11T22:31:06.309 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:31:06.309 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:31:06.309 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 msgr2=0x7f82040a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 0x7f82040a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82000058c0 tx=0x7f8200005850 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 msgr2=0x7f8218198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8210005cc0 tx=0x7f821002f790 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 shutdown_connections 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f82040a2d70 0x7f82040a5230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821810c190 0x7f821819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8218103710 0x7f8218198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 --2- 172.21.15.22:0/4104016090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8218102df0 0x7f8218198580 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:06.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 >> 172.21.15.22:0/4104016090 conn(0x7f82180fc7d0 msgr2=0x7f82180fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 shutdown_connections 2024-09-11T22:31:06.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:06.310+0000 7f821d923640 1 -- 172.21.15.22:0/4104016090 wait complete. 2024-09-11T22:31:06.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:06 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4104016090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:06.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:06 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4104016090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:06.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:06 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4104016090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:06.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:31:07.256 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:07.629 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:07 smithi022 ceph-mon[30966]: pgmap v65: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.48k op/s 2024-09-11T22:31:07.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 -- 172.21.15.22:0/2085512911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4103660 msgr2=0x7f01f410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 --2- 172.21.15.22:0/2085512911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4103660 0x7f01f410bb50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802a480 comp rx=0 tx=0).stop 2024-09-11T22:31:07.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 -- 172.21.15.22:0/2085512911 shutdown_connections 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 --2- 172.21.15.22:0/2085512911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f410c170 0x7f01f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 --2- 172.21.15.22:0/2085512911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4103660 0x7f01f410bb50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 --2- 172.21.15.22:0/2085512911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f4102d40 0x7f01f4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 -- 172.21.15.22:0/2085512911 >> 172.21.15.22:0/2085512911 conn(0x7f01f40fc7a0 msgr2=0x7f01f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 -- 172.21.15.22:0/2085512911 shutdown_connections 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.712+0000 7f01f9b20640 1 -- 172.21.15.22:0/2085512911 wait complete. 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.713+0000 7f01f9b20640 1 Processor -- start 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.713+0000 7f01f9b20640 1 -- start start 2024-09-11T22:31:07.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.713+0000 7f01f9b20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.713+0000 7f01f9b20640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f4103660 0x7f01f4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f410c170 0x7f01f419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41120f0 con 0x7f01f4102d40 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4111f70 con 0x7f01f4103660 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4112270 con 0x7f01f410c170 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57620/0 (socket says 172.21.15.22:57620) 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 -- 172.21.15.22:0/3750361400 learned_addr learned my addr 172.21.15.22:0/3750361400 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f4103660 0x7f01f4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f410c170 0x7f01f419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 -- 172.21.15.22:0/3750361400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f410c170 msgr2=0x7f01f419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f410c170 0x7f01f419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 -- 172.21.15.22:0/3750361400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f4103660 msgr2=0x7f01f4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f4103660 0x7f01f4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 -- 172.21.15.22:0/3750361400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f419d540 con 0x7f01f4102d40 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f37fe640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b4a0 tx=0x7f01e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f0ff9640 1 -- 172.21.15.22:0/3750361400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4014070 con 0x7f01f4102d40 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f419d830 con 0x7f01f4102d40 2024-09-11T22:31:07.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f0ff9640 1 -- 172.21.15.22:0/3750361400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e4010b10 con 0x7f01f4102d40 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f0ff9640 1 -- 172.21.15.22:0/3750361400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4017d60 con 0x7f01f4102d40 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.714+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f41a5110 con 0x7f01f4102d40 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.717+0000 7f01f0ff9640 1 -- 172.21.15.22:0/3750361400 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f01e4017070 con 0x7f01f4102d40 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.717+0000 7f01fbef9740 1 Processor -- start 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 -- start start 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 0x5593a0ec1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 0x5593a0ec1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ece760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5593a0e272f0 con 0x5593a0ec15d0 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5593a0dcecf0 con 0x5593a0ec2b40 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01fbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5593a0e232b0 con 0x5593a0ecc370 2024-09-11T22:31:07.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 0x5593a0ec1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 0x5593a0ec1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 0x5593a0ec1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57630/0 (socket says 172.21.15.22:57630) 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f37fe640 1 -- 172.21.15.22:0/3084647919 learned_addr learned my addr 172.21.15.22:0/3084647919 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f0ff9640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 0x7f01dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ece760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 -- 172.21.15.22:0/3084647919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 msgr2=0x5593a0ece760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ece760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 -- 172.21.15.22:0/3084647919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 msgr2=0x5593a0ec1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 0x5593a0ec1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.718+0000 7f01f3fff640 1 -- 172.21.15.22:0/3084647919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a0db33a0 con 0x5593a0ec2b40 2024-09-11T22:31:07.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01f0ff9640 1 -- 172.21.15.22:0/3750361400 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f01e40ce700 con 0x7f01f4102d40 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 0x7f01dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 0x5593a0ec1090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009fa0 tx=0x7f01ec010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b4342b2cc954b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01d9ffb640 1 -- 172.21.15.22:0/3084647919 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec01c900 con 0x5593a0ec2b40 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01f3fff640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 0x7f01dc0a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01ec020000 tx=0x7f01ec01d000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01d9ffb640 1 -- 172.21.15.22:0/3084647919 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01ec0113e0 con 0x5593a0ec2b40 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.719+0000 7f01d9ffb640 1 -- 172.21.15.22:0/3084647919 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec01b630 con 0x5593a0ec2b40 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- 172.21.15.22:0/3084647919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 msgr2=0x5593a0ec1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 0x5593a0ec1090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009fa0 tx=0x7f01ec010800 comp rx=0 tx=0).stop 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- 172.21.15.22:0/3084647919 shutdown_connections 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ece760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec15d0 0x5593a0ec1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 --2- 172.21.15.22:0/3084647919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec2b40 0x5593a0ec1090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- 172.21.15.22:0/3084647919 >> 172.21.15.22:0/3084647919 conn(0x5593a0e8a310 msgr2=0x5593a0ebdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- 172.21.15.22:0/3084647919 shutdown_connections 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- 172.21.15.22:0/3084647919 wait complete. 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 -- start start 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.720+0000 7f01fbef9740 1 Processor -- start 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ecbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ec9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5593a0ecf070 con 0x5593a0ec2b40 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5593a0de2060 con 0x5593a0ec15d0 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5593a0ecf1f0 con 0x5593a0ecc370 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01fbef9740 10 client.0 _ll_register_callbacks cb 0x5593a0b358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ec9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ecbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ec9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57634/0 (socket says 172.21.15.22:57634) 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f2ffd640 1 -- 172.21.15.22:0/821574013 learned_addr learned my addr 172.21.15.22:0/821574013 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f3fff640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 -- 172.21.15.22:0/821574013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 msgr2=0x5593a0ec97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 -- 172.21.15.22:0/821574013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 msgr2=0x5593a0ec9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ec9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 -- 172.21.15.22:0/821574013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a0b983c0 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01f37fe640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ecbda0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01e4097750 tx=0x7f01e40d4240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29cd12b285d96d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.721+0000 7f01d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e401e070 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f01e4097470 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01ec0113e0 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e409b480 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 10 client.25406 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5593a0edab50 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01ec0113e0 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01e40b1050 con 0x5593a0ec15d0 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 10 client.25406 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 10 client.25406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 20 client.25406 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:07.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0edbf60 0x5593a0ede3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 4 client.25406 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.722+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593a0e34860 con 0x5593a0edbf60 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.723+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0edbf60 0x5593a0ede3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.723+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0edbf60 0x5593a0ede3d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a83927dfe013c75 server_cookie=3343b97f7980953d in_seq=0 out_seq=0 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.723+0000 7f01d2ffd640 10 client.25406 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01d2ffd640 1 -- 172.21.15.22:0/821574013 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593a0e34860 con 0x5593a0edbf60 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01d2ffd640 10 client.25406 handle_command_reply: tid=0 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 client.25406 shutdown 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 msgr2=0x5593a0ecbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ecbda0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f01e4097750 tx=0x7f01e40d4240 comp rx=0 tx=0).stop 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 shutdown_connections 2024-09-11T22:31:07.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0edbf60 0x5593a0ede3d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ec9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 --2- 172.21.15.22:0/821574013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ecbda0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01d2ffd640 0 client.25406 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 >> 172.21.15.22:0/821574013 conn(0x5593a0e8a310 msgr2=0x5593a0ec3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 shutdown_connections 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 1 -- 172.21.15.22:0/821574013 wait complete. 2024-09-11T22:31:07.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.724+0000 7f01fbef9740 20 client.25406 trim_cache size 0 max 16384 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 Processor -- start 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 -- start start 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ed4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41ab8c0 con 0x5593a0ec2b40 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41ae140 con 0x5593a0ec15d0 2024-09-11T22:31:07.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01fbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41abf30 con 0x5593a0ecc370 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57648/0 (socket says 172.21.15.22:57648) 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.737+0000 7f01f2ffd640 1 -- 172.21.15.22:0/2242673213 learned_addr learned my addr 172.21.15.22:0/2242673213 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 -- 172.21.15.22:0/2242673213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 msgr2=0x5593a0ec4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 -- 172.21.15.22:0/2242673213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 msgr2=0x5593a0ed4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f37fe640 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ed4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ed4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 -- 172.21.15.22:0/2242673213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a0ede740 con 0x5593a0ec2b40 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e8031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6aca7b1c7c7b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01d97fa640 1 -- 172.21.15.22:0/2242673213 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8035040 con 0x5593a0ec2b40 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01d97fa640 1 -- 172.21.15.22:0/2242673213 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e8005540 con 0x5593a0ec2b40 2024-09-11T22:31:07.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.738+0000 7f01d97fa640 1 -- 172.21.15.22:0/2242673213 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004ce0 con 0x5593a0ec2b40 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- 172.21.15.22:0/2242673213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 msgr2=0x5593a0ed4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e8031ae0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- 172.21.15.22:0/2242673213 shutdown_connections 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0ec4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0ed4da0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 --2- 172.21.15.22:0/2242673213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0ed4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- 172.21.15.22:0/2242673213 >> 172.21.15.22:0/2242673213 conn(0x5593a0e8a310 msgr2=0x5593a0ec8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- 172.21.15.22:0/2242673213 shutdown_connections 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- 172.21.15.22:0/2242673213 wait complete. 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 -- start start 2024-09-11T22:31:07.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.739+0000 7f01fbef9740 1 Processor -- start 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0f3ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0f3f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41ac600 con 0x5593a0ec2b40 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41ada70 con 0x5593a0ec15d0 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41accd0 con 0x5593a0ecc370 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01fbef9740 10 client.0 _ll_register_callbacks cb 0x7f01e40969e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57656/0 (socket says 172.21.15.22:57656) 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 -- 172.21.15.22:0/91802519 learned_addr learned my addr 172.21.15.22:0/91802519 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f37fe640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0f3ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 -- 172.21.15.22:0/91802519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 msgr2=0x5593a0f3f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0f3f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 -- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 msgr2=0x5593a0f3ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0f3ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 -- 172.21.15.22:0/91802519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a0f49d30 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01f2ffd640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a9a0 tx=0x7f01e8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5075a3d5f4d936fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.740+0000 7f01d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8035040 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f01e8004050 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e8005540 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e8004750 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 10 client.15726 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5593a0f4b010 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e8005540 con 0x5593a0ec2b40 2024-09-11T22:31:07.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01e80473d0 con 0x5593a0ec2b40 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 10 client.15726 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 20 client.15726 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0f4b6e0 0x5593a0f4db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 4 client.15726 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.741+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593a0e2ed70 con 0x5593a0f4b6e0 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01f37fe640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0f4b6e0 0x5593a0f4db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01f37fe640 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0f4b6e0 0x5593a0f4db00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e57f905b9dc24a7e server_cookie=f0e772b2129c06b2 in_seq=0 out_seq=0 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01d2ffd640 10 client.15726 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01d2ffd640 1 -- 172.21.15.22:0/91802519 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593a0e2ed70 con 0x5593a0f4b6e0 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01d2ffd640 10 client.15726 handle_command_reply: tid=0 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 client.15726 shutdown 2024-09-11T22:31:07.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 msgr2=0x5593a0f3f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f01e802a9a0 tx=0x7f01e8005270 comp rx=0 tx=0).stop 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 shutdown_connections 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5593a0f4b6e0 0x5593a0f4db00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5593a0ecc370 0x5593a0f3f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5593a0ec2b40 0x5593a0f3f170 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01d2ffd640 0 client.15726 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.742+0000 7f01fbef9740 1 --2- 172.21.15.22:0/91802519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593a0ec15d0 0x5593a0f3ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 >> 172.21.15.22:0/91802519 conn(0x5593a0e8a310 msgr2=0x5593a0ed7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 shutdown_connections 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01fbef9740 1 -- 172.21.15.22:0/91802519 wait complete. 2024-09-11T22:31:07.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01fbef9740 20 client.15726 trim_cache size 0 max 16384 2024-09-11T22:31:07.750 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:31:07.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 msgr2=0x7f01dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 0x7f01dc0a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01ec020000 tx=0x7f01ec01d000 comp rx=0 tx=0).stop 2024-09-11T22:31:07.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 msgr2=0x7f01f4198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:07.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b4a0 tx=0x7f01e400b960 comp rx=0 tx=0).stop 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 shutdown_connections 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f01dc0a2cf0 0x7f01dc0a51b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01f410c170 0x7f01f419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01f4103660 0x7f01f4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 --2- 172.21.15.22:0/3750361400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f4102d40 0x7f01f4198590 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.743+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 >> 172.21.15.22:0/3750361400 conn(0x7f01f40fc7a0 msgr2=0x7f01f40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.744+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 shutdown_connections 2024-09-11T22:31:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:07.744+0000 7f01f9b20640 1 -- 172.21.15.22:0/3750361400 wait complete. 2024-09-11T22:31:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:07 smithi169 ceph-mon[35628]: pgmap v65: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.48k op/s 2024-09-11T22:31:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:07 smithi045 ceph-mon[35556]: pgmap v65: 97 pgs: 97 active+clean; 161 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.48k op/s 2024-09-11T22:31:09.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:31:09.313 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:09.451 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:31:09.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:31:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:09 smithi022 ceph-mon[30966]: pgmap v66: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.50k op/s 2024-09-11T22:31:09.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 -- 172.21.15.22:0/1886441448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe710102d40 msgr2=0x7fe710103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:09.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 --2- 172.21.15.22:0/1886441448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe710102d40 0x7fe710103120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe700009900 tx=0x7fe70002a480 comp rx=0 tx=0).stop 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 -- 172.21.15.22:0/1886441448 shutdown_connections 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 --2- 172.21.15.22:0/1886441448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe71010c170 0x7fe71010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 --2- 172.21.15.22:0/1886441448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 0x7fe71010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 --2- 172.21.15.22:0/1886441448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe710102d40 0x7fe710103120 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 -- 172.21.15.22:0/1886441448 >> 172.21.15.22:0/1886441448 conn(0x7fe7100fc7a0 msgr2=0x7fe7100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 -- 172.21.15.22:0/1886441448 shutdown_connections 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.836+0000 7fe71547a640 1 -- 172.21.15.22:0/1886441448 wait complete. 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 Processor -- start 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 -- start start 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe710102d40 0x7fe7101009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 0x7fe710100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:09.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe710112140 con 0x7fe71010c170 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe710111fc0 con 0x7fe710102d40 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.837+0000 7fe71547a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe7101122c0 con 0x7fe710103660 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57680/0 (socket says 172.21.15.22:57680) 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 -- 172.21.15.22:0/1158847696 learned_addr learned my addr 172.21.15.22:0/1158847696 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70effd640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe710102d40 0x7fe7101009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70e7fc640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 0x7fe710100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 -- 172.21.15.22:0/1158847696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 msgr2=0x7fe710100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 0x7fe710100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 -- 172.21.15.22:0/1158847696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe710102d40 msgr2=0x7fe7101009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe710102d40 0x7fe7101009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 -- 172.21.15.22:0/1158847696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7101aaf10 con 0x7fe71010c170 2024-09-11T22:31:09.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe70f7fe640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe70800eaa0 tx=0x7fe70800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70800cdb0 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7101ab140 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe708004b20 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708011760 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.838+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7101ab630 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.839+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71006b070 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.841+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe708011900 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.842+0000 7fe6f7fff640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 0x7fe6f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.842+0000 7fe70effd640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 0x7fe6f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.842+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe7080cfb20 con 0x7fe71010c170 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.842+0000 7fe70effd640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 0x7fe6f80a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe700000c00 tx=0x7fe700005e80 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:09.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:09.845+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe708016030 con 0x7fe71010c170 2024-09-11T22:31:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:09 smithi169 ceph-mon[35628]: pgmap v66: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.50k op/s 2024-09-11T22:31:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:09 smithi045 ceph-mon[35556]: pgmap v66: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 1.50k op/s 2024-09-11T22:31:09.953 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:10.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.070+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe710103120 con 0x7fe71010c170 2024-09-11T22:31:10.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.071+0000 7fe6f7fff640 1 -- 172.21.15.22:0/1158847696 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11838 (secure 0 0 0) 0x7fe710103120 con 0x7fe71010c170 2024-09-11T22:31:10.073 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:31:10.073 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"btime":"2024-09-11T22:27:34:215280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:27:33.502987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/1224562712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1224562712},{"type":"v1","addr":"172.21.15.45:6837","nonce":1224562712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:31:10.073 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 20 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 msgr2=0x7fe6f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 0x7fe6f80a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe700000c00 tx=0x7fe700005e80 comp rx=0 tx=0).stop 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 msgr2=0x7fe710101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe70800eaa0 tx=0x7fe70800ef60 comp rx=0 tx=0).stop 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 shutdown_connections 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe6f80a2cf0 0x7fe6f80a51b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe71010c170 0x7fe710101420 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:10.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe710103660 0x7fe710100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:10.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 --2- 172.21.15.22:0/1158847696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe710102d40 0x7fe7101009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:10.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.073+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 >> 172.21.15.22:0/1158847696 conn(0x7fe7100fc7a0 msgr2=0x7fe7100fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:10.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.074+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 shutdown_connections 2024-09-11T22:31:10.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:10.074+0000 7fe71547a640 1 -- 172.21.15.22:0/1158847696 wait complete. 2024-09-11T22:31:10.771 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:10 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1158847696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:10.771 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:10 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:10.804 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id a8bf226a --release --await' 2024-09-11T22:31:10.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id a8bf226a --release --await 2024-09-11T22:31:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:10 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1158847696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:10 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:10 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1158847696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:10 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 -- 172.21.15.22:0/3486866380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40100e20 msgr2=0x7f7d40101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 --2- 172.21.15.22:0/3486866380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40100e20 0x7f7d40101200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009900 tx=0x7f7d3002c690 comp rx=0 tx=0).stop 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 -- 172.21.15.22:0/3486866380 shutdown_connections 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 --2- 172.21.15.22:0/3486866380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40102ef0 0x7f7d4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 --2- 172.21.15.22:0/3486866380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102570 0x7f7d401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 --2- 172.21.15.22:0/3486866380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40100e20 0x7f7d40101200 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 -- 172.21.15.22:0/3486866380 >> 172.21.15.22:0/3486866380 conn(0x7f7d400fc7d0 msgr2=0x7f7d400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 -- 172.21.15.22:0/3486866380 shutdown_connections 2024-09-11T22:31:11.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.102+0000 7f7d45c48640 1 -- 172.21.15.22:0/3486866380 wait complete. 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 Processor -- start 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 -- start start 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40100e20 0x7f7d401a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40102570 0x7f7d401a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4010ffa0 con 0x7f7d40102570 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4010fe20 con 0x7f7d40100e20 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.103+0000 7f7d45c48640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d40110120 con 0x7f7d40102ef0 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40100e20 0x7f7d401a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:35498/0 (socket says 172.21.15.22:35498) 2024-09-11T22:31:11.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 -- 172.21.15.22:0/379781053 learned_addr learned my addr 172.21.15.22:0/379781053 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3effd640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40102570 0x7f7d401a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 -- 172.21.15.22:0/379781053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40100e20 msgr2=0x7f7d401a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40100e20 0x7f7d401a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 -- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40102570 msgr2=0x7f7d401a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40102570 0x7f7d401a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 -- 172.21.15.22:0/379781053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4019ad30 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800eb10 tx=0x7f7d3800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3cff9640 1 -- 172.21.15.22:0/379781053 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38004b20 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d3cff9640 1 -- 172.21.15.22:0/379781053 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d38004cc0 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.104+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4019b020 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.105+0000 7f7d3cff9640 1 -- 172.21.15.22:0/379781053 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380107f0 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.105+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d401a7310 con 0x7f7d40102ef0 2024-09-11T22:31:11.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.107+0000 7f7d3cff9640 1 -- 172.21.15.22:0/379781053 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7d38005020 con 0x7f7d40102ef0 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d3cff9640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 0x7f7d280a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d3cff9640 1 -- 172.21.15.22:0/379781053 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7d380cf9c0 con 0x7f7d40102ef0 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 0x7f7d280a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d48021740 1 Processor -- start 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d48021740 1 -- start start 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 0x7f7d280a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009230 tx=0x7f7d300058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d48021740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec3103f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d48021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.108+0000 7f7d48021740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d48021740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aec3069280 con 0x55aec3103b60 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d48021740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aec3010b10 con 0x55aec310ed40 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d48021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aec3065240 con 0x55aec3104480 2024-09-11T22:31:11.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec3103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:59036/0 (socket says 172.21.15.22:59036) 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 -- 172.21.15.22:0/427202475 learned_addr learned my addr 172.21.15.22:0/427202475 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3effd640 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 -- 172.21.15.22:0/427202475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 msgr2=0x55aec310e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 -- 172.21.15.22:0/427202475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 msgr2=0x55aec3103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec3103f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 -- 172.21.15.22:0/427202475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec301d1f0 con 0x55aec310ed40 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec3103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:11.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d380a4610 tx=0x7f7d38098240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e480679c4226839d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.109+0000 7f7d25ffb640 1 -- 172.21.15.22:0/427202475 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b4020 con 0x55aec310ed40 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d25ffb640 1 -- 172.21.15.22:0/427202475 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d3809c5d0 con 0x55aec310ed40 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d25ffb640 1 -- 172.21.15.22:0/427202475 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38098540 con 0x55aec310ed40 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 -- 172.21.15.22:0/427202475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 msgr2=0x55aec3111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d380a4610 tx=0x7f7d38098240 comp rx=0 tx=0).stop 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 -- 172.21.15.22:0/427202475 shutdown_connections 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec310ed40 0x55aec3111130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 --2- 172.21.15.22:0/427202475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec3103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 -- 172.21.15.22:0/427202475 >> 172.21.15.22:0/427202475 conn(0x55aec31000f0 msgr2=0x55aec31004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 -- 172.21.15.22:0/427202475 shutdown_connections 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.110+0000 7f7d48021740 1 -- 172.21.15.22:0/427202475 wait complete. 2024-09-11T22:31:11.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.111+0000 7f7d48021740 1 -- start start 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.111+0000 7f7d48021740 1 Processor -- start 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3103b60 0x55aec310e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aec3111910 con 0x55aec310ed40 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aec3023f10 con 0x55aec3103b60 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aec3111a90 con 0x55aec3104480 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 10 client.0 _ll_register_callbacks cb 0x55aec2feca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57708/0 (socket says 172.21.15.22:57708) 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 -- 172.21.15.22:0/2547809211 learned_addr learned my addr 172.21.15.22:0/2547809211 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3103b60 0x55aec310e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 -- 172.21.15.22:0/2547809211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 msgr2=0x55aec310bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 -- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3103b60 msgr2=0x55aec310e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3103b60 0x55aec310e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 -- 172.21.15.22:0/2547809211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec2dda6a0 con 0x55aec310ed40 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7d380049d0 tx=0x7f7d3809bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2661d06b25edaa99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b4070 con 0x55aec310ed40 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7d380a46b0 con 0x55aec310ed40 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.112+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d3809c5d0 con 0x55aec310ed40 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7d380a48b0 con 0x55aec310ed40 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 10 client.15744 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:11.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aec311d440 con 0x55aec310ed40 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d3809c5d0 con 0x55aec310ed40 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7d380baba0 con 0x55aec310ed40 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 10 client.15744 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 20 client.15744 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec3120b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 4 client.15744 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aec30767f0 con 0x55aec311e790 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.113+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec3120b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.114+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec3120b80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f88bf3697656aa server_cookie=3ad56314b36322b8 in_seq=0 out_seq=0 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.114+0000 7f7d1effd640 10 client.15744 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.114+0000 7f7d1effd640 1 -- 172.21.15.22:0/2547809211 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aec30767f0 con 0x55aec311e790 2024-09-11T22:31:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.114+0000 7f7d1effd640 10 client.15744 handle_command_reply: tid=0 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.114+0000 7f7d48021740 1 client.15744 shutdown 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 msgr2=0x55aec310c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7d380049d0 tx=0x7f7d3809bb10 comp rx=0 tx=0).stop 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 shutdown_connections 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec3120b80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec310c2e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d1effd640 0 client.15744 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3104480 0x55aec310bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 --2- 172.21.15.22:0/2547809211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3103b60 0x55aec310e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 >> 172.21.15.22:0/2547809211 conn(0x55aec31000f0 msgr2=0x55aec3105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 shutdown_connections 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 1 -- 172.21.15.22:0/2547809211 wait complete. 2024-09-11T22:31:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.115+0000 7f7d48021740 20 client.15744 trim_cache size 0 max 16384 2024-09-11T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 Processor -- start 2024-09-11T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 -- start start 2024-09-11T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3103b60 0x55aec310ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec3126120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401ada60 con 0x55aec310ed40 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401b02e0 con 0x55aec3104480 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d48021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401ae0d0 con 0x55aec3103b60 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57722/0 (socket says 172.21.15.22:57722) 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d3ffff640 1 -- 172.21.15.22:0/3719901398 learned_addr learned my addr 172.21.15.22:0/3719901398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d3effd640 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec3126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.134+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3103b60 0x55aec310ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 -- 172.21.15.22:0/3719901398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3103b60 msgr2=0x55aec310ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3103b60 0x55aec310ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 -- 172.21.15.22:0/3719901398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 msgr2=0x55aec3126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec3126120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 -- 172.21.15.22:0/3719901398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec30fb830 con 0x55aec310ed40 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d3809bbd0 tx=0x7f7d38005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d6402574c3067f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d257fa640 1 -- 172.21.15.22:0/3719901398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b4070 con 0x55aec310ed40 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d257fa640 1 -- 172.21.15.22:0/3719901398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d3807f070 con 0x55aec310ed40 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.135+0000 7f7d257fa640 1 -- 172.21.15.22:0/3719901398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380850d0 con 0x55aec310ed40 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- 172.21.15.22:0/3719901398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 msgr2=0x55aec3126660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d3809bbd0 tx=0x7f7d38005990 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- 172.21.15.22:0/3719901398 shutdown_connections 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec310ed40 0x55aec3126660 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec3126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 --2- 172.21.15.22:0/3719901398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec3103b60 0x55aec310ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- 172.21.15.22:0/3719901398 >> 172.21.15.22:0/3719901398 conn(0x55aec31000f0 msgr2=0x55aec310a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- 172.21.15.22:0/3719901398 shutdown_connections 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- 172.21.15.22:0/3719901398 wait complete. 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.136+0000 7f7d48021740 1 -- start start 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 Processor -- start 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec31088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec310ed40 0x55aec3108e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401ae7a0 con 0x55aec3103b60 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401afc10 con 0x55aec3104480 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401aee70 con 0x55aec310ed40 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d48021740 10 client.0 _ll_register_callbacks cb 0x7f7d3809bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57738/0 (socket says 172.21.15.22:57738) 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 -- 172.21.15.22:0/2796626441 learned_addr learned my addr 172.21.15.22:0/2796626441 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec31088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3ffff640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec310ed40 0x55aec3108e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 -- 172.21.15.22:0/2796626441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec310ed40 msgr2=0x55aec3108e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec310ed40 0x55aec3108e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 -- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 msgr2=0x55aec31088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec31088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3f7fe640 1 -- 172.21.15.22:0/2796626441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec310eb70 con 0x55aec3103b60 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.137+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec31088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d3f7fe640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d30033690 tx=0x7f7d3002c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4668c2ef760a368d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30060070 con 0x55aec3103b60 2024-09-11T22:31:11.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7d3005cc40 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d3807f070 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7d3006c050 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d48021740 10 client.15750 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aec3188fa0 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d3807f070 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7d3003d600 con 0x55aec3103b60 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.138+0000 7f7d48021740 10 client.15750 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d48021740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d48021740 20 client.15750 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec318b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d48021740 4 client.15750 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aec3070d00 con 0x55aec311e790 2024-09-11T22:31:11.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec318b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d3effd640 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec318b740 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fb5a96a204d78c server_cookie=58bf41d605faeb7d in_seq=0 out_seq=0 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.139+0000 7f7d1effd640 10 client.15750 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.140+0000 7f7d1effd640 1 -- 172.21.15.22:0/2796626441 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aec3070d00 con 0x55aec311e790 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.140+0000 7f7d1effd640 10 client.15750 handle_command_reply: tid=0 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.140+0000 7f7d48021740 1 client.15750 shutdown 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 msgr2=0x55aec31173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d30033690 tx=0x7f7d3002c690 comp rx=0 tx=0).stop 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 shutdown_connections 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55aec311e790 0x55aec318b740 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d1effd640 0 client.15750 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aec310ed40 0x55aec3108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aec3104480 0x55aec31088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 --2- 172.21.15.22:0/2796626441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aec3103b60 0x55aec31173f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 >> 172.21.15.22:0/2796626441 conn(0x55aec31000f0 msgr2=0x55aec310ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 shutdown_connections 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 1 -- 172.21.15.22:0/2796626441 wait complete. 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.141+0000 7f7d48021740 20 client.15750 trim_cache size 0 max 16384 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "014d5a67-51a6-4a2b-b2fe-de1dd71b35de", 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:31:11.152 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 msgr2=0x7f7d280a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 0x7f7d280a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009230 tx=0x7f7d300058d0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 msgr2=0x7f7d4019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800eb10 tx=0x7f7d3800c2d0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 shutdown_connections 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d280a2d70 0x7f7d280a5230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d40102ef0 0x7f7d4019a600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d40102570 0x7f7d401a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 --2- 172.21.15.22:0/379781053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d40100e20 0x7f7d401a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:11.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 >> 172.21.15.22:0/379781053 conn(0x7f7d400fc7d0 msgr2=0x7f7d400fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:11.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 shutdown_connections 2024-09-11T22:31:11.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:11.142+0000 7f7d45c48640 1 -- 172.21.15.22:0/379781053 wait complete. 2024-09-11T22:31:11.801 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:11.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: pgmap v67: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.074 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:12.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:12.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: pgmap v67: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:12.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: pgmap v67: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:12.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:12.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:31:12.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 -- 172.21.15.22:0/1006566428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20100a70 msgr2=0x7f5f2010ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 --2- 172.21.15.22:0/1006566428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20100a70 0x7f5f2010ea60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009ca0 tx=0x7f5f1802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 -- 172.21.15.22:0/1006566428 shutdown_connections 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 --2- 172.21.15.22:0/1006566428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20100a70 0x7f5f2010ea60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 --2- 172.21.15.22:0/1006566428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 --2- 172.21.15.22:0/1006566428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20106ba0 0x7f5f20106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 -- 172.21.15.22:0/1006566428 >> 172.21.15.22:0/1006566428 conn(0x7f5f20077210 msgr2=0x7f5f200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 -- 172.21.15.22:0/1006566428 shutdown_connections 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.293+0000 7f5f28115640 1 -- 172.21.15.22:0/1006566428 wait complete. 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 Processor -- start 2024-09-11T22:31:12.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 -- start start 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20100a70 0x7f5f20198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201121f0 con 0x7f5f20106ba0 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20112070 con 0x7f5f20100a70 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f28115640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20112370 con 0x7f5f201000d0 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f266b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f266b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57760/0 (socket says 172.21.15.22:57760) 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f266b2640 1 -- 172.21.15.22:0/1205101695 learned_addr learned my addr 172.21.15.22:0/1205101695 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20100a70 0x7f5f20198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.294+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 -- 172.21.15.22:0/1205101695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 msgr2=0x7f5f20198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 -- 172.21.15.22:0/1205101695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20100a70 msgr2=0x7f5f20198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20100a70 0x7f5f20198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 -- 172.21.15.22:0/1205101695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2019d640 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f266b2640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005e30 tx=0x7f5f18003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f16ffd640 1 -- 172.21.15.22:0/1205101695 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f180316d0 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f16ffd640 1 -- 172.21.15.22:0/1205101695 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f18031870 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2019d8d0 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f16ffd640 1 -- 172.21.15.22:0/1205101695 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1802fb80 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.295+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201a5210 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.297+0000 7f5f16ffd640 1 -- 172.21.15.22:0/1205101695 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5f1802fd40 con 0x7f5f20106ba0 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 Processor -- start 2024-09-11T22:31:12.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 -- start start 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace6c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556cacdc2620 con 0x556cace5cf60 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556cacd69e50 con 0x556cace5d880 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556cacdbe5e0 con 0x556cace6c650 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f16ffd640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 0x7f5f0c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f266b2640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 0x7f5f0c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57774/0 (socket says 172.21.15.22:57774) 2024-09-11T22:31:12.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f256b0640 1 -- 172.21.15.22:0/1222336024 learned_addr learned my addr 172.21.15.22:0/1222336024 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f16ffd640 1 -- 172.21.15.22:0/1205101695 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5f180f07c0 con 0x7f5f20106ba0 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace6c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.298+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 -- 172.21.15.22:0/1222336024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 msgr2=0x556cace6ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace6ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 -- 172.21.15.22:0/1222336024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 msgr2=0x556cace6c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace6c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 -- 172.21.15.22:0/1222336024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cacd5ad40 con 0x556cace5cf60 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace6c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f266b2640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 0x7f5f0c0a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f180ee0d0 tx=0x7f5f180b22d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009f50 tx=0x7f5f100095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4729495bb27a568a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f0bfff640 1 -- 172.21.15.22:0/1222336024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000f040 con 0x556cace5cf60 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f0bfff640 1 -- 172.21.15.22:0/1222336024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.299+0000 7f5f0bfff640 1 -- 172.21.15.22:0/1222336024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10015710 con 0x556cace5cf60 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1222336024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 msgr2=0x556cace5d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009f50 tx=0x7f5f100095d0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1222336024 shutdown_connections 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace6ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace6c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1222336024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace5d340 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1222336024 >> 172.21.15.22:0/1222336024 conn(0x556cace595f0 msgr2=0x556cace599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1222336024 shutdown_connections 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1222336024 wait complete. 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.300+0000 7f5f2a4ee740 1 -- start start 2024-09-11T22:31:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 Processor -- start 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5d880 0x556cace69b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace6a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556cace6f220 con 0x556cace5cf60 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556cacd4af10 con 0x556cace6c650 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556cace6f3a0 con 0x556cace5d880 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f2a4ee740 10 client.0 _ll_register_callbacks cb 0x556cacd6edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57782/0 (socket says 172.21.15.22:57782) 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 -- 172.21.15.22:0/2052733698 learned_addr learned my addr 172.21.15.22:0/2052733698 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 -- 172.21.15.22:0/2052733698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5d880 msgr2=0x556cace69b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5d880 0x556cace69b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 -- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 msgr2=0x556cace6a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace6a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.301+0000 7f5f256b0640 1 -- 172.21.15.22:0/2052733698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cacad1580 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f256b0640 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f10006aa0 tx=0x7f5f10017640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c280c7a31f65761e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10025070 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5f10017a40 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5f10031050 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 10 client.15762 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556cacb9b960 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5f100154e0 con 0x556cace5cf60 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 10 client.15762 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 10 client.15762 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 20 client.15762 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:12.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cace7c160 0x556cace7e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 4 client.15762 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.302+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cacdcfb90 con 0x556cace7c160 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.303+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cace7c160 0x556cace7e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.303+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cace7c160 0x556cace7e550 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0918dd965c93b3 server_cookie=f2d0eb1698b44335 in_seq=0 out_seq=0 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.303+0000 7f5f097fa640 10 client.15762 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f097fa640 1 -- 172.21.15.22:0/2052733698 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cacdcfb90 con 0x556cace7c160 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f097fa640 10 client.15762 handle_command_reply: tid=0 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 client.15762 shutdown 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 msgr2=0x556cace695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5f10006aa0 tx=0x7f5f10017640 comp rx=0 tx=0).stop 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 shutdown_connections 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cace7c160 0x556cace7e550 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace6a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5d880 0x556cace69b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f097fa640 0 client.15762 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/2052733698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace695c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 >> 172.21.15.22:0/2052733698 conn(0x556cace595f0 msgr2=0x556cace5f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 shutdown_connections 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/2052733698 wait complete. 2024-09-11T22:31:12.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.304+0000 7f5f2a4ee740 20 client.15762 trim_cache size 0 max 16384 2024-09-11T22:31:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 Processor -- start 2024-09-11T22:31:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 -- start start 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace84250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace66820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201a95b0 con 0x556cace5cf60 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201abe10 con 0x556cace5d880 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201a9c00 con 0x556cace6c650 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.322+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57796/0 (socket says 172.21.15.22:57796) 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 -- 172.21.15.22:0/1165024282 learned_addr learned my addr 172.21.15.22:0/1165024282 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace84250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace66820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 -- 172.21.15.22:0/1165024282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 msgr2=0x556cace66820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace66820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 -- 172.21.15.22:0/1165024282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 msgr2=0x556cace84250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace84250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 -- 172.21.15.22:0/1165024282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cace59420 con 0x556cace5cf60 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f256b0640 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f10011010 tx=0x7f5f10009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5727a166f90dbcc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f0b7fe640 1 -- 172.21.15.22:0/1165024282 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10025040 con 0x556cace5cf60 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.323+0000 7f5f0b7fe640 1 -- 172.21.15.22:0/1165024282 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f0b7fe640 1 -- 172.21.15.22:0/1165024282 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10005d20 con 0x556cace5cf60 2024-09-11T22:31:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1165024282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 msgr2=0x556cace83d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5f10011010 tx=0x7f5f10009d70 comp rx=0 tx=0).stop 2024-09-11T22:31:12.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1165024282 shutdown_connections 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace6c650 0x556cace66820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace5d880 0x556cace84250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/1165024282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5cf60 0x556cace83d10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.324+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1165024282 >> 172.21.15.22:0/1165024282 conn(0x556cace595f0 msgr2=0x556cace67e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.325+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1165024282 shutdown_connections 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.325+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/1165024282 wait complete. 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.325+0000 7f5f2a4ee740 1 -- start start 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.325+0000 7f5f2a4ee740 1 Processor -- start 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 0x556cace70120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace70680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201aa2d0 con 0x556cace5d880 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201ab740 con 0x556cace6c650 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5f201aa9a0 con 0x556cace5cf60 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f2a4ee740 10 client.0 _ll_register_callbacks cb 0x7f5f10009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f25eb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 0x556cace70120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:35592/0 (socket says 172.21.15.22:35592) 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 -- 172.21.15.22:0/3075229482 learned_addr learned my addr 172.21.15.22:0/3075229482 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace70680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 -- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 msgr2=0x556cace70680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace70680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 -- 172.21.15.22:0/3075229482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 msgr2=0x556cace70120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:12.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 0x556cace70120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 -- 172.21.15.22:0/3075229482 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cace70eb0 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 0x556cace70120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.326+0000 7f5f256b0640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f100177d0 tx=0x7f5f100059c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de0bb5802d47f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10005aa0 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5f10005c40 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5f10005e40 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f2a4ee740 10 client.25297 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556cacee6db0 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.327+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f1001c070 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5f10006780 con 0x556cace5cf60 2024-09-11T22:31:12.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 10 client.25297 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 10 client.25297 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 20 client.25297 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cacee7410 0x556cacee9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 4 client.25297 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a8bf226a", "release": true, "await": true}] 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a8bf226a", "release": true, "await": true}) -- 0x556cacdca0a0 con 0x556cacee7410 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.328+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cacee7410 0x556cacee9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:12.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.329+0000 7f5f25eb1640 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cacee7410 0x556cacee9800 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a9cac305d8ba04 server_cookie=798b39a360bf18ae in_seq=0 out_seq=0 2024-09-11T22:31:12.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.329+0000 7f5f097fa640 10 client.25297 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:12.348 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:12.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f097fa640 1 -- 172.21.15.22:0/3075229482 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556cacdca0a0 con 0x556cacee7410 2024-09-11T22:31:12.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f097fa640 10 client.25297 handle_command_reply: tid=0 2024-09-11T22:31:12.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 client.25297 shutdown 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 msgr2=0x556cace74df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f100177d0 tx=0x7f5f100059c0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 shutdown_connections 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556cacee7410 0x556cacee9800 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556cace6c650 0x556cace70680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556cace5d880 0x556cace70120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f097fa640 0 client.25297 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 --2- 172.21.15.22:0/3075229482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cace5cf60 0x556cace74df0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 >> 172.21.15.22:0/3075229482 conn(0x556cace595f0 msgr2=0x556cace69580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 shutdown_connections 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 1 -- 172.21.15.22:0/3075229482 wait complete. 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.553+0000 7f5f2a4ee740 20 client.25297 trim_cache size 0 max 16384 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 20, 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 8, 2024-09-11T22:31:12.557 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "a8bf226a": { 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 8, 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 133.4, 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:31:12.558 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:12.559 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 msgr2=0x7f5f0c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 0x7f5f0c0a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f180ee0d0 tx=0x7f5f180b22d0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 msgr2=0x7f5f2019cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:12.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005e30 tx=0x7f5f18003f90 comp rx=0 tx=0).stop 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 shutdown_connections 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5f0c0a2cf0 0x7f5f0c0a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f20106ba0 0x7f5f2019cf60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20100a70 0x7f5f20198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 --2- 172.21.15.22:0/1205101695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f201000d0 0x7f5f20198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 >> 172.21.15.22:0/1205101695 conn(0x7f5f20077210 msgr2=0x7f5f200fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 shutdown_connections 2024-09-11T22:31:12.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:12.554+0000 7f5f28115640 1 -- 172.21.15.22:0/1205101695 wait complete. 2024-09-11T22:31:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:12 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:31:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:12 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:12 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:31:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:12 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:13.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:12 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:31:13.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:12 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:13.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:12 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:31:13.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:12 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:13.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:12 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:31:13.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:12 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:13.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:12 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:31:13.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:12 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:13.362 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a8bf226a', total seconds elapsed: 17.7 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.551+0000 7f51bc435640 1 -- 172.21.15.22:0/1912990826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b41027a0 msgr2=0x7f51b41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.551+0000 7f51bc435640 1 --2- 172.21.15.22:0/1912990826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b41027a0 0x7f51b41067f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009900 tx=0x7f51a802a410 comp rx=0 tx=0).stop 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 -- 172.21.15.22:0/1912990826 shutdown_connections 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 --2- 172.21.15.22:0/1912990826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4106f20 0x7f51b410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 --2- 172.21.15.22:0/1912990826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b41027a0 0x7f51b41067f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 --2- 172.21.15.22:0/1912990826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b4101df0 0x7f51b41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 -- 172.21.15.22:0/1912990826 >> 172.21.15.22:0/1912990826 conn(0x7f51b40fd8f0 msgr2=0x7f51b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 -- 172.21.15.22:0/1912990826 shutdown_connections 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 -- 172.21.15.22:0/1912990826 wait complete. 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.552+0000 7f51bc435640 1 Processor -- start 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 -- start start 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b41027a0 0x7f51b4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 0x7f51b419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41120a0 con 0x7f51b4106f20 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4111f20 con 0x7f51b41027a0 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51bc435640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4112220 con 0x7f51b4101df0 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 0x7f51b419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b41027a0 0x7f51b4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:35610/0 (socket says 172.21.15.22:35610) 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 -- 172.21.15.22:0/2510530328 learned_addr learned my addr 172.21.15.22:0/2510530328 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 -- 172.21.15.22:0/2510530328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b41027a0 msgr2=0x7f51b4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b41027a0 0x7f51b4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 -- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 msgr2=0x7f51b419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 0x7f51b419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba1d1640 1 -- 172.21.15.22:0/2510530328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b419d4d0 con 0x7f51b4101df0 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.553+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 0x7f51b419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51a400ebc0 tx=0x7f51a400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51b37fe640 1 -- 172.21.15.22:0/2510530328 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4010630 con 0x7f51b4101df0 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b419d7c0 con 0x7f51b4101df0 2024-09-11T22:31:13.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51b37fe640 1 -- 172.21.15.22:0/2510530328 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51a4010cd0 con 0x7f51b4101df0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51b37fe640 1 -- 172.21.15.22:0/2510530328 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4018cf0 con 0x7f51b4101df0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.554+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b41a50a0 con 0x7f51b4101df0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.557+0000 7f51b37fe640 1 -- 172.21.15.22:0/2510530328 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f51a40107d0 con 0x7f51b4101df0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.557+0000 7f51be80e740 1 Processor -- start 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 -- start start 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a6253880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611a61b92e0 con 0x5611a625e680 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a6160ce0 con 0x5611a6253dc0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51be80e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5611a61b52a0 con 0x5611a62534a0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51ba1d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57834/0 (socket says 172.21.15.22:57834) 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 -- 172.21.15.22:0/30831541 learned_addr learned my addr 172.21.15.22:0/30831541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a6253880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b37fe640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 0x7f519c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 -- 172.21.15.22:0/30831541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 msgr2=0x5611a6253880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a6253880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 -- 172.21.15.22:0/30831541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 msgr2=0x5611a625e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51b99d0640 1 -- 172.21.15.22:0/30831541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a6145440 con 0x5611a625e680 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.558+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 0x7f519c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.559+0000 7f51b37fe640 1 -- 172.21.15.22:0/2510530328 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f51a40cfac0 con 0x7f51b4101df0 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.559+0000 7f51b99d0640 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009900 tx=0x7f51a8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccac0340af665493 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.559+0000 7f51b0dea640 1 -- 172.21.15.22:0/30831541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8040070 con 0x5611a625e680 2024-09-11T22:31:13.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.559+0000 7f51b0dea640 1 -- 172.21.15.22:0/30831541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51a8031900 con 0x5611a625e680 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.559+0000 7f51b0dea640 1 -- 172.21.15.22:0/30831541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8035040 con 0x5611a625e680 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- 172.21.15.22:0/30831541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 msgr2=0x5611a6260a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009900 tx=0x7f51a8005bd0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 0x7f519c0a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ac012510 tx=0x7f51ac0046c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- 172.21.15.22:0/30831541 shutdown_connections 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6260a70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- 172.21.15.22:0/30831541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a6253880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- 172.21.15.22:0/30831541 >> 172.21.15.22:0/30831541 conn(0x5611a624fa30 msgr2=0x5611a624fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- 172.21.15.22:0/30831541 shutdown_connections 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- 172.21.15.22:0/30831541 wait complete. 2024-09-11T22:31:13.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- start start 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 Processor -- start 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a625df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5611a6261250 con 0x5611a625e680 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a6174050 con 0x5611a6253dc0 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.560+0000 7f51be80e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5611a62613d0 con 0x5611a62534a0 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51be80e740 10 client.0 _ll_register_callbacks cb 0x5611a61b4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57848/0 (socket says 172.21.15.22:57848) 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 -- 172.21.15.22:0/3587643046 learned_addr learned my addr 172.21.15.22:0/3587643046 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:13.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:59160/0 (socket says 172.21.15.22:59160) 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a625df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 -- 172.21.15.22:0/3587643046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 msgr2=0x5611a625df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a625df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 -- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 msgr2=0x5611a625b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 -- 172.21.15.22:0/3587643046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a5f2a3c0 con 0x5611a625e680 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51b99d0640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00f880 tx=0x7f51ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8509eed80a19e672 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f5199ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac010640 con 0x5611a625e680 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f51ac018050 con 0x5611a625e680 2024-09-11T22:31:13.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.561+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a8031900 con 0x5611a625e680 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51ac0107e0 con 0x5611a625e680 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 10 client.15780 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5611a626cc80 con 0x5611a625e680 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51a8031900 con 0x5611a625e680 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51ac01a070 con 0x5611a625e680 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 10 client.15780 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 20 client.15780 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a626e140 0x5611a62705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 4 client.15780 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611a61c6850 con 0x5611a626e140 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.562+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a626e140 0x5611a62705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.563+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a626e140 0x5611a62705e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd457c1504981087 server_cookie=63403a1d8e4f9314 in_seq=0 out_seq=0 2024-09-11T22:31:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.563+0000 7f5199ffb640 10 client.15780 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.564+0000 7f5199ffb640 1 -- 172.21.15.22:0/3587643046 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611a61c6850 con 0x5611a626e140 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.564+0000 7f5199ffb640 10 client.15780 handle_command_reply: tid=0 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.564+0000 7f51be80e740 1 client.15780 shutdown 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 msgr2=0x5611a625b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00f880 tx=0x7f51ac004730 comp rx=0 tx=0).stop 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 shutdown_connections 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a626e140 0x5611a62705e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a625b780 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f5199ffb640 0 client.15780 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a6253dc0 0x5611a625b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 --2- 172.21.15.22:0/3587643046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a625df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 >> 172.21.15.22:0/3587643046 conn(0x5611a624fa30 msgr2=0x5611a6255710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 shutdown_connections 2024-09-11T22:31:13.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 1 -- 172.21.15.22:0/3587643046 wait complete. 2024-09-11T22:31:13.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.565+0000 7f51be80e740 20 client.15780 trim_cache size 0 max 16384 2024-09-11T22:31:13.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 Processor -- start 2024-09-11T22:31:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 -- start start 2024-09-11T22:31:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a62534a0 0x5611a626a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 0x5611a6256760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41ab810 con 0x5611a625e680 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41ae090 con 0x5611a62534a0 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51be80e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41abe80 con 0x5611a6253dc0 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51ba9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51ba9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57858/0 (socket says 172.21.15.22:57858) 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51ba9d2640 1 -- 172.21.15.22:0/343529708 learned_addr learned my addr 172.21.15.22:0/343529708 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a62534a0 0x5611a626a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51b99d0640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 0x5611a6256760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.583+0000 7f51ba9d2640 1 -- 172.21.15.22:0/343529708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 msgr2=0x5611a6256760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 0x5611a6256760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51ba9d2640 1 -- 172.21.15.22:0/343529708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a62534a0 msgr2=0x5611a626a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a62534a0 0x5611a626a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51ba9d2640 1 -- 172.21.15.22:0/343529708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a6270c60 con 0x5611a625e680 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51b99d0640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 0x5611a6256760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00f850 tx=0x7f51ac005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeaefea80afbd24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f519bfff640 1 -- 172.21.15.22:0/343529708 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac035030 con 0x5611a625e680 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f519bfff640 1 -- 172.21.15.22:0/343529708 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51ac028420 con 0x5611a625e680 2024-09-11T22:31:13.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.584+0000 7f519bfff640 1 -- 172.21.15.22:0/343529708 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0316f0 con 0x5611a625e680 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- 172.21.15.22:0/343529708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 msgr2=0x5611a6275f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00f850 tx=0x7f51ac005fb0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- 172.21.15.22:0/343529708 shutdown_connections 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a625e680 0x5611a6275f00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a6253dc0 0x5611a6256760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 --2- 172.21.15.22:0/343529708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a62534a0 0x5611a626a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- 172.21.15.22:0/343529708 >> 172.21.15.22:0/343529708 conn(0x5611a624fa30 msgr2=0x5611a6256050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- 172.21.15.22:0/343529708 shutdown_connections 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- 172.21.15.22:0/343529708 wait complete. 2024-09-11T22:31:13.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 -- start start 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.585+0000 7f51be80e740 1 Processor -- start 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a62669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a625e680 0x5611a6261f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41ac550 con 0x5611a6253dc0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41ad9c0 con 0x5611a625e680 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f51b41acc20 con 0x5611a62534a0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51be80e740 10 client.0 _ll_register_callbacks cb 0x7f51ac012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57860/0 (socket says 172.21.15.22:57860) 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 -- 172.21.15.22:0/1876979090 learned_addr learned my addr 172.21.15.22:0/1876979090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51ba9d2640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a625e680 0x5611a6261f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a62669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 -- 172.21.15.22:0/1876979090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 msgr2=0x5611a62669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a62669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 -- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a625e680 msgr2=0x5611a6261f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a625e680 0x5611a6261f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 -- 172.21.15.22:0/1876979090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a6262760 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f51b99d0640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009900 tx=0x7f51a8031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49f89fdb9be586c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.586+0000 7f5199ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a804b020 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f51a8004450 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51ac028420 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51a8056050 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 10 client.15786 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5611a62d8b00 con 0x5611a6253dc0 2024-09-11T22:31:13.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51a8009520 con 0x5611a6253dc0 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51a803c900 con 0x5611a6253dc0 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 10 client.15786 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 20 client.15786 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a62d8f50 0x5611a62db340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 4 client.15786 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.587+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f51ac028420 con 0x5611a62d8f50 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.588+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a62d8f50 0x5611a62db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.588+0000 7f5199ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:13.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.588+0000 7f51ba1d1640 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a62d8f50 0x5611a62db340 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49f553caeacc6c24 server_cookie=a05d5c8d215b9971 in_seq=0 out_seq=0 2024-09-11T22:31:13.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f5199ffb640 1 -- 172.21.15.22:0/1876979090 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f51ac028420 con 0x5611a62d8f50 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f5199ffb640 10 client.15786 handle_command_reply: tid=0 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 client.15786 shutdown 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 msgr2=0x5611a6266f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009900 tx=0x7f51a8031bb0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 shutdown_connections 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5611a62d8f50 0x5611a62db340 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a625e680 0x5611a6261f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5611a6253dc0 0x5611a6266f20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 --2- 172.21.15.22:0/1876979090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5611a62534a0 0x5611a62669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 >> 172.21.15.22:0/1876979090 conn(0x5611a624fa30 msgr2=0x5611a625d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.590+0000 7f5199ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 shutdown_connections 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51be80e740 1 -- 172.21.15.22:0/1876979090 wait complete. 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51be80e740 20 client.15786 trim_cache size 0 max 16384 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "014d5a67-51a6-4a2b-b2fe-de1dd71b35de": { 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "014d5a67-51a6-4a2b-b2fe-de1dd71b35de", 2024-09-11T22:31:13.596 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:31:13.597 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:13.597 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:13.597 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:13.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 msgr2=0x7f519c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 0x7f519c0a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ac012510 tx=0x7f51ac0046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 msgr2=0x7f51b4198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51a400ebc0 tx=0x7f51a400c6a0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 shutdown_connections 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f519c0a2cf0 0x7f519c0a51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b4106f20 0x7f51b419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51b41027a0 0x7f51b4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 --2- 172.21.15.22:0/2510530328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f51b4101df0 0x7f51b4198520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.591+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 >> 172.21.15.22:0/2510530328 conn(0x7f51b40fd8f0 msgr2=0x7f51b40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.592+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 shutdown_connections 2024-09-11T22:31:13.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:13.592+0000 7f51bc435640 1 -- 172.21.15.22:0/2510530328 wait complete. 2024-09-11T22:31:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:13 smithi045 ceph-mon[35556]: pgmap v68: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:13.912 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[65385]: *** Caught signal (Segmentation fault) ** 2024-09-11T22:31:13.912 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[65385]: in thread 7f5cfbf99640 thread_name:md_log_replay 2024-09-11T22:31:13.912 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:13 smithi045 podman[68976]: 2024-09-11 22:31:13.673097731 +0000 UTC m=+0.023628838 container died bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T22:31:14.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:13 smithi022 ceph-mon[30966]: pgmap v68: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:13 smithi169 ceph-mon[35628]: pgmap v68: 97 pgs: 97 active+clean; 127 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-11T22:31:14.325 INFO:tasks.cephfs.filesystem:scrub status for tag:014d5a67-51a6-4a2b-b2fe-de1dd71b35de - {'path': '/', 'tag': '014d5a67-51a6-4a2b-b2fe-de1dd71b35de', 'options': 'recursive,force'} 2024-09-11T22:31:14.822 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:14 smithi045 podman[68976]: 2024-09-11 22:31:14.5564046 +0000 UTC m=+0.906935709 container remove bb111e6fd6450257165a182fbfbcb8902cccb2305ba221880b2f80bd32c00883 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:31:14.822 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:14 smithi045 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service: Main process exited, code=exited, status=139/n/a 2024-09-11T22:31:15.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:14 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:31:15.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:14 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:31:15.162 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:14 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:31:15.162 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:14 smithi045 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-09-11T22:31:15.162 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:14 smithi045 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service: Consumed 5.445s CPU time. 2024-09-11T22:31:16.118 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:15 smithi045 ceph-mon[35556]: pgmap v69: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.12k op/s 2024-09-11T22:31:16.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:15 smithi022 ceph-mon[30966]: pgmap v69: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.12k op/s 2024-09-11T22:31:16.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:15 smithi169 ceph-mon[35628]: pgmap v69: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 1.12k op/s 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 -- 172.21.15.22:0/2971554555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630101ad0 msgr2=0x7fb630101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 --2- 172.21.15.22:0/2971554555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630101ad0 0x7fb630101f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb624009930 tx=0x7fb62402a420 comp rx=0 tx=0).stop 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 -- 172.21.15.22:0/2971554555 shutdown_connections 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 --2- 172.21.15.22:0/2971554555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630102470 0x7fb63010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 --2- 172.21.15.22:0/2971554555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630101ad0 0x7fb630101f30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 --2- 172.21.15.22:0/2971554555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630107b70 0x7fb630107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 -- 172.21.15.22:0/2971554555 >> 172.21.15.22:0/2971554555 conn(0x7fb6300fd7d0 msgr2=0x7fb6300ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.497+0000 7fb63645e640 1 -- 172.21.15.22:0/2971554555 shutdown_connections 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.498+0000 7fb63645e640 1 -- 172.21.15.22:0/2971554555 wait complete. 2024-09-11T22:31:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.498+0000 7fb63645e640 1 Processor -- start 2024-09-11T22:31:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.498+0000 7fb63645e640 1 -- start start 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.498+0000 7fb63645e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 0x7fb630198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb63645e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 0x7fb6301989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb63645e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630107b70 0x7fb63019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb63645e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb630112040 con 0x7fb630107b70 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb63645e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb630111ec0 con 0x7fb630102470 2024-09-11T22:31:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb63645e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301121c0 con 0x7fb630101ad0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 0x7fb6301989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 0x7fb630198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb6349fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630107b70 0x7fb63019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 0x7fb6301989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:58736/0 (socket says 172.21.15.22:58736) 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62f7fe640 1 -- 172.21.15.22:0/3472081095 learned_addr learned my addr 172.21.15.22:0/3472081095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 -- 172.21.15.22:0/3472081095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 msgr2=0x7fb6301989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 0x7fb6301989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 -- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630107b70 msgr2=0x7fb63019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630107b70 0x7fb63019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 -- 172.21.15.22:0/3472081095 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63019d460 con 0x7fb630101ad0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.499+0000 7fb62ffff640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 0x7fb630198470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb62000e9f0 tx=0x7fb62000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.500+0000 7fb62d7fa640 1 -- 172.21.15.22:0/3472081095 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62000ccc0 con 0x7fb630101ad0 2024-09-11T22:31:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.500+0000 7fb62d7fa640 1 -- 172.21.15.22:0/3472081095 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb620010930 con 0x7fb630101ad0 2024-09-11T22:31:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.500+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63019d750 con 0x7fb630101ad0 2024-09-11T22:31:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.500+0000 7fb62d7fa640 1 -- 172.21.15.22:0/3472081095 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200189f0 con 0x7fb630101ad0 2024-09-11T22:31:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.500+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6301a4fe0 con 0x7fb630101ad0 2024-09-11T22:31:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.502+0000 7fb62d7fa640 1 -- 172.21.15.22:0/3472081095 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb620010ae0 con 0x7fb630101ad0 2024-09-11T22:31:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.502+0000 7fb6391f8740 1 Processor -- start 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 -- start start 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62d7fa640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 0x7fb6180a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 0x557ffce3aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce45770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62d7fa640 1 -- 172.21.15.22:0/3472081095 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb6200cf680 con 0x7fb630101ad0 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6349fb640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 0x7fb6180a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 0x557ffce480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557ffcd9f2f0 con 0x557ffce3b410 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557ffcd47270 con 0x557ffce3aaf0 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6391f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557ffcd9b2b0 con 0x557ffce45cb0 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce45770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 0x557ffce3aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce45770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46082/0 (socket says 172.21.15.22:46082) 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62f7fe640 1 -- 172.21.15.22:0/1695897705 learned_addr learned my addr 172.21.15.22:0/1695897705 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6349fb640 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 0x557ffce480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 -- 172.21.15.22:0/1695897705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 msgr2=0x557ffce480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 0x557ffce480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 -- 172.21.15.22:0/1695897705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 msgr2=0x557ffce45770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce45770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb62ffff640 1 -- 172.21.15.22:0/1695897705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ffcd46340 con 0x557ffce3aaf0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6349fb640 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 0x557ffce480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.503+0000 7fb6349fb640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 0x7fb6180a5260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb628005fd0 tx=0x7fb628009b10 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb62ffff640 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 0x557ffce3aed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6200ccdc0 tx=0x7fb62009b5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fab3990e62f44a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb6167fc640 1 -- 172.21.15.22:0/1695897705 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200a4800 con 0x557ffce3aaf0 2024-09-11T22:31:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb6167fc640 1 -- 172.21.15.22:0/1695897705 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb620086050 con 0x557ffce3aaf0 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb6167fc640 1 -- 172.21.15.22:0/1695897705 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62009b090 con 0x557ffce3aaf0 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb6391f8740 1 -- 172.21.15.22:0/1695897705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 msgr2=0x557ffce3aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.504+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 0x557ffce3aed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6200ccdc0 tx=0x7fb62009b5a0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- 172.21.15.22:0/1695897705 shutdown_connections 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce45cb0 0x557ffce480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce45770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1695897705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3aaf0 0x557ffce3aed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- 172.21.15.22:0/1695897705 >> 172.21.15.22:0/1695897705 conn(0x557ffce37060 msgr2=0x557ffce37440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- 172.21.15.22:0/1695897705 shutdown_connections 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- 172.21.15.22:0/1695897705 wait complete. 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- start start 2024-09-11T22:31:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 Processor -- start 2024-09-11T22:31:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce42b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce43600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557ffce48880 con 0x557ffce3b410 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557ffcd28290 con 0x557ffce45cb0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.505+0000 7fb6391f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557ffce48a00 con 0x557ffce3aaf0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6391f8740 10 client.0 _ll_register_callbacks cb 0x557ffcd59140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46096/0 (socket says 172.21.15.22:46096) 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 -- 172.21.15.22:0/467867765 learned_addr learned my addr 172.21.15.22:0/467867765 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6349fb640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce43600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62ffff640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce42b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 -- 172.21.15.22:0/467867765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 msgr2=0x557ffce42b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.513 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce42b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 -- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 msgr2=0x557ffce43600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce43600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 -- 172.21.15.22:0/467867765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ffcab2210 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6349fb640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce43600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb624031870 tx=0x7fb6240318a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834065fbe4cf7f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb60f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624035040 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb624004440 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb620086050 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb62404a020 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6391f8740 10 client.15798 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.506+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557ffcb7e620 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb620086050 con 0x557ffce3b410 2024-09-11T22:31:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb6240035f0 con 0x557ffce3b410 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 10 client.15798 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 20 client.15798 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffce55bd0 0x557ffce57ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 4 client.15798 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ffcdaca20 con 0x557ffce55bd0 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb62ffff640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffce55bd0 0x557ffce57ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb62ffff640 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffce55bd0 0x557ffce57ff0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c005b861ef048623 server_cookie=ae280658d2d4208f in_seq=0 out_seq=0 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.507+0000 7fb60f7fe640 10 client.15798 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb60f7fe640 1 -- 172.21.15.22:0/467867765 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ffcdaca20 con 0x557ffce55bd0 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb60f7fe640 10 client.15798 handle_command_reply: tid=0 2024-09-11T22:31:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 client.15798 shutdown 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 msgr2=0x557ffce430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb624031870 tx=0x7fb6240318a0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 shutdown_connections 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffce55bd0 0x557ffce57ff0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce43600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce430c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb60f7fe640 0 client.15798 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 --2- 172.21.15.22:0/467867765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce42b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 >> 172.21.15.22:0/467867765 conn(0x557ffce37060 msgr2=0x557ffce3cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 shutdown_connections 2024-09-11T22:31:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 1 -- 172.21.15.22:0/467867765 wait complete. 2024-09-11T22:31:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.509+0000 7fb6391f8740 20 client.15798 trim_cache size 0 max 16384 2024-09-11T22:31:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 Processor -- start 2024-09-11T22:31:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 -- start start 2024-09-11T22:31:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3b410 0x557ffce43430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ab7b0 con 0x557ffce45cb0 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ae030 con 0x557ffce3b410 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6391f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301abe20 con 0x557ffce3aaf0 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6349fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6349fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46100/0 (socket says 172.21.15.22:46100) 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb6349fb640 1 -- 172.21.15.22:0/1110350396 learned_addr learned my addr 172.21.15.22:0/1110350396 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3b410 0x557ffce43430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.524+0000 7fb62ffff640 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 -- 172.21.15.22:0/1110350396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 msgr2=0x557ffce41430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce41430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 -- 172.21.15.22:0/1110350396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3b410 msgr2=0x557ffce43430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3b410 0x557ffce43430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 -- 172.21.15.22:0/1110350396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ffce48760 con 0x557ffce45cb0 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb6349fb640 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb628012400 tx=0x7fb628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e7df7394617590 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb615ffb640 1 -- 172.21.15.22:0/1110350396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62802a430 con 0x557ffce45cb0 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb615ffb640 1 -- 172.21.15.22:0/1110350396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb628010930 con 0x557ffce45cb0 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.525+0000 7fb615ffb640 1 -- 172.21.15.22:0/1110350396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628021a20 con 0x557ffce45cb0 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- 172.21.15.22:0/1110350396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 msgr2=0x557ffce5d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb628012400 tx=0x7fb628016000 comp rx=0 tx=0).stop 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- 172.21.15.22:0/1110350396 shutdown_connections 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce45cb0 0x557ffce5d8c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce3b410 0x557ffce43430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 --2- 172.21.15.22:0/1110350396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- 172.21.15.22:0/1110350396 >> 172.21.15.22:0/1110350396 conn(0x557ffce37060 msgr2=0x557ffce44c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- 172.21.15.22:0/1110350396 shutdown_connections 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- 172.21.15.22:0/1110350396 wait complete. 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 -- start start 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.526+0000 7fb6391f8740 1 Processor -- start 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce4e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ac4f0 con 0x557ffce3b410 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ad960 con 0x557ffce45cb0 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301acbc0 con 0x557ffce3aaf0 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 10 client.0 _ll_register_callbacks cb 0x7fb624009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46116/0 (socket says 172.21.15.22:46116) 2024-09-11T22:31:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce4e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 -- 172.21.15.22:0/349845521 learned_addr learned my addr 172.21.15.22:0/349845521 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6349fb640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 -- 172.21.15.22:0/349845521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 msgr2=0x557ffce4e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce4e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 -- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 msgr2=0x557ffce3fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce3fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 -- 172.21.15.22:0/349845521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ffce405d0 con 0x557ffce3b410 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb62f7fe640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb624009900 tx=0x7fb624005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1779b80013bf53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb60f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624035070 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb624004440 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.527+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb628010930 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb624055070 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 10 client.15804 fetch_fsmap learned FSMap version 20 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557ffcec0890 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb628010930 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb624004850 con 0x557ffce3b410 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 10 client.15804 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 20 client.15804 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffcec0ff0 0x557ffcec3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 4 client.15804 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:31:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ffcda6d70 con 0x557ffcec0ff0 2024-09-11T22:31:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.528+0000 7fb62ffff640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffcec0ff0 0x557ffcec3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.529+0000 7fb60f7fe640 10 client.15804 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:16.536 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.529+0000 7fb62ffff640 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffcec0ff0 0x557ffcec3410 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=500e5eff7ec58d12 server_cookie=55759e99e42a04c6 in_seq=0 out_seq=0 2024-09-11T22:31:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.751+0000 7fb60f7fe640 1 -- 172.21.15.22:0/349845521 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ffcda6d70 con 0x557ffcec0ff0 2024-09-11T22:31:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb60f7fe640 10 client.15804 handle_command_reply: tid=0 2024-09-11T22:31:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 client.15804 shutdown 2024-09-11T22:31:16.755 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 msgr2=0x557ffce3f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb624009900 tx=0x7fb624005d50 comp rx=0 tx=0).stop 2024-09-11T22:31:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 shutdown_connections 2024-09-11T22:31:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557ffcec0ff0 0x557ffcec3410 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb60f7fe640 0 client.15804 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:16.756 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557ffce45cb0 0x557ffce3fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557ffce3b410 0x557ffce3f860 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 --2- 172.21.15.22:0/349845521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557ffce3aaf0 0x557ffce4e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 >> 172.21.15.22:0/349845521 conn(0x557ffce37060 msgr2=0x557ffce443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 shutdown_connections 2024-09-11T22:31:16.757 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 1 -- 172.21.15.22:0/349845521 wait complete. 2024-09-11T22:31:16.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.752+0000 7fb6391f8740 20 client.15804 trim_cache size 0 max 16384 2024-09-11T22:31:16.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:31:16.758 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:31:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:31:16.759 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:31:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 msgr2=0x7fb6180a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.760 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 0x7fb6180a5260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb628005fd0 tx=0x7fb628009b10 comp rx=0 tx=0).stop 2024-09-11T22:31:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 msgr2=0x7fb630198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 0x7fb630198470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb62000e9f0 tx=0x7fb62000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 shutdown_connections 2024-09-11T22:31:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb6180a2da0 0x7fb6180a5260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.761 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb630107b70 0x7fb63019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb630102470 0x7fb6301989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 --2- 172.21.15.22:0/3472081095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb630101ad0 0x7fb630198470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 >> 172.21.15.22:0/3472081095 conn(0x7fb6300fd7d0 msgr2=0x7fb6300fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 shutdown_connections 2024-09-11T22:31:16.762 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:16.753+0000 7fb63645e640 1 -- 172.21.15.22:0/3472081095 wait complete. 2024-09-11T22:31:18.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:17 smithi022 ceph-mon[30966]: pgmap v70: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 200 KiB/s wr, 381 op/s 2024-09-11T22:31:18.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:17 smithi169 ceph-mon[35628]: pgmap v70: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 200 KiB/s wr, 381 op/s 2024-09-11T22:31:18.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:17 smithi045 ceph-mon[35556]: pgmap v70: 97 pgs: 97 active+clean; 129 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 200 KiB/s wr, 381 op/s 2024-09-11T22:31:20.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:19 smithi022 ceph-mon[30966]: pgmap v71: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.4 MiB/s wr, 665 op/s 2024-09-11T22:31:20.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:19 smithi169 ceph-mon[35628]: pgmap v71: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.4 MiB/s wr, 665 op/s 2024-09-11T22:31:20.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:19 smithi045 ceph-mon[35556]: pgmap v71: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.4 MiB/s wr, 665 op/s 2024-09-11T22:31:22.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:21 smithi022 ceph-mon[30966]: pgmap v72: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:22.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:21 smithi169 ceph-mon[35628]: pgmap v72: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:22.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:21 smithi045 ceph-mon[35556]: pgmap v72: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:22.561 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar xf doc.tar 2024-09-11T22:31:24.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:23 smithi022 ceph-mon[30966]: pgmap v73: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:24.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:23 smithi169 ceph-mon[35628]: pgmap v73: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:24.164 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:23 smithi045 ceph-mon[35556]: pgmap v73: 97 pgs: 97 active+clean; 130 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1.4 MiB/s wr, 643 op/s 2024-09-11T22:31:25.199 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:24 smithi045 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-09-11T22:31:25.199 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:24 smithi045 systemd[1]: Stopped Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:31:25.199 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:24 smithi045 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service: Consumed 5.445s CPU time. 2024-09-11T22:31:25.200 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:24 smithi045 systemd[1]: Starting Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:31:25.200 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 podman[69078]: 2024-09-11 22:31:25.043150207 +0000 UTC m=+0.017565390 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:31:25.200 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 podman[69078]: 2024-09-11 22:31:25.199202787 +0000 UTC m=+0.173617960 container create 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T22:31:25.466 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 podman[69078]: 2024-09-11 22:31:25.435311406 +0000 UTC m=+0.409726571 container init 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T22:31:25.467 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 podman[69078]: 2024-09-11 22:31:25.438492992 +0000 UTC m=+0.412908157 container start 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T22:31:25.885 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 ceph-mds[69096]: -- 172.21.15.45:0/256087165 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55697bacb860 con 0x55697baa8800 2024-09-11T22:31:25.885 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: starting mds.h at 2024-09-11T22:31:25.885 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 bash[69078]: 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b 2024-09-11T22:31:25.885 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:31:25 smithi045 systemd[1]: Started Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:31:26.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:25 smithi022 ceph-mon[30966]: pgmap v74: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 2.4 MiB/s wr, 796 op/s 2024-09-11T22:31:26.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:25 smithi022 ceph-mon[30966]: daemon mds.h restarted 2024-09-11T22:31:26.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:25 smithi169 ceph-mon[35628]: pgmap v74: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 2.4 MiB/s wr, 796 op/s 2024-09-11T22:31:26.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:25 smithi169 ceph-mon[35628]: daemon mds.h restarted 2024-09-11T22:31:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:25 smithi045 ceph-mon[35556]: pgmap v74: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 2.4 MiB/s wr, 796 op/s 2024-09-11T22:31:26.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:25 smithi045 ceph-mon[35556]: daemon mds.h restarted 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:26 smithi022 ceph-mon[30966]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:26 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6836/2237272154,v1:172.21.15.45:6837/2237272154] up:boot 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:26 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:26 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:26 smithi022 ceph-mon[30966]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:31:27.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:26 smithi169 ceph-mon[35628]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:31:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:26 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6836/2237272154,v1:172.21.15.45:6837/2237272154] up:boot 2024-09-11T22:31:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:26 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:31:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:26 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:31:27.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:26 smithi169 ceph-mon[35628]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:31:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:26 smithi045 ceph-mon[35556]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:31:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:26 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6836/2237272154,v1:172.21.15.45:6837/2237272154] up:boot 2024-09-11T22:31:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:26 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:31:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:26 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:31:27.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:26 smithi045 ceph-mon[35556]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T22:31:28.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:27 smithi022 ceph-mon[30966]: pgmap v76: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 2.7 MiB/s wr, 523 op/s 2024-09-11T22:31:28.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:27 smithi169 ceph-mon[35628]: pgmap v76: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 2.7 MiB/s wr, 523 op/s 2024-09-11T22:31:28.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:27 smithi045 ceph-mon[35556]: pgmap v76: 97 pgs: 97 active+clean; 142 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 2.7 MiB/s wr, 523 op/s 2024-09-11T22:31:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/2395176191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0101350 msgr2=0x7f7cb010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/2395176191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0101350 0x7f7cb010d880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009860 tx=0x7f7ca802a340 comp rx=0 tx=0).stop 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/2395176191 shutdown_connections 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/2395176191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb0101350 0x7f7cb010d880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/2395176191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01009b0 0x7f7cb0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/2395176191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb01069c0 0x7f7cb0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/2395176191 >> 172.21.15.22:0/2395176191 conn(0x7f7cb0077990 msgr2=0x7f7cb00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/2395176191 shutdown_connections 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.850+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/2395176191 wait complete. 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 Processor -- start 2024-09-11T22:31:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 -- start start 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01009b0 0x7f7cb01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb0101350 0x7f7cb01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0110f20 con 0x7f7cb01069c0 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0110da0 con 0x7f7cb01009b0 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb7ff1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01110a0 con 0x7f7cb0101350 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb658e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb658e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50322/0 (socket says 172.21.15.22:50322) 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb658e640 1 -- 172.21.15.22:0/912127134 learned_addr learned my addr 172.21.15.22:0/912127134 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.851+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01009b0 0x7f7cb01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb558c640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb0101350 0x7f7cb01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 -- 172.21.15.22:0/912127134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb0101350 msgr2=0x7f7cb01988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb0101350 0x7f7cb01988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 -- 172.21.15.22:0/912127134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01009b0 msgr2=0x7f7cb01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01009b0 0x7f7cb01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 -- 172.21.15.22:0/912127134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb019d390 con 0x7f7cb01069c0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb658e640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802a930 tx=0x7f7ca80326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7ca2ffd640 1 -- 172.21.15.22:0/912127134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8037050 con 0x7f7cb01069c0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb019d620 con 0x7f7cb01069c0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7ca2ffd640 1 -- 172.21.15.22:0/912127134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ca8043070 con 0x7f7cb01069c0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7ca2ffd640 1 -- 172.21.15.22:0/912127134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8003d80 con 0x7f7cb01069c0 2024-09-11T22:31:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.852+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01a4f10 con 0x7f7cb01069c0 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7ca2ffd640 1 -- 172.21.15.22:0/912127134 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7ca8004040 con 0x7f7cb01069c0 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 Processor -- start 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 -- start start 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755244af0 0x559755244ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x5597552520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.855+0000 7f7cbae63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5597551a92f0 con 0x559755245410 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cbae63740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559755151270 con 0x55975524fcb0 2024-09-11T22:31:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cbae63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5597551a52b0 con 0x559755244af0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x5597552520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7ca2ffd640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 0x7f7c9c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50338/0 (socket says 172.21.15.22:50338) 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 -- 172.21.15.22:0/3498150612 learned_addr learned my addr 172.21.15.22:0/3498150612 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755244af0 0x559755244ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb658e640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 0x7f7c9c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 -- 172.21.15.22:0/3498150612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755244af0 msgr2=0x559755244ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755244af0 0x559755244ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7ca2ffd640 1 -- 172.21.15.22:0/912127134 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7ca80ef660 con 0x7f7cb01069c0 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 -- 172.21.15.22:0/3498150612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 msgr2=0x5597552520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x5597552520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 -- 172.21.15.22:0/3498150612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559755150340 con 0x559755245410 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400b710 tx=0x7f7ca4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ba1811021d0672 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7cb658e640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 0x7f7c9c0a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80bb9e0 tx=0x7f7ca8005d20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.856+0000 7f7c9bfff640 1 -- 172.21.15.22:0/3498150612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4003bd0 con 0x559755245410 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7c9bfff640 1 -- 172.21.15.22:0/3498150612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ca4015070 con 0x559755245410 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7c9bfff640 1 -- 172.21.15.22:0/3498150612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4011440 con 0x559755245410 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 -- 172.21.15.22:0/3498150612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 msgr2=0x55975524f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400b710 tx=0x7f7ca4004610 comp rx=0 tx=0).stop 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 -- 172.21.15.22:0/3498150612 shutdown_connections 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x5597552520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755245410 0x55975524f770 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3498150612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755244af0 0x559755244ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 -- 172.21.15.22:0/3498150612 >> 172.21.15.22:0/3498150612 conn(0x559755241060 msgr2=0x559755241440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 -- 172.21.15.22:0/3498150612 shutdown_connections 2024-09-11T22:31:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.857+0000 7f7cbae63740 1 -- 172.21.15.22:0/3498150612 wait complete. 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 -- start start 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 Processor -- start 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 0x55975524d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x55975524d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559755252880 con 0x559755244af0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559755132290 con 0x55975524fcb0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559755252a00 con 0x559755245410 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cbae63740 10 client.0 _ll_register_callbacks cb 0x559755163140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.858+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50348/0 (socket says 172.21.15.22:50348) 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 -- 172.21.15.22:0/3674257443 learned_addr learned my addr 172.21.15.22:0/3674257443 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x55975524d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 0x55975524d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 -- 172.21.15.22:0/3674257443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 msgr2=0x55975524d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 0x55975524d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 -- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 msgr2=0x55975524d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x55975524d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 -- 172.21.15.22:0/3674257443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559754ebc210 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 0x55975524d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7cac003e80 tx=0x7f7cac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26d58bcc807c5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7c997fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac004820 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7cac004b20 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca4015070 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7cac004d20 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cbae63740 10 client.15822 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.859+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559754f88620 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ca4015070 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7cac00b040 con 0x559755244af0 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 10 client.15822 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 20 client.15822 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55975525fc30 0x559755262040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 4 client.15822 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597551b6a20 con 0x55975525fc30 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.860+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55975525fc30 0x559755262040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.861+0000 7f7c997fa640 10 client.15822 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.861+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55975525fc30 0x559755262040 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2504f793be20b468 server_cookie=f37fbcff40a72c43 in_seq=0 out_seq=0 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7c997fa640 1 -- 172.21.15.22:0/3674257443 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597551b6a20 con 0x55975525fc30 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7c997fa640 10 client.15822 handle_command_reply: tid=0 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 client.15822 shutdown 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 msgr2=0x55975524cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7cac003e80 tx=0x7f7cac004ab0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 shutdown_connections 2024-09-11T22:31:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55975525fc30 0x559755262040 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55975524fcb0 0x55975524d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559755245410 0x55975524d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3674257443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x55975524cb50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7c997fa640 0 client.15822 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 >> 172.21.15.22:0/3674257443 conn(0x559755241060 msgr2=0x559755246d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 shutdown_connections 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 1 -- 172.21.15.22:0/3674257443 wait complete. 2024-09-11T22:31:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.863+0000 7f7cbae63740 20 client.15822 trim_cache size 0 max 16384 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 Processor -- start 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 -- start start 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x55975524d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755267950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ab710 con 0x559755244af0 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01adf90 con 0x559755245410 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cbae63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01abd80 con 0x55975524fcb0 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50362/0 (socket says 172.21.15.22:50362) 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cb558c640 1 -- 172.21.15.22:0/3150443183 learned_addr learned my addr 172.21.15.22:0/3150443183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x55975524d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.878+0000 7f7cb558c640 1 -- 172.21.15.22:0/3150443183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 msgr2=0x559755267950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755267950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb558c640 1 -- 172.21.15.22:0/3150443183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 msgr2=0x55975524d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x55975524d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb558c640 1 -- 172.21.15.22:0/3150443183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55975524dfe0 con 0x559755244af0 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x55975524d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7cb558c640 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0049b0 tx=0x7f7cac009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100e22d3dfeaab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7c9b7fe640 1 -- 172.21.15.22:0/3150443183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac004b20 con 0x559755244af0 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7c9b7fe640 1 -- 172.21.15.22:0/3150443183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cac01b950 con 0x559755244af0 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.879+0000 7f7c9b7fe640 1 -- 172.21.15.22:0/3150443183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac01f6f0 con 0x559755244af0 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- 172.21.15.22:0/3150443183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 msgr2=0x559755247560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0049b0 tx=0x7f7cac009be0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- 172.21.15.22:0/3150443183 shutdown_connections 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755267950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x55975524d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 --2- 172.21.15.22:0/3150443183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755247560 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- 172.21.15.22:0/3150443183 >> 172.21.15.22:0/3150443183 conn(0x559755241060 msgr2=0x55975524ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- 172.21.15.22:0/3150443183 shutdown_connections 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- 172.21.15.22:0/3150443183 wait complete. 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 -- start start 2024-09-11T22:31:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.880+0000 7f7cbae63740 1 Processor -- start 2024-09-11T22:31:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x559755249800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755249d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ac450 con 0x559755244af0 2024-09-11T22:31:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ad8c0 con 0x559755245410 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01acb20 con 0x55975524fcb0 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 10 client.0 _ll_register_callbacks cb 0x7f7cac00ef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50368/0 (socket says 172.21.15.22:50368) 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 -- 172.21.15.22:0/29594902 learned_addr learned my addr 172.21.15.22:0/29594902 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x559755249800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755249d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 -- 172.21.15.22:0/29594902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 msgr2=0x559755249d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755249d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 -- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 msgr2=0x559755249800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x559755249800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 -- 172.21.15.22:0/29594902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55975524a540 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cb558c640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7cac02aa60 tx=0x7f7cac005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1094b1c6e1f48b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7c997fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac03e060 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7cac02a470 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.881+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cac01b950 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7cac02a670 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 10 client.15828 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5597552ca8e0 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cac01b950 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7cac00b070 con 0x559755244af0 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 10 client.15828 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 20 client.15828 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5597552caee0 0x5597552cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 4 client.15828 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597551b0d70 con 0x5597552caee0 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.882+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5597552caee0 0x5597552cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.883+0000 7f7cb5d8d640 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5597552caee0 0x5597552cd300 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b99f1f2c150adcd server_cookie=b0d6cc6d88b5e2bc in_seq=0 out_seq=0 2024-09-11T22:31:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:29.883+0000 7f7c997fa640 10 client.15828 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:30.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:29 smithi022 ceph-mon[30966]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 427 op/s 2024-09-11T22:31:30.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:29 smithi169 ceph-mon[35628]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 427 op/s 2024-09-11T22:31:30.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:29 smithi045 ceph-mon[35556]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 427 op/s 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7c997fa640 1 -- 172.21.15.22:0/29594902 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597551b0d70 con 0x5597552caee0 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7c997fa640 10 client.15828 handle_command_reply: tid=0 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 client.15828 shutdown 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 msgr2=0x559755258410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7cac02aa60 tx=0x7f7cac005bd0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 shutdown_connections 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5597552caee0 0x5597552cd300 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55975524fcb0 0x559755249d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7c997fa640 0 client.15828 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559755245410 0x559755249800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 --2- 172.21.15.22:0/29594902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559755244af0 0x559755258410 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 >> 172.21.15.22:0/29594902 conn(0x559755241060 msgr2=0x55975523f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 shutdown_connections 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 1 -- 172.21.15.22:0/29594902 wait complete. 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.164+0000 7f7cbae63740 20 client.15828 trim_cache size 0 max 16384 2024-09-11T22:31:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:31:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:31:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:31:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:31:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 msgr2=0x7f7c9c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 0x7f7c9c0a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80bb9e0 tx=0x7f7ca8005d20 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 msgr2=0x7f7cb019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802a930 tx=0x7f7ca80326f0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 shutdown_connections 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c9c0a2da0 0x7f7c9c0a5260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cb01069c0 0x7f7cb019cc60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7cb0101350 0x7f7cb01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 --2- 172.21.15.22:0/912127134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb01009b0 0x7f7cb01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 >> 172.21.15.22:0/912127134 conn(0x7f7cb0077990 msgr2=0x7f7cb00699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 shutdown_connections 2024-09-11T22:31:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:31.165+0000 7f7cb7ff1640 1 -- 172.21.15.22:0/912127134 wait complete. 2024-09-11T22:31:31.591 INFO:tasks.workunit.client.0.smithi022.stderr:+ sync 2024-09-11T22:31:32.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:31 smithi022 ceph-mon[30966]: pgmap v78: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:32.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:31 smithi169 ceph-mon[35628]: pgmap v78: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:32.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:31 smithi045 ceph-mon[35556]: pgmap v78: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:32.813 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar c linux-4.0.5 2024-09-11T22:31:33.077 INFO:tasks.workunit.client.0.smithi022.stdout:Ok 2024-09-11T22:31:33.078 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo Ok 2024-09-11T22:31:33.079 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T22:31:33.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T22:31:34.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:33 smithi045 ceph-mon[35556]: pgmap v79: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:33 smithi022 ceph-mon[30966]: pgmap v79: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:34.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:33 smithi169 ceph-mon[35628]: pgmap v79: 97 pgs: 97 active+clean; 160 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 483 op/s 2024-09-11T22:31:36.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:35 smithi022 ceph-mon[30966]: pgmap v80: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 1.26k op/s 2024-09-11T22:31:36.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:35 smithi045 ceph-mon[35556]: pgmap v80: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 1.26k op/s 2024-09-11T22:31:36.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:35 smithi169 ceph-mon[35628]: pgmap v80: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 1.26k op/s 2024-09-11T22:31:38.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:37 smithi045 ceph-mon[35556]: pgmap v81: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 1.21k op/s 2024-09-11T22:31:38.249 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-11T22:31:38.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:31:38.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:37 smithi022 ceph-mon[30966]: pgmap v81: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 1.21k op/s 2024-09-11T22:31:38.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:37 smithi169 ceph-mon[35628]: pgmap v81: 97 pgs: 97 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 1.21k op/s 2024-09-11T22:31:38.515 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.014+0000 7f218c5ca640 1 -- 172.21.15.22:0/3569249106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 msgr2=0x7f2184106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.014+0000 7f218c5ca640 1 --2- 172.21.15.22:0/3569249106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f2184106e50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2180009930 tx=0x7f218002a420 comp rx=0 tx=0).stop 2024-09-11T22:31:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 -- 172.21.15.22:0/3569249106 shutdown_connections 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 --2- 172.21.15.22:0/3569249106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184101410 0x7f218410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 --2- 172.21.15.22:0/3569249106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184100a70 0x7f2184100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 --2- 172.21.15.22:0/3569249106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f2184106e50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 -- 172.21.15.22:0/3569249106 >> 172.21.15.22:0/3569249106 conn(0x7f21840fc790 msgr2=0x7f21840febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 -- 172.21.15.22:0/3569249106 shutdown_connections 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 -- 172.21.15.22:0/3569249106 wait complete. 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.015+0000 7f218c5ca640 1 Processor -- start 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 -- start start 2024-09-11T22:31:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184101410 0x7f21841998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f21841a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2184110f90 con 0x7f2184106a70 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2184110e10 con 0x7f2184100a70 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218c5ca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2184111110 con 0x7f2184101410 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218ab67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f21841a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:33090/0 (socket says 172.21.15.22:33090) 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 -- 172.21.15.22:0/236446725 learned_addr learned my addr 172.21.15.22:0/236446725 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f2189b65640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184101410 0x7f21841998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 -- 172.21.15.22:0/236446725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184101410 msgr2=0x7f21841998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184101410 0x7f21841998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 -- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 msgr2=0x7f21841a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f21841a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.016+0000 7f218a366640 1 -- 172.21.15.22:0/236446725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21841a4950 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f218a366640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2180009230 tx=0x7f2180004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218003f030 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21841a4b20 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2180003af0 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21841a5000 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.017+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180049060 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.018+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2184100ed0 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.019+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2180042030 con 0x7f2184100a70 2024-09-11T22:31:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.020+0000 7f217b7fe640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 0x7f21700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.020+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f21800ef980 con 0x7f2184100a70 2024-09-11T22:31:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.020+0000 7f2189b65640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 0x7f21700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.021+0000 7f2189b65640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 0x7f21700a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f218406b320 tx=0x7f217400b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.023+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21800bc000 con 0x7f2184100a70 2024-09-11T22:31:39.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.238+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2184108fe0 con 0x7f2184100a70 2024-09-11T22:31:39.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.238+0000 7f217b7fe640 1 -- 172.21.15.22:0/236446725 <== mon.2 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f21800c0300 con 0x7f2184100a70 2024-09-11T22:31:39.239 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:31:39.240 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:31:39.240 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:31:39.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.240+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 msgr2=0x7f21700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:39.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.240+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 0x7f21700a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f218406b320 tx=0x7f217400b390 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 msgr2=0x7f2184199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2180009230 tx=0x7f2180004270 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 shutdown_connections 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21700a2cf0 0x7f21700a51b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2184106a70 0x7f21841a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2184101410 0x7f21841998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 --2- 172.21.15.22:0/236446725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2184100a70 0x7f2184199390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 >> 172.21.15.22:0/236446725 conn(0x7f21840fc790 msgr2=0x7f21840fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 shutdown_connections 2024-09-11T22:31:39.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:39.241+0000 7f218c5ca640 1 -- 172.21.15.22:0/236446725 wait complete. 2024-09-11T22:31:39.946 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-11T22:31:39.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-11T22:31:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:39 smithi045 ceph-mon[35556]: pgmap v82: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 1.18k op/s 2024-09-11T22:31:40.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:39 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/236446725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:40.254 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:40.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:39 smithi022 ceph-mon[30966]: pgmap v82: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 1.18k op/s 2024-09-11T22:31:40.273 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:39 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/236446725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:40.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:39 smithi169 ceph-mon[35628]: pgmap v82: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 1.18k op/s 2024-09-11T22:31:40.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:39 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/236446725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 -- 172.21.15.22:0/1862567139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270106f10 msgr2=0x7fd27010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 --2- 172.21.15.22:0/1862567139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270106f10 0x7fd27010ea90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd268009ca0 tx=0x7fd26802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 -- 172.21.15.22:0/1862567139 shutdown_connections 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 --2- 172.21.15.22:0/1862567139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270106f10 0x7fd27010ea90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 --2- 172.21.15.22:0/1862567139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 0x7fd2701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 --2- 172.21.15.22:0/1862567139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270101de0 0x7fd2701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 -- 172.21.15.22:0/1862567139 >> 172.21.15.22:0/1862567139 conn(0x7fd2700fd8c0 msgr2=0x7fd2700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 -- 172.21.15.22:0/1862567139 shutdown_connections 2024-09-11T22:31:40.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 -- 172.21.15.22:0/1862567139 wait complete. 2024-09-11T22:31:40.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.777+0000 7fd27659c640 1 Processor -- start 2024-09-11T22:31:40.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 -- start start 2024-09-11T22:31:40.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 0x7fd270198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270106f10 0x7fd27019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd270112090 con 0x7fd270101de0 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd270111f10 con 0x7fd270106f10 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd27659c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd270112210 con 0x7fd270102790 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47762/0 (socket says 172.21.15.22:47762) 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd26ffff640 1 -- 172.21.15.22:0/2901480296 learned_addr learned my addr 172.21.15.22:0/2901480296 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd274b39640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270106f10 0x7fd27019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.778+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 0x7fd270198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 -- 172.21.15.22:0/2901480296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 msgr2=0x7fd270198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 0x7fd270198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 -- 172.21.15.22:0/2901480296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270106f10 msgr2=0x7fd27019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270106f10 0x7fd27019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 -- 172.21.15.22:0/2901480296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27019d410 con 0x7fd270101de0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd26000e9f0 tx=0x7fd26000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26d7fa640 1 -- 172.21.15.22:0/2901480296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26000cd80 con 0x7fd270101de0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26d7fa640 1 -- 172.21.15.22:0/2901480296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd260010930 con 0x7fd270101de0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27019d700 con 0x7fd270101de0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd26d7fa640 1 -- 172.21.15.22:0/2901480296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd260018b00 con 0x7fd270101de0 2024-09-11T22:31:40.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.779+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2701a4fe0 con 0x7fd270101de0 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.781+0000 7fd26d7fa640 1 -- 172.21.15.22:0/2901480296 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd260018ca0 con 0x7fd270101de0 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 Processor -- start 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 -- start start 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd26d7fa640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 0x7fd2580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b5158b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 0x5568b5163400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b5165d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd26d7fa640 1 -- 172.21.15.22:0/2901480296 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd2600cf7e0 con 0x7fd270101de0 2024-09-11T22:31:40.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd274b39640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 0x7fd2580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5568b50be2a0 con 0x5568b5163940 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5568b5065b10 con 0x5568b5158760 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd274b39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b5165d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd278975740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568b50ba260 con 0x5568b5159080 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd274b39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b5165d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47772/0 (socket says 172.21.15.22:47772) 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd274b39640 1 -- 172.21.15.22:0/2492160147 learned_addr learned my addr 172.21.15.22:0/2492160147 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.782+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b5158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 0x5568b5163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 -- 172.21.15.22:0/2492160147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 msgr2=0x5568b5163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 0x5568b5163400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 -- 172.21.15.22:0/2492160147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 msgr2=0x5568b5165d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b5165d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 -- 172.21.15.22:0/2492160147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b4e2fb90 con 0x5568b5158760 2024-09-11T22:31:40.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 0x5568b5163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:40.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd274b39640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 0x7fd2580a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd26802f540 tx=0x7fd26802f4d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd26ffff640 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b5158b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ccf20 tx=0x7fd26004a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dac51588171963c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd2567fc640 1 -- 172.21.15.22:0/2492160147 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600a00a0 con 0x5568b5158760 2024-09-11T22:31:40.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd2567fc640 1 -- 172.21.15.22:0/2492160147 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2600a4960 con 0x5568b5158760 2024-09-11T22:31:40.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.783+0000 7fd2567fc640 1 -- 172.21.15.22:0/2492160147 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600cd3a0 con 0x5568b5158760 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- 172.21.15.22:0/2492160147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 msgr2=0x5568b5158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b5158b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ccf20 tx=0x7fd26004a760 comp rx=0 tx=0).stop 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- 172.21.15.22:0/2492160147 shutdown_connections 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b5165d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5159080 0x5568b5163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 --2- 172.21.15.22:0/2492160147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b5158b40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- 172.21.15.22:0/2492160147 >> 172.21.15.22:0/2492160147 conn(0x5568b5154cf0 msgr2=0x5568b51550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- 172.21.15.22:0/2492160147 shutdown_connections 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- 172.21.15.22:0/2492160147 wait complete. 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.784+0000 7fd278975740 1 -- start start 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 Processor -- start 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5158760 0x5568b5167e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b516c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5568b5166510 con 0x5568b5163940 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5568b50466e0 con 0x5568b5159080 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568b5166690 con 0x5568b5158760 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd278975740 10 client.0 _ll_register_callbacks cb 0x5568b506aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:33138/0 (socket says 172.21.15.22:33138) 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd274b39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b516c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26f7fe640 1 -- 172.21.15.22:0/648377797 learned_addr learned my addr 172.21.15.22:0/648377797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26ffff640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5158760 0x5568b5167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26f7fe640 1 -- 172.21.15.22:0/648377797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5158760 msgr2=0x5568b5167e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.785+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5158760 0x5568b5167e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd26f7fe640 1 -- 172.21.15.22:0/648377797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 msgr2=0x5568b516c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b516c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd26f7fe640 1 -- 172.21.15.22:0/648377797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b516cb90 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd274b39640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b516c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd26400be30 tx=0x7fd264012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48c2fabaceab3aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd24f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264004220 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2600a4960 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd2640043c0 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd264010650 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd278975740 10 client.25526 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5568b5176880 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.786+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2600a4960 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fd264019070 con 0x5568b5159080 2024-09-11T22:31:40.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 10 client.25526 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 10 client.25526 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 20 client.25526 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b5177de0 0x5568b517a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 4 client.25526 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568b50cb9d0 con 0x5568b5177de0 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd26ffff640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b5177de0 0x5568b517a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd26ffff640 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b5177de0 0x5568b517a200 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238d79c4ac356811 server_cookie=ff2940795deea77d in_seq=0 out_seq=0 2024-09-11T22:31:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.787+0000 7fd24f7fe640 10 client.25526 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:40.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd24f7fe640 1 -- 172.21.15.22:0/648377797 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568b50cb9d0 con 0x5568b5177de0 2024-09-11T22:31:40.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd24f7fe640 10 client.25526 handle_command_reply: tid=0 2024-09-11T22:31:40.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 client.25526 shutdown 2024-09-11T22:31:40.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 msgr2=0x5568b5168380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd26400be30 tx=0x7fd264012820 comp rx=0 tx=0).stop 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 shutdown_connections 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b5177de0 0x5568b517a200 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5163940 0x5568b516c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b5168380 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 --2- 172.21.15.22:0/648377797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5158760 0x5568b5167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 >> 172.21.15.22:0/648377797 conn(0x5568b5154cf0 msgr2=0x5568b515aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd24f7fe640 0 client.25526 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 shutdown_connections 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 1 -- 172.21.15.22:0/648377797 wait complete. 2024-09-11T22:31:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.789+0000 7fd278975740 20 client.25526 trim_cache size 0 max 16384 2024-09-11T22:31:40.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 Processor -- start 2024-09-11T22:31:40.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 -- start start 2024-09-11T22:31:40.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b516c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b517fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701a9610 con 0x5568b5159080 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701abe90 con 0x5568b5158760 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd278975740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701a9c80 con 0x5568b5163940 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47788/0 (socket says 172.21.15.22:47788) 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 -- 172.21.15.22:0/1444524030 learned_addr learned my addr 172.21.15.22:0/1444524030 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26ffff640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b516c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd274b39640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b517fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 -- 172.21.15.22:0/1444524030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 msgr2=0x5568b517fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b517fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 -- 172.21.15.22:0/1444524030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 msgr2=0x5568b516c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b516c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd26f7fe640 1 -- 172.21.15.22:0/1444524030 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b5166f80 con 0x5568b5159080 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.807+0000 7fd274b39640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b517fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd264001eb0 tx=0x7fd264005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3031f49d7e9e02c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd255ffb640 1 -- 172.21.15.22:0/1444524030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264000e60 con 0x5568b5159080 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd255ffb640 1 -- 172.21.15.22:0/1444524030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd264004200 con 0x5568b5159080 2024-09-11T22:31:40.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd255ffb640 1 -- 172.21.15.22:0/1444524030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264027070 con 0x5568b5159080 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 -- 172.21.15.22:0/1444524030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 msgr2=0x5568b5153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd264001eb0 tx=0x7fd264005850 comp rx=0 tx=0).stop 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 -- 172.21.15.22:0/1444524030 shutdown_connections 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b517fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5159080 0x5568b5153d60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 --2- 172.21.15.22:0/1444524030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5158760 0x5568b516c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.808+0000 7fd278975740 1 -- 172.21.15.22:0/1444524030 >> 172.21.15.22:0/1444524030 conn(0x5568b5154cf0 msgr2=0x5568b5153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 -- 172.21.15.22:0/1444524030 shutdown_connections 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 -- 172.21.15.22:0/1444524030 wait complete. 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 -- start start 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 Processor -- start 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.809+0000 7fd278975740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b516f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd278975740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b516fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd278975740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701aa350 con 0x5568b5158760 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd278975740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701ab7c0 con 0x5568b5159080 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd278975740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701aaa20 con 0x5568b5163940 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b516f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd278975740 10 client.0 _ll_register_callbacks cb 0x7fd26400b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47796/0 (socket says 172.21.15.22:47796) 2024-09-11T22:31:40.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 -- 172.21.15.22:0/1182328526 learned_addr learned my addr 172.21.15.22:0/1182328526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd274b39640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b516fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 -- 172.21.15.22:0/1182328526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 msgr2=0x5568b516fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b516fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 -- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 msgr2=0x5568b516f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b516f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 -- 172.21.15.22:0/1182328526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b5158eb0 con 0x5568b5158760 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b516f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd26ffff640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd26009bd30 tx=0x7fd26009bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f013ab27766ad54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd24f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600b8070 con 0x5568b5158760 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.810+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fd260010ae0 con 0x5568b5158760 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd264004200 con 0x5568b5158760 2024-09-11T22:31:40.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd260010ce0 con 0x5568b5158760 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 10 client.15852 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5568b51e2580 con 0x5568b5158760 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd264004200 con 0x5568b5158760 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fd2600b3070 con 0x5568b5158760 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 10 client.15852 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 10 client.15852 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 20 client.15852 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b51e2980 0x5568b51e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 4 client.15852 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x5568b50c5d20 con 0x5568b51e2980 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.811+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b51e2980 0x5568b51e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.812+0000 7fd26f7fe640 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b51e2980 0x5568b51e4d70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84aa953c23af2af8 server_cookie=3ce315904dadef06 in_seq=0 out_seq=0 2024-09-11T22:31:40.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:40.812+0000 7fd24f7fe640 10 client.15852 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.809+0000 7fd24f7fe640 1 -- 172.21.15.22:0/1182328526 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5568b50c5d20 con 0x5568b51e2980 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.809+0000 7fd24f7fe640 10 client.15852 handle_command_reply: tid=0 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.809+0000 7fd278975740 1 client.15852 shutdown 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 msgr2=0x5568b5173c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd26009bd30 tx=0x7fd26009bf20 comp rx=0 tx=0).stop 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 shutdown_connections 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568b51e2980 0x5568b51e4d70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568b5163940 0x5568b516fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd24f7fe640 0 client.15852 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568b5159080 0x5568b516f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 --2- 172.21.15.22:0/1182328526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568b5158760 0x5568b5173c20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 >> 172.21.15.22:0/1182328526 conn(0x5568b5154cf0 msgr2=0x5568b5153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 shutdown_connections 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 1 -- 172.21.15.22:0/1182328526 wait complete. 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.810+0000 7fd278975740 20 client.15852 trim_cache size 0 max 16384 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 22, 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:31:41.812 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 10, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "450de0df": { 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 10, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.7, 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:31:41.813 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:41.814 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 msgr2=0x7fd2580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 0x7fd2580a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd26802f540 tx=0x7fd26802f4d0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 msgr2=0x7fd270198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd26000e9f0 tx=0x7fd26000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 shutdown_connections 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fd2580a2cf0 0x7fd2580a51b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd270106f10 0x7fd27019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd270102790 0x7fd270198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 --2- 172.21.15.22:0/2901480296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd270101de0 0x7fd270198500 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 >> 172.21.15.22:0/2901480296 conn(0x7fd2700fd8c0 msgr2=0x7fd2700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 shutdown_connections 2024-09-11T22:31:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:41.811+0000 7fd27659c640 1 -- 172.21.15.22:0/2901480296 wait complete. 2024-09-11T22:31:42.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:41 smithi022 ceph-mon[30966]: pgmap v83: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.01k op/s 2024-09-11T22:31:42.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:41 smithi169 ceph-mon[35628]: pgmap v83: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.01k op/s 2024-09-11T22:31:42.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:41 smithi045 ceph-mon[35556]: pgmap v83: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.01k op/s 2024-09-11T22:31:42.627 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '450de0df', quiesce took 4.4 seconds. Will release after: 20.299999999999997 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 -- 172.21.15.22:0/2990941228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 msgr2=0x7f365010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 --2- 172.21.15.22:0/2990941228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f365010bac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3644009900 tx=0x7f364402a480 comp rx=0 tx=0).stop 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 -- 172.21.15.22:0/2990941228 shutdown_connections 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 --2- 172.21.15.22:0/2990941228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 --2- 172.21.15.22:0/2990941228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f365010bac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 --2- 172.21.15.22:0/2990941228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 0x7f36501030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 -- 172.21.15.22:0/2990941228 >> 172.21.15.22:0/2990941228 conn(0x7f36500fc6b0 msgr2=0x7f36500fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.268 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 -- 172.21.15.22:0/2990941228 shutdown_connections 2024-09-11T22:31:44.269 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.267+0000 7f3655242640 1 -- 172.21.15.22:0/2990941228 wait complete. 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 Processor -- start 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 -- start start 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 0x7f36501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3650112010 con 0x7f36501035e0 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3650111e90 con 0x7f3650102cc0 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f3655242640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3650112190 con 0x7f365010c110 2024-09-11T22:31:44.271 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f364e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f364e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56448/0 (socket says 172.21.15.22:56448) 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f364e59c640 1 -- 172.21.15.22:0/2109972198 learned_addr learned my addr 172.21.15.22:0/2109972198 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f364f59e640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.268+0000 7f364ed9d640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 0x7f36501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 -- 172.21.15.22:0/2109972198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 msgr2=0x7f365019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 -- 172.21.15.22:0/2109972198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 msgr2=0x7f36501984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 0x7f36501984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 -- 172.21.15.22:0/2109972198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365019d4d0 con 0x7f36501035e0 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364f59e640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f364e59c640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3644006010 tx=0x7f36440040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.272 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f3637fff640 1 -- 172.21.15.22:0/2109972198 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364403f030 con 0x7f36501035e0 2024-09-11T22:31:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365019d760 con 0x7f36501035e0 2024-09-11T22:31:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f3637fff640 1 -- 172.21.15.22:0/2109972198 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36440044c0 con 0x7f36501035e0 2024-09-11T22:31:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f3637fff640 1 -- 172.21.15.22:0/2109972198 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644035070 con 0x7f36501035e0 2024-09-11T22:31:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.269+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501a5050 con 0x7f36501035e0 2024-09-11T22:31:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3637fff640 1 -- 172.21.15.22:0/2109972198 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3644042030 con 0x7f36501035e0 2024-09-11T22:31:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 Processor -- start 2024-09-11T22:31:44.279 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 -- start start 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbb9adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbcbaff2f0 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cbcbaa7270 con 0x55cbcbb9b2f0 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.272+0000 7f3657fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cbcbafb2b0 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f3637fff640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 0x7f36380a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56452/0 (socket says 172.21.15.22:56452) 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364e59c640 1 -- 172.21.15.22:0/1473836653 learned_addr learned my addr 172.21.15.22:0/1473836653 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:44.280 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbb9adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364ed9d640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 0x7f36380a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f3637fff640 1 -- 172.21.15.22:0/2109972198 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f36440ef700 con 0x7f36501035e0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 -- 172.21.15.22:0/1473836653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 msgr2=0x55cbcbba9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 -- 172.21.15.22:0/1473836653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 msgr2=0x55cbcbbac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 -- 172.21.15.22:0/1473836653 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcbaa6340 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364e59c640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.273+0000 7f364f59e640 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbb9adb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3648013c70 tx=0x7f36480117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0ff70b660c2397 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f364f59e640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 0x7f36380a5260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f364801c000 tx=0x7f364801e000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f36357fa640 1 -- 172.21.15.22:0/1473836653 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364801de60 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f36357fa640 1 -- 172.21.15.22:0/1473836653 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3648021030 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f36357fa640 1 -- 172.21.15.22:0/1473836653 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36480044e0 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 -- 172.21.15.22:0/1473836653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 msgr2=0x55cbcbb9adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbb9adb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3648013c70 tx=0x7f36480117b0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 -- 172.21.15.22:0/1473836653 shutdown_connections 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbbac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1473836653 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbb9adb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 -- 172.21.15.22:0/1473836653 >> 172.21.15.22:0/1473836653 conn(0x55cbcbb97060 msgr2=0x55cbcbb97440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 -- 172.21.15.22:0/1473836653 shutdown_connections 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.274+0000 7f3657fd2740 1 -- 172.21.15.22:0/1473836653 wait complete. 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 -- start start 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 Processor -- start 2024-09-11T22:31:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cbcbbacc90 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cbcba88290 con 0x55cbcbb9b2f0 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cbcbbace10 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f3657fd2740 10 client.0 _ll_register_callbacks cb 0x55cbcbab9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56464/0 (socket says 172.21.15.22:56464) 2024-09-11T22:31:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.275+0000 7f364ed9d640 1 -- 172.21.15.22:0/3166335529 learned_addr learned my addr 172.21.15.22:0/3166335529 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364e59c640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364f59e640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 -- 172.21.15.22:0/3166335529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 msgr2=0x55cbcbba7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 -- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 msgr2=0x55cbcbba7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 -- 172.21.15.22:0/3166335529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcb812210 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364f59e640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f364ed9d640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f36400126e0 tx=0x7f3640012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c590da1a3b7db4a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3632ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640012190 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f364000f920 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3648021030 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f364000fb20 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3657fd2740 10 client.15864 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cbcb8de620 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.276+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3648021030 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f364001c420 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 10 client.15864 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 20 client.15864 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbbba120 0x55cbcbbbc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 4 client.15864 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbcbb0ca20 con 0x55cbcbbba120 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f364e59c640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbbba120 0x55cbcbbbc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f3632ff5640 10 client.15864 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.277+0000 7f364e59c640 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbbba120 0x55cbcbbbc570 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8922572a368a0859 server_cookie=d7ff395d8a24db93 in_seq=0 out_seq=0 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3632ff5640 1 -- 172.21.15.22:0/3166335529 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbcbb0ca20 con 0x55cbcbbba120 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3632ff5640 10 client.15864 handle_command_reply: tid=0 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 client.15864 shutdown 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 msgr2=0x55cbcbba70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f36400126e0 tx=0x7f3640012ba0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 shutdown_connections 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbbba120 0x55cbcbbbc570 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.286 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 --2- 172.21.15.22:0/3166335529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbba70f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 >> 172.21.15.22:0/3166335529 conn(0x55cbcbb97060 msgr2=0x55cbcbb9cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.278+0000 7f3632ff5640 0 client.15864 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.279+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 shutdown_connections 2024-09-11T22:31:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.279+0000 7f3657fd2740 1 -- 172.21.15.22:0/3166335529 wait complete. 2024-09-11T22:31:44.287 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.279+0000 7f3657fd2740 20 client.15864 trim_cache size 0 max 16384 2024-09-11T22:31:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 Processor -- start 2024-09-11T22:31:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 -- start start 2024-09-11T22:31:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbbc2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36501a95c0 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f36501abe20 con 0x55cbcbb9b2f0 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.293+0000 7f3657fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36501a9c10 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56478/0 (socket says 172.21.15.22:56478) 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 -- 172.21.15.22:0/538172561 learned_addr learned my addr 172.21.15.22:0/538172561 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364e59c640 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbbc2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 -- 172.21.15.22:0/538172561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 msgr2=0x55cbcbba4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 -- 172.21.15.22:0/538172561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 msgr2=0x55cbcbbc2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbbc2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 -- 172.21.15.22:0/538172561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcbbb5ef0 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364e59c640 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbbc2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f364ed9d640 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f364001c890 tx=0x7f364001df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee51267a6a2eb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f3634ff9640 1 -- 172.21.15.22:0/538172561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640029070 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f3634ff9640 1 -- 172.21.15.22:0/538172561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3640012250 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.294+0000 7f3634ff9640 1 -- 172.21.15.22:0/538172561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364001c680 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- 172.21.15.22:0/538172561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 msgr2=0x55cbcbbc1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f364001c890 tx=0x7f364001df60 comp rx=0 tx=0).stop 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- 172.21.15.22:0/538172561 shutdown_connections 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbbc2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 --2- 172.21.15.22:0/538172561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbc1ed0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.300 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- 172.21.15.22:0/538172561 >> 172.21.15.22:0/538172561 conn(0x55cbcbb97060 msgr2=0x55cbcbba9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- 172.21.15.22:0/538172561 shutdown_connections 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- 172.21.15.22:0/538172561 wait complete. 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 -- start start 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.295+0000 7f3657fd2740 1 Processor -- start 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbb2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f36501aa2e0 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f36501ab750 con 0x55cbcbb9b2f0 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36501aa9b0 con 0x55cbcbb9a9d0 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 10 client.0 _ll_register_callbacks cb 0x7f3640009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:44.301 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56492/0 (socket says 172.21.15.22:56492) 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 -- 172.21.15.22:0/1803286115 learned_addr learned my addr 172.21.15.22:0/1803286115 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364e59c640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364ed9d640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbb2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 -- 172.21.15.22:0/1803286115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 msgr2=0x55cbcbbb2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbb2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 -- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 msgr2=0x55cbcbba3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 -- 172.21.15.22:0/1803286115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcbba4ac0 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364e59c640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f364f59e640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3648011cb0 tx=0x7f364800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e2dc559454c086 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3632ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648013250 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.302 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3648012450 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.296+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3640012250 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f364800abf0 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 10 client.15870 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cbcbc24d40 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3640012250 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f3648038030 con 0x55cbcbbaa0c0 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 10 client.15870 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 20 client.15870 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbc25220 0x55cbcbc27640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 4 client.15870 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbcbb06d70 con 0x55cbcbc25220 2024-09-11T22:31:44.303 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.297+0000 7f364ed9d640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbc25220 0x55cbcbc27640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.298+0000 7f364ed9d640 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbc25220 0x55cbcbc27640 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8967394f8a60650 server_cookie=ea84b013b078a2d4 in_seq=0 out_seq=0 2024-09-11T22:31:44.304 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.298+0000 7f3632ff5640 10 client.15870 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:44.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:31:44.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:43 smithi022 ceph-mon[30966]: pgmap v84: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-11T22:31:44.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:43 smithi169 ceph-mon[35628]: pgmap v84: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-11T22:31:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:43 smithi045 ceph-mon[35556]: pgmap v84: 97 pgs: 97 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 965 op/s 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3632ff5640 1 -- 172.21.15.22:0/1803286115 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbcbb06d70 con 0x55cbcbc25220 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3632ff5640 10 client.15870 handle_command_reply: tid=0 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 client.15870 shutdown 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 msgr2=0x55cbcbba42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3648011cb0 tx=0x7f364800a4d0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 shutdown_connections 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cbcbc25220 0x55cbcbc27640 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cbcbbaa0c0 0x55cbcbba42b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cbcbb9b2f0 0x55cbcbba3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 --2- 172.21.15.22:0/1803286115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cbcbb9a9d0 0x55cbcbbb2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 >> 172.21.15.22:0/1803286115 conn(0x55cbcbb97060 msgr2=0x55cbcbb959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.498+0000 7f3632ff5640 0 client.15870 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 shutdown_connections 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3657fd2740 1 -- 172.21.15.22:0/1803286115 wait complete. 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3657fd2740 20 client.15870 trim_cache size 0 max 16384 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 msgr2=0x7f36380a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 0x7f36380a5260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f364801c000 tx=0x7f364801e000 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 msgr2=0x7f3650198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.499+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3644006010 tx=0x7f36440040c0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 shutdown_connections 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36380a2da0 0x7f36380a5260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f365010c110 0x7f365019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36501035e0 0x7f3650198a20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 --2- 172.21.15.22:0/2109972198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3650102cc0 0x7f36501984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 >> 172.21.15.22:0/2109972198 conn(0x7f36500fc6b0 msgr2=0x7f36500fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.503 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 shutdown_connections 2024-09-11T22:31:44.504 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:44.500+0000 7f3655242640 1 -- 172.21.15.22:0/2109972198 wait complete. 2024-09-11T22:31:44.647 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- 172.21.15.22:0/4257008212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 msgr2=0x7f908410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 --2- 172.21.15.22:0/4257008212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f908410ec40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f907c009930 tx=0x7f907c02a440 comp rx=0 tx=0).stop 2024-09-11T22:31:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- 172.21.15.22:0/4257008212 shutdown_connections 2024-09-11T22:31:45.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 --2- 172.21.15.22:0/4257008212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f908410ec40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 --2- 172.21.15.22:0/4257008212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90841036e0 0x7f9084107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 --2- 172.21.15.22:0/4257008212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9084102d30 0x7f9084103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- 172.21.15.22:0/4257008212 >> 172.21.15.22:0/4257008212 conn(0x7f90840fc7d0 msgr2=0x7f90840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- 172.21.15.22:0/4257008212 shutdown_connections 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- 172.21.15.22:0/4257008212 wait complete. 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 Processor -- start 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.171+0000 7f908bc82640 1 -- start start 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9084102d30 0x7f9084100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90841036e0 0x7f9084100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9084112220 con 0x7f90841082a0 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f90841120a0 con 0x7f90841036e0 2024-09-11T22:31:45.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908bc82640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90841123a0 con 0x7f9084102d30 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56522/0 (socket says 172.21.15.22:56522) 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 -- 172.21.15.22:0/2751103688 learned_addr learned my addr 172.21.15.22:0/2751103688 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908921d640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90841036e0 0x7f9084100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f9089a1e640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9084102d30 0x7f9084100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 -- 172.21.15.22:0/2751103688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9084102d30 msgr2=0x7f9084100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9084102d30 0x7f9084100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 -- 172.21.15.22:0/2751103688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90841036e0 msgr2=0x7f9084100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90841036e0 0x7f9084100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 -- 172.21.15.22:0/2751103688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90841a6b40 con 0x7f90841082a0 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.172+0000 7f908a21f640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f907c005ab0 tx=0x7f907c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.173+0000 7f907affd640 1 -- 172.21.15.22:0/2751103688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c03f030 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.173+0000 7f907affd640 1 -- 172.21.15.22:0/2751103688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f907c003d00 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.173+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90841a6dd0 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.173+0000 7f907affd640 1 -- 172.21.15.22:0/2751103688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c035070 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.173+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90841a72b0 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.175+0000 7f907affd640 1 -- 172.21.15.22:0/2751103688 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f907c042030 con 0x7f90841082a0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.175+0000 7f908e05b740 1 Processor -- start 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 -- start start 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a393885880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a393892a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a3937eb2e0 con 0x55a393885dc0 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a393792ce0 con 0x55a393890680 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908e05b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a3937e72a0 con 0x55a3938854a0 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56536/0 (socket says 172.21.15.22:56536) 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 -- 172.21.15.22:0/2441121466 learned_addr learned my addr 172.21.15.22:0/2441121466 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f907affd640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 0x7f90700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908921d640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a393885880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908921d640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a393892a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f908a21f640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 0x7f90700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 -- 172.21.15.22:0/2441121466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 msgr2=0x55a393885880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a393885880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 -- 172.21.15.22:0/2441121466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 msgr2=0x55a393892a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a393892a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f9089a1e640 1 -- 172.21.15.22:0/2441121466 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a393777440 con 0x55a393885dc0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.176+0000 7f907affd640 1 -- 172.21.15.22:0/2751103688 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f907c0efcc0 con 0x7f90841082a0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f908921d640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a393885880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f9089a1e640 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f908000ae90 tx=0x7f908000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f0e38b68133377 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f906ffff640 1 -- 172.21.15.22:0/2441121466 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080011850 con 0x55a393885dc0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f908a21f640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 0x7f90700a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b8c60 tx=0x7f907c0b1720 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f906ffff640 1 -- 172.21.15.22:0/2441121466 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f908001a480 con 0x55a393885dc0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.177+0000 7f906ffff640 1 -- 172.21.15.22:0/2441121466 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080010630 con 0x55a393885dc0 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- 172.21.15.22:0/2441121466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 msgr2=0x55a393890140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f908000ae90 tx=0x7f908000f730 comp rx=0 tx=0).stop 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- 172.21.15.22:0/2441121466 shutdown_connections 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a393892a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a393890140 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 --2- 172.21.15.22:0/2441121466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a393885880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- 172.21.15.22:0/2441121466 >> 172.21.15.22:0/2441121466 conn(0x55a393881a30 msgr2=0x55a393881e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- 172.21.15.22:0/2441121466 shutdown_connections 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- 172.21.15.22:0/2441121466 wait complete. 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 -- start start 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.178+0000 7f908e05b740 1 Processor -- start 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a39388ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 0x55a39388d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a393893250 con 0x55a393885dc0 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a3937a6050 con 0x55a3938854a0 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a3938933d0 con 0x55a393890680 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 10 client.0 _ll_register_callbacks cb 0x55a3937e6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:45.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56538/0 (socket says 172.21.15.22:56538) 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 -- 172.21.15.22:0/3365806710 learned_addr learned my addr 172.21.15.22:0/3365806710 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908921d640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a39388ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908921d640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 0x55a39388d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 -- 172.21.15.22:0/3365806710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 msgr2=0x55a39388d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 0x55a39388d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 -- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 msgr2=0x55a39388ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a39388ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 -- 172.21.15.22:0/3365806710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a39355c3c0 con 0x55a393885dc0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908921d640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 0x55a39388d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f9089a1e640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f908000ac00 tx=0x7f908001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46262d57d03e3058 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f906d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908001a730 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f908001a8d0 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.179+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908001a480 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9080011650 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 10 client.15882 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a39389eba0 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f908001a480 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9080025b90 con 0x55a393885dc0 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 10 client.15882 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 20 client.15882 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a3938a0000 0x55a3938a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 4 client.15882 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3937f8850 con 0x55a3938a0000 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.180+0000 7f908921d640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a3938a0000 0x55a3938a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.181+0000 7f908921d640 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a3938a0000 0x55a3938a23f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a7d5b652e026d33 server_cookie=6fde042ef256531 in_seq=0 out_seq=0 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.181+0000 7f906d7fa640 10 client.15882 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f906d7fa640 1 -- 172.21.15.22:0/3365806710 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3937f8850 con 0x55a3938a0000 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f906d7fa640 10 client.15882 handle_command_reply: tid=0 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 client.15882 shutdown 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 msgr2=0x55a39388d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f908000ac00 tx=0x7f908001ad10 comp rx=0 tx=0).stop 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 shutdown_connections 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a3938a0000 0x55a3938a23f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393890680 0x55a39388d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a39388d1d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 --2- 172.21.15.22:0/3365806710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a39388ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 >> 172.21.15.22:0/3365806710 conn(0x55a393881a30 msgr2=0x55a393887710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f906d7fa640 0 client.15882 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 shutdown_connections 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 1 -- 172.21.15.22:0/3365806710 wait complete. 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.182+0000 7f908e05b740 20 client.15882 trim_cache size 0 max 16384 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 Processor -- start 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 -- start start 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a39389c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a3938a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90841adaa0 con 0x55a393885dc0 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b0320 con 0x55a393890680 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908e05b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90841ae110 con 0x55a3938854a0 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56552/0 (socket says 172.21.15.22:56552) 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 -- 172.21.15.22:0/572342002 learned_addr learned my addr 172.21.15.22:0/572342002 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908921d640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a39389c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908921d640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a3938a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 -- 172.21.15.22:0/572342002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 msgr2=0x55a39389c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a39389c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 -- 172.21.15.22:0/572342002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 msgr2=0x55a3938a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a3938a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 -- 172.21.15.22:0/572342002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a393885220 con 0x55a393885dc0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f908921d640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a3938a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.200+0000 7f9089a1e640 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f908001ac70 tx=0x7f908000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8327d088493a3163 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f906f7fe640 1 -- 172.21.15.22:0/572342002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080032070 con 0x55a393885dc0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f906f7fe640 1 -- 172.21.15.22:0/572342002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f908002d9b0 con 0x55a393885dc0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f906f7fe640 1 -- 172.21.15.22:0/572342002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908001a480 con 0x55a393885dc0 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 -- 172.21.15.22:0/572342002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 msgr2=0x55a3938a7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f908001ac70 tx=0x7f908000f730 comp rx=0 tx=0).stop 2024-09-11T22:31:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 -- 172.21.15.22:0/572342002 shutdown_connections 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a393890680 0x55a3938a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393885dc0 0x55a3938a7aa0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 --2- 172.21.15.22:0/572342002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3938854a0 0x55a39389c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.201+0000 7f908e05b740 1 -- 172.21.15.22:0/572342002 >> 172.21.15.22:0/572342002 conn(0x55a393881a30 msgr2=0x55a39388f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- 172.21.15.22:0/572342002 shutdown_connections 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- 172.21.15.22:0/572342002 wait complete. 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- start start 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 Processor -- start 2024-09-11T22:31:45.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a3938989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393890680 0x55a393895f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90841ae7e0 con 0x55a393890680 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f90841afc50 con 0x55a3938854a0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.202+0000 7f908e05b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90841aeeb0 con 0x55a393885dc0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f908e05b740 10 client.0 _ll_register_callbacks cb 0x7f908000ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:33128/0 (socket says 172.21.15.22:33128) 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 -- 172.21.15.22:0/56935062 learned_addr learned my addr 172.21.15.22:0/56935062 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f908921d640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393890680 0x55a393895f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f908921d640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a3938989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 -- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 msgr2=0x55a3938989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a3938989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 -- 172.21.15.22:0/56935062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393890680 msgr2=0x55a393895f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393890680 0x55a393895f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 -- 172.21.15.22:0/56935062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a393896780 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f9089a1e640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f908000a6b0 tx=0x7f908000ae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ae73a2379afe3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f906d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080032030 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.203+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908002d9b0 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f908002ddf0 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f90800049e0 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 10 client.25393 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a39390a620 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f908002d9b0 con 0x55a393885dc0 2024-09-11T22:31:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9080011bc0 con 0x55a393885dc0 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 10 client.25393 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 10 client.25393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 20 client.25393 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a39390ac50 0x55a39390d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 4 client.25393 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3937f2d60 con 0x55a39390ac50 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.204+0000 7f908921d640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a39390ac50 0x55a39390d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f906d7fa640 10 client.25393 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908921d640 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a39390ac50 0x55a39390d070 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f593d65ba5e0c4 server_cookie=256963d0be8b3571 in_seq=0 out_seq=0 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f906d7fa640 1 -- 172.21.15.22:0/56935062 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a3937f2d60 con 0x55a39390ac50 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f906d7fa640 10 client.25393 handle_command_reply: tid=0 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 client.25393 shutdown 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 msgr2=0x55a393898ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f908000a6b0 tx=0x7f908000ae40 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 shutdown_connections 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a39390ac50 0x55a39390d070 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a393890680 0x55a393895f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a393885dc0 0x55a393898ef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 --2- 172.21.15.22:0/56935062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a3938854a0 0x55a3938989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f906d7fa640 0 client.25393 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 >> 172.21.15.22:0/56935062 conn(0x55a393881a30 msgr2=0x55a393880350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 shutdown_connections 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 1 -- 172.21.15.22:0/56935062 wait complete. 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.205+0000 7f908e05b740 20 client.25393 trim_cache size 0 max 16384 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 msgr2=0x7f90700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 0x7f90700a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b8c60 tx=0x7f907c0b1720 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 msgr2=0x7f9084101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f907c005ab0 tx=0x7f907c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 shutdown_connections 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f90700a2cf0 0x7f90700a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90841082a0 0x7f9084101410 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90841036e0 0x7f9084100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 --2- 172.21.15.22:0/2751103688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9084102d30 0x7f9084100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 >> 172.21.15.22:0/2751103688 conn(0x7f90840fc7d0 msgr2=0x7f90840fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 shutdown_connections 2024-09-11T22:31:45.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:45.206+0000 7f908bc82640 1 -- 172.21.15.22:0/2751103688 wait complete. 2024-09-11T22:31:45.868 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:31:45.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:31:46.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:45 smithi022 ceph-mon[30966]: pgmap v85: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.16k op/s 2024-09-11T22:31:46.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:46.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:45 smithi169 ceph-mon[35628]: pgmap v85: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.16k op/s 2024-09-11T22:31:46.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:45 smithi045 ceph-mon[35556]: pgmap v85: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 1.16k op/s 2024-09-11T22:31:46.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 -- 172.21.15.22:0/2106945563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4106f10 msgr2=0x7f61f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/2106945563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4106f10 0x7f61f410ea90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009ca0 tx=0x7f61ec02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 -- 172.21.15.22:0/2106945563 shutdown_connections 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/2106945563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4106f10 0x7f61f410ea90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/2106945563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4102790 0x7f61f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/2106945563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4101de0 0x7f61f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 -- 172.21.15.22:0/2106945563 >> 172.21.15.22:0/2106945563 conn(0x7f61f40fd8c0 msgr2=0x7f61f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 -- 172.21.15.22:0/2106945563 shutdown_connections 2024-09-11T22:31:46.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.677+0000 7f61fb9cf640 1 -- 172.21.15.22:0/2106945563 wait complete. 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 Processor -- start 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 -- start start 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4102790 0x7f61f4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 0x7f61f419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61f41120d0 con 0x7f61f4101de0 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4111f50 con 0x7f61f4102790 2024-09-11T22:31:46.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61fb9cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4112250 con 0x7f61f4106f10 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61f976b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61f976b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56566/0 (socket says 172.21.15.22:56566) 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61f976b640 1 -- 172.21.15.22:0/857997396 learned_addr learned my addr 172.21.15.22:0/857997396 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.678+0000 7f61f8f6a640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4102790 0x7f61f4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f9f6c640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 0x7f61f419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 -- 172.21.15.22:0/857997396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 msgr2=0x7f61f419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 0x7f61f419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 -- 172.21.15.22:0/857997396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4102790 msgr2=0x7f61f4198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4102790 0x7f61f4198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 -- 172.21.15.22:0/857997396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f419d500 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f9f6c640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 0x7f61f419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61f976b640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c890 tx=0x7f61f000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0004220 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61f00043c0 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f419d7f0 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0004a00 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.679+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f41a50d0 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.680+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f41021c0 con 0x7f61f4101de0 2024-09-11T22:31:46.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.681+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f61f0004c60 con 0x7f61f4101de0 2024-09-11T22:31:46.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.682+0000 7f61ea7fc640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 0x7f61e00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:46.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.682+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f61f00cf430 con 0x7f61f4101de0 2024-09-11T22:31:46.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.682+0000 7f61f8f6a640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 0x7f61e00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:46.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.682+0000 7f61f8f6a640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 0x7f61e00a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f40ff770 tx=0x7f61e4009110 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:46.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.686+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61f0014030 con 0x7f61f4101de0 2024-09-11T22:31:46.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.898+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61f410a0f0 con 0x7f61f4101de0 2024-09-11T22:31:46.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.899+0000 7f61ea7fc640 1 -- 172.21.15.22:0/857997396 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f61f009c040 con 0x7f61f4101de0 2024-09-11T22:31:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:31:46.900 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:31:46.900 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:31:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 msgr2=0x7f61e00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 0x7f61e00a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61f40ff770 tx=0x7f61e4009110 comp rx=0 tx=0).stop 2024-09-11T22:31:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 msgr2=0x7f61f4198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c890 tx=0x7f61f000cc90 comp rx=0 tx=0).stop 2024-09-11T22:31:46.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 shutdown_connections 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f61e00a2d70 0x7f61e00a5230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f4106f10 0x7f61f419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f4102790 0x7f61f4198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 --2- 172.21.15.22:0/857997396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61f4101de0 0x7f61f4198550 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.901+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 >> 172.21.15.22:0/857997396 conn(0x7f61f40fd8c0 msgr2=0x7f61f40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.902+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 shutdown_connections 2024-09-11T22:31:46.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:46.902+0000 7f61fb9cf640 1 -- 172.21.15.22:0/857997396 wait complete. 2024-09-11T22:31:47.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:46 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/857997396' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:47.313 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:46 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/857997396' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:47.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:46 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/857997396' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:31:47.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:31:47.990 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:48.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:47 smithi022 ceph-mon[30966]: pgmap v86: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 358 op/s 2024-09-11T22:31:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:47 smithi169 ceph-mon[35628]: pgmap v86: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 358 op/s 2024-09-11T22:31:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:47 smithi045 ceph-mon[35556]: pgmap v86: 97 pgs: 97 active+clean; 152 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 358 op/s 2024-09-11T22:31:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.446+0000 7f7079923640 1 -- 172.21.15.22:0/4152084013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074101400 msgr2=0x7f707410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.446+0000 7f7079923640 1 --2- 172.21.15.22:0/4152084013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074101400 0x7f707410d930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f706c009930 tx=0x7f706c02a420 comp rx=0 tx=0).stop 2024-09-11T22:31:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.446+0000 7f7079923640 1 -- 172.21.15.22:0/4152084013 shutdown_connections 2024-09-11T22:31:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.446+0000 7f7079923640 1 --2- 172.21.15.22:0/4152084013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074101400 0x7f707410d930 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 --2- 172.21.15.22:0/4152084013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 0x7f7074100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 --2- 172.21.15.22:0/4152084013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074106a60 0x7f7074106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 -- 172.21.15.22:0/4152084013 >> 172.21.15.22:0/4152084013 conn(0x7f70740fc780 msgr2=0x7f70740feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 -- 172.21.15.22:0/4152084013 shutdown_connections 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 -- 172.21.15.22:0/4152084013 wait complete. 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 Processor -- start 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.447+0000 7f7079923640 1 -- start start 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 0x7f7074198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074101400 0x7f70741989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7074110f80 con 0x7f7074106a60 2024-09-11T22:31:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7074110e00 con 0x7f7074100a60 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7079923640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7074111100 con 0x7f7074101400 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56578/0 (socket says 172.21.15.22:56578) 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 -- 172.21.15.22:0/1537676610 learned_addr learned my addr 172.21.15.22:0/1537676610 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7072ffd640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 0x7f7074198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70727fc640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074101400 0x7f70741989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 -- 172.21.15.22:0/1537676610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074101400 msgr2=0x7f70741989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074101400 0x7f70741989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 -- 172.21.15.22:0/1537676610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 msgr2=0x7f7074198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 0x7f7074198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 -- 172.21.15.22:0/1537676610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707419d420 con 0x7f7074106a60 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f70737fe640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f706c004770 tx=0x7f706c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.448+0000 7f7078921640 1 -- 172.21.15.22:0/1537676610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c03f030 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.449+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707419d6b0 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.449+0000 7f7078921640 1 -- 172.21.15.22:0/1537676610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f706c003d00 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.449+0000 7f7078921640 1 -- 172.21.15.22:0/1537676610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c035070 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.449+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741a4ff0 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f7078921640 1 -- 172.21.15.22:0/1537676610 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f706c042030 con 0x7f7074106a60 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f707bcfc740 1 Processor -- start 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f707bcfc740 1 -- start start 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587169090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x562587169a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.451+0000 7f7078921640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 0x7f705c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f707bcfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5625870cf2f0 con 0x562587178780 2024-09-11T22:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f707bcfc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562587076cf0 con 0x56258716ab40 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f707bcfc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625870cb2b0 con 0x5625871695d0 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f7072ffd640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 0x7f705c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56582/0 (socket says 172.21.15.22:56582) 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 -- 172.21.15.22:0/3645879529 learned_addr learned my addr 172.21.15.22:0/3645879529 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70727fc640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x562587169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f7078921640 1 -- 172.21.15.22:0/1537676610 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f706c0ef8e0 con 0x7f7074106a60 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70727fc640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 -- 172.21.15.22:0/3645879529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 msgr2=0x562587169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x562587169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 -- 172.21.15.22:0/3645879529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 msgr2=0x562587169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 -- 172.21.15.22:0/3645879529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258705b3a0 con 0x562587178780 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70727fc640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f7072ffd640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 0x7f705c0a51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7064007e40 tx=0x7f70640075b0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f70737fe640 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f706c0b87c0 tx=0x7f706c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a480d5b97e2c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f7059ffb640 1 -- 172.21.15.22:0/3645879529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c049070 con 0x562587178780 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.452+0000 7f7059ffb640 1 -- 172.21.15.22:0/3645879529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f7059ffb640 1 -- 172.21.15.22:0/3645879529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0dd220 con 0x562587178780 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 -- 172.21.15.22:0/3645879529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 msgr2=0x56258717ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f706c0b87c0 tx=0x7f706c03b6b0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 -- 172.21.15.22:0/3645879529 shutdown_connections 2024-09-11T22:31:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x56258717ab70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x562587169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3645879529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 -- 172.21.15.22:0/3645879529 >> 172.21.15.22:0/3645879529 conn(0x562587132310 msgr2=0x562587165c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 -- 172.21.15.22:0/3645879529 shutdown_connections 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.453+0000 7f707bcfc740 1 -- 172.21.15.22:0/3645879529 wait complete. 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 -- start start 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 Processor -- start 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x5625871781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587175460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5625870cf2f0 con 0x562587178780 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56258708a060 con 0x56258716ab40 2024-09-11T22:31:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56258717b240 con 0x5625871695d0 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f707bcfc740 10 client.0 _ll_register_callbacks cb 0x562586ddd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56594/0 (socket says 172.21.15.22:56594) 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f70737fe640 1 -- 172.21.15.22:0/4042986827 learned_addr learned my addr 172.21.15.22:0/4042986827 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f70727fc640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587175460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.454+0000 7f7072ffd640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x5625871781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 -- 172.21.15.22:0/4042986827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 msgr2=0x5625871781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x5625871781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 -- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 msgr2=0x562587175460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587175460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 -- 172.21.15.22:0/4042986827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562586e403c0 con 0x562587178780 2024-09-11T22:31:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f70737fe640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f706c0b8250 tx=0x7f706c0bb850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae60a3d85bc9e624 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f7052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c049040 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f706c03bc50 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f706c0c01a0 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f707bcfc740 10 client.15906 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562587186ba0 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.455+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f706c0ab3d0 con 0x562587178780 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 10 client.15906 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 20 client.15906 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562587187ef0 0x56258718a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 4 client.15906 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625870dc860 con 0x562587187ef0 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f7072ffd640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562587187ef0 0x56258718a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f7052ffd640 10 client.15906 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.456+0000 7f7072ffd640 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562587187ef0 0x56258718a2e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f58ae9350ffb26 server_cookie=cc6d989e2cca59da in_seq=0 out_seq=0 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f7052ffd640 1 -- 172.21.15.22:0/4042986827 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625870dc860 con 0x562587187ef0 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f7052ffd640 10 client.15906 handle_command_reply: tid=0 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 client.15906 shutdown 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 msgr2=0x562587175bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f706c0b8250 tx=0x7f706c0bb850 comp rx=0 tx=0).stop 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 shutdown_connections 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562587187ef0 0x56258718a2e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587175bf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56258716ab40 0x562587175460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 --2- 172.21.15.22:0/4042986827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625871695d0 0x5625871781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 >> 172.21.15.22:0/4042986827 conn(0x562587132310 msgr2=0x56258716b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f7052ffd640 0 client.15906 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 shutdown_connections 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 1 -- 172.21.15.22:0/4042986827 wait complete. 2024-09-11T22:31:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.457+0000 7f707bcfc740 20 client.15906 trim_cache size 0 max 16384 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 Processor -- start 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 -- start start 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x562587175430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x56258718fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70741a95f0 con 0x562587178780 2024-09-11T22:31:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70741abe70 con 0x5625871695d0 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f707bcfc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70741a9c60 con 0x56258716ab40 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56600/0 (socket says 172.21.15.22:56600) 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.471+0000 7f70737fe640 1 -- 172.21.15.22:0/1527999543 learned_addr learned my addr 172.21.15.22:0/1527999543 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f7072ffd640 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x562587175430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70727fc640 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x56258718fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 -- 172.21.15.22:0/1527999543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 msgr2=0x56258718fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x56258718fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 -- 172.21.15.22:0/1527999543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 msgr2=0x562587175430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x562587175430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 -- 172.21.15.22:0/1527999543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258716c120 con 0x562587178780 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70737fe640 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f706c0c0360 tx=0x7f706c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26343aa3c55477e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70597fa640 1 -- 172.21.15.22:0/1527999543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c049040 con 0x562587178780 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70597fa640 1 -- 172.21.15.22:0/1527999543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.472+0000 7f70597fa640 1 -- 172.21.15.22:0/1527999543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0bb3b0 con 0x562587178780 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- 172.21.15.22:0/1527999543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 msgr2=0x562587190080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f706c0c0360 tx=0x7f706c03b6b0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- 172.21.15.22:0/1527999543 shutdown_connections 2024-09-11T22:31:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587190080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x56258718fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 --2- 172.21.15.22:0/1527999543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x562587175430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- 172.21.15.22:0/1527999543 >> 172.21.15.22:0/1527999543 conn(0x562587132310 msgr2=0x562587174d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- 172.21.15.22:0/1527999543 shutdown_connections 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- 172.21.15.22:0/1527999543 wait complete. 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 -- start start 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.473+0000 7f707bcfc740 1 Processor -- start 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x56258716fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x5625871804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70741aa330 con 0x562587178780 2024-09-11T22:31:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70741ab7a0 con 0x5625871695d0 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70741aaa00 con 0x56258716ab40 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f707bcfc740 10 client.0 _ll_register_callbacks cb 0x7f706800c9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f7072ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x56258716fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56602/0 (socket says 172.21.15.22:56602) 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 -- 172.21.15.22:0/3630793531 learned_addr learned my addr 172.21.15.22:0/3630793531 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70727fc640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x5625871804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 -- 172.21.15.22:0/3630793531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 msgr2=0x5625871804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x5625871804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 -- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 msgr2=0x56258716fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x56258716fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 -- 172.21.15.22:0/3630793531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562587180fd0 con 0x562587178780 2024-09-11T22:31:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70727fc640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x5625871804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f7072ffd640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x56258716fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f70737fe640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f706c0ba340 tx=0x7f706c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768b9c5bb5600870 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f7052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.474+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c049070 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f706c0ed2a0 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f706c0ed4a0 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 10 client.15912 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562587180fd0 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f706c0bc4f0 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f706c0b7b40 con 0x562587178780 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 10 client.15912 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:48.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 20 client.15912 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5625871f75a0 0x5625871f9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 4 client.15912 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.475+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625870d6d70 con 0x5625871f75a0 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7072ffd640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5625871f75a0 0x5625871f9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7072ffd640 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5625871f75a0 0x5625871f9990 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0e886bc2041738 server_cookie=c270715e3e87371b in_seq=0 out_seq=0 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7052ffd640 10 client.15912 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7052ffd640 1 -- 172.21.15.22:0/3630793531 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625870d6d70 con 0x5625871f75a0 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7052ffd640 10 client.15912 handle_command_reply: tid=0 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 client.15912 shutdown 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 msgr2=0x562587180a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f706c0ba340 tx=0x7f706c003f30 comp rx=0 tx=0).stop 2024-09-11T22:31:48.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 shutdown_connections 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5625871f75a0 0x5625871f9990 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562587178780 0x562587180a10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56258716ab40 0x5625871804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f7052ffd640 0 client.15912 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 --2- 172.21.15.22:0/3630793531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625871695d0 0x56258716fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 >> 172.21.15.22:0/3630793531 conn(0x562587132310 msgr2=0x562587176cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.476+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 shutdown_connections 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f707bcfc740 1 -- 172.21.15.22:0/3630793531 wait complete. 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f707bcfc740 20 client.15912 trim_cache size 0 max 16384 2024-09-11T22:31:48.486 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 msgr2=0x7f705c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 0x7f705c0a51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7064007e40 tx=0x7f70640075b0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 msgr2=0x7f707419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f706c004770 tx=0x7f706c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 shutdown_connections 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f705c0a2cf0 0x7f705c0a51b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7074106a60 0x7f707419cd40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7074101400 0x7f70741989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 --2- 172.21.15.22:0/1537676610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7074100a60 0x7f7074198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 >> 172.21.15.22:0/1537676610 conn(0x7f70740fc780 msgr2=0x7f707406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 shutdown_connections 2024-09-11T22:31:48.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:48.477+0000 7f7079923640 1 -- 172.21.15.22:0/1537676610 wait complete. 2024-09-11T22:31:50.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:49 smithi022 ceph-mon[30966]: pgmap v87: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 511 op/s 2024-09-11T22:31:50.173 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:31:50.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:31:50.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:49 smithi169 ceph-mon[35628]: pgmap v87: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 511 op/s 2024-09-11T22:31:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:49 smithi045 ceph-mon[35556]: pgmap v87: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 511 op/s 2024-09-11T22:31:50.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 -- 172.21.15.22:0/613724732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102ef0 msgr2=0x7f600010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 --2- 172.21.15.22:0/613724732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102ef0 0x7f600010da40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009ca0 tx=0x7f5ff802a950 comp rx=0 tx=0).stop 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 -- 172.21.15.22:0/613724732 shutdown_connections 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 --2- 172.21.15.22:0/613724732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102ef0 0x7f600010da40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 --2- 172.21.15.22:0/613724732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000102570 0x7f60001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 --2- 172.21.15.22:0/613724732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000100e20 0x7f6000101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 -- 172.21.15.22:0/613724732 >> 172.21.15.22:0/613724732 conn(0x7f60000fc7d0 msgr2=0x7f60000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 -- 172.21.15.22:0/613724732 shutdown_connections 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.940+0000 7f600663f640 1 -- 172.21.15.22:0/613724732 wait complete. 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 Processor -- start 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 -- start start 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000100e20 0x7f60001985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 0x7f600019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60001110a0 con 0x7f6000102570 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6000110f20 con 0x7f6000100e20 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f600663f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6000111220 con 0x7f6000102ef0 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56628/0 (socket says 172.21.15.22:56628) 2024-09-11T22:31:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f5fff7fe640 1 -- 172.21.15.22:0/753143520 learned_addr learned my addr 172.21.15.22:0/753143520 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.941+0000 7f5ffffff640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000100e20 0x7f60001985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f6004bdc640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 0x7f600019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 -- 172.21.15.22:0/753143520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 msgr2=0x7f600019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 0x7f600019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 -- 172.21.15.22:0/753143520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000100e20 msgr2=0x7f60001985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000100e20 0x7f60001985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 -- 172.21.15.22:0/753143520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600019d560 con 0x7f6000102570 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f6004bdc640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 0x7f600019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d950 tx=0x7f5ff400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5ffd7fa640 1 -- 172.21.15.22:0/753143520 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4017070 con 0x7f6000102570 2024-09-11T22:31:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600019d850 con 0x7f6000102570 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5ffd7fa640 1 -- 172.21.15.22:0/753143520 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ff4009c30 con 0x7f6000102570 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f5ffd7fa640 1 -- 172.21.15.22:0/753143520 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400f740 con 0x7f6000102570 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.942+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60001a5130 con 0x7f6000102570 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.944+0000 7f5ffd7fa640 1 -- 172.21.15.22:0/753143520 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5ff4010a80 con 0x7f6000102570 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 Processor -- start 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 -- start start 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5ffd7fa640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 0x7f5fe80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bedf827280 con 0x55bedf8c1b60 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bedf7ceb10 con 0x55bedf8ccd40 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6008a18740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bedf823240 con 0x55bedf8c2480 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5ffffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f6004bdc640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 0x7f5fe80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5ffffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56630/0 (socket says 172.21.15.22:56630) 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5ffffff640 1 -- 172.21.15.22:0/1366966543 learned_addr learned my addr 172.21.15.22:0/1366966543 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5ffd7fa640 1 -- 172.21.15.22:0/753143520 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5ff40cefe0 con 0x7f6000102570 2024-09-11T22:31:51.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.945+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f6004bdc640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 -- 172.21.15.22:0/1366966543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 msgr2=0x55bedf8cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 -- 172.21.15.22:0/1366966543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 msgr2=0x55bedf8cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 -- 172.21.15.22:0/1366966543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bedf7db1f0 con 0x55bedf8c1b60 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f6004bdc640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5ffffff640 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000bd10 tx=0x7f5ff00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae841e160da2f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f6004bdc640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 0x7f5fe80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55bedf8bf470 tx=0x7f5ff80093f0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5fe67fc640 1 -- 172.21.15.22:0/1366966543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0004030 con 0x55bedf8c1b60 2024-09-11T22:31:51.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5fe67fc640 1 -- 172.21.15.22:0/1366966543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ff00041d0 con 0x55bedf8c1b60 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.946+0000 7f5fe67fc640 1 -- 172.21.15.22:0/1366966543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0011980 con 0x55bedf8c1b60 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- 172.21.15.22:0/1366966543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 msgr2=0x55bedf8c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000bd10 tx=0x7f5ff00107a0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- 172.21.15.22:0/1366966543 shutdown_connections 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 --2- 172.21.15.22:0/1366966543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c1b60 0x55bedf8c1f40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- 172.21.15.22:0/1366966543 >> 172.21.15.22:0/1366966543 conn(0x55bedf8be0f0 msgr2=0x55bedf8be4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- 172.21.15.22:0/1366966543 shutdown_connections 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- 172.21.15.22:0/1366966543 wait complete. 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 -- start start 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.947+0000 7f6008a18740 1 Processor -- start 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bedf8cf910 con 0x55bedf8ccd40 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bedf7e1f10 con 0x55bedf8c1b60 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bedf8cfa90 con 0x55bedf8c2480 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6008a18740 10 client.0 _ll_register_callbacks cb 0x55bedf7aaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56632/0 (socket says 172.21.15.22:56632) 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 -- 172.21.15.22:0/3382010220 learned_addr learned my addr 172.21.15.22:0/3382010220 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 -- 172.21.15.22:0/3382010220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 msgr2=0x55bedf8ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 -- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 msgr2=0x55bedf8c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 -- 172.21.15.22:0/3382010220 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bedf5986a0 con 0x55bedf8ccd40 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f6004bdc640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5ff802f3a0 tx=0x7f5ff80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c94d8344db6bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f5fdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.948+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff804d070 con 0x55bedf8ccd40 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5ff8003cc0 con 0x55bedf8ccd40 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff00041d0 con 0x55bedf8ccd40 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5ff8059050 con 0x55bedf8ccd40 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 10 client.15924 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:51.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bedf8db4d0 con 0x55bedf8ccd40 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ff00041d0 con 0x55bedf8ccd40 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f5ff803d950 con 0x55bedf8ccd40 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 10 client.15924 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 20 client.15924 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf8dc8e0 0x55bedf8ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 4 client.15924 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bedf8347f0 con 0x55bedf8dc8e0 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.949+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf8dc8e0 0x55bedf8ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.950+0000 7f5fdf7fe640 10 client.15924 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.950+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf8dc8e0 0x55bedf8ded80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc34fed185d184a server_cookie=5e2ef94643248916 in_seq=0 out_seq=0 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3382010220 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bedf8347f0 con 0x55bedf8dc8e0 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f5fdf7fe640 10 client.15924 handle_command_reply: tid=0 2024-09-11T22:31:51.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 client.15924 shutdown 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 msgr2=0x55bedf8ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5ff802f3a0 tx=0x7f5ff80095c0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 shutdown_connections 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf8dc8e0 0x55bedf8ded80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8ccd40 0x55bedf8ca690 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c2480 0x55bedf8ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f5fdf7fe640 0 client.15924 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 --2- 172.21.15.22:0/3382010220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 >> 172.21.15.22:0/3382010220 conn(0x55bedf8be0f0 msgr2=0x55bedf8bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 shutdown_connections 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 1 -- 172.21.15.22:0/3382010220 wait complete. 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.951+0000 7f6008a18740 20 client.15924 trim_cache size 0 max 16384 2024-09-11T22:31:51.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.968+0000 7f6008a18740 1 Processor -- start 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.968+0000 7f6008a18740 1 -- start start 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c1b60 0x55bedf8c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ab7d0 con 0x55bedf8c2480 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ae050 con 0x55bedf8ccd40 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6008a18740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60001abe40 con 0x55bedf8c1b60 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56636/0 (socket says 172.21.15.22:56636) 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 -- 172.21.15.22:0/1991949825 learned_addr learned my addr 172.21.15.22:0/1991949825 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5ffffff640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c1b60 0x55bedf8c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6004bdc640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 -- 172.21.15.22:0/1991949825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c1b60 msgr2=0x55bedf8c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c1b60 0x55bedf8c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 -- 172.21.15.22:0/1991949825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 msgr2=0x55bedf8e4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8e4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 -- 172.21.15.22:0/1991949825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bedf8c22b0 con 0x55bedf8c2480 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f6004bdc640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8e4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5ff409b4e0 tx=0x7f5ff409af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab132a404265247 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fe5ffb640 1 -- 172.21.15.22:0/1991949825 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4020040 con 0x55bedf8c2480 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fe5ffb640 1 -- 172.21.15.22:0/1991949825 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ff4009de0 con 0x55bedf8c2480 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.969+0000 7f5fe5ffb640 1 -- 172.21.15.22:0/1991949825 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4097bc0 con 0x55bedf8c2480 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- 172.21.15.22:0/1991949825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 msgr2=0x55bedf8e46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5ff409b4e0 tx=0x7f5ff409af70 comp rx=0 tx=0).stop 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- 172.21.15.22:0/1991949825 shutdown_connections 2024-09-11T22:31:51.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8ccd40 0x55bedf8e4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8e46a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 --2- 172.21.15.22:0/1991949825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8c1b60 0x55bedf8c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- 172.21.15.22:0/1991949825 >> 172.21.15.22:0/1991949825 conn(0x55bedf8be0f0 msgr2=0x55bedf8cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- 172.21.15.22:0/1991949825 shutdown_connections 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- 172.21.15.22:0/1991949825 wait complete. 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.970+0000 7f6008a18740 1 -- start start 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 Processor -- start 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8ccd40 0x55bedf946670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ac510 con 0x55bedf8c2480 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f60001ad980 con 0x55bedf8c1b60 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60001acbe0 con 0x55bedf8ccd40 2024-09-11T22:31:51.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6008a18740 10 client.0 _ll_register_callbacks cb 0x7f5ff8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56644/0 (socket says 172.21.15.22:56644) 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 -- 172.21.15.22:0/3716439970 learned_addr learned my addr 172.21.15.22:0/3716439970 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f6004bdc640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8ccd40 0x55bedf946670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 -- 172.21.15.22:0/3716439970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8ccd40 msgr2=0x55bedf946670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8ccd40 0x55bedf946670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 -- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 msgr2=0x55bedf8d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 -- 172.21.15.22:0/3716439970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bedf946bb0 con 0x55bedf8c2480 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fff7fe640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40058c0 tx=0x7f5ff409afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf03ff0ee2c86a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.971+0000 7f5fdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4020030 con 0x55bedf8c2480 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f5ff409a9a0 con 0x55bedf8c2480 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff4009de0 con 0x55bedf8c2480 2024-09-11T22:31:51.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5ff409f900 con 0x55bedf8c2480 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 10 client.15930 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bedf947e30 con 0x55bedf8c2480 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ff4009de0 con 0x55bedf8c2480 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f5ff4084a90 con 0x55bedf8c2480 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 10 client.15930 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:51.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 20 client.15930 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf948500 0x55bedf94a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 4 client.15930 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bedf82ed00 con 0x55bedf948500 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.972+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf948500 0x55bedf94a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.973+0000 7f5ffffff640 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf948500 0x55bedf94a920 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5a673310f131cdd server_cookie=f4be5c24283016b in_seq=0 out_seq=0 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.973+0000 7f5fdf7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:51.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f5fdf7fe640 1 -- 172.21.15.22:0/3716439970 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bedf82ed00 con 0x55bedf948500 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f5fdf7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 client.15930 shutdown 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 msgr2=0x55bedf8d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40058c0 tx=0x7f5ff409afe0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "0ed4dafc-090a-4938-9085-41aa88bca991", 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:31:51.015 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 shutdown_connections 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bedf948500 0x55bedf94a920 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bedf8ccd40 0x55bedf946670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bedf8c2480 0x55bedf8d1680 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f5fdf7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 --2- 172.21.15.22:0/3716439970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bedf8c1b60 0x55bedf8d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 >> 172.21.15.22:0/3716439970 conn(0x55bedf8be0f0 msgr2=0x55bedf8bca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:51.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.974+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 shutdown_connections 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f6008a18740 1 -- 172.21.15.22:0/3716439970 wait complete. 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f6008a18740 20 client.15930 trim_cache size 0 max 16384 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 msgr2=0x7f5fe80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 0x7f5fe80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55bedf8bf470 tx=0x7f5ff80093f0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 msgr2=0x7f6000198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d950 tx=0x7f5ff400de10 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 shutdown_connections 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5fe80a2cf0 0x7f5fe80a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6000102ef0 0x7f600019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000102570 0x7f6000198af0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 --2- 172.21.15.22:0/753143520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6000100e20 0x7f60001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 >> 172.21.15.22:0/753143520 conn(0x7f60000fc7d0 msgr2=0x7f600006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:51.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 shutdown_connections 2024-09-11T22:31:51.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:50.975+0000 7f600663f640 1 -- 172.21.15.22:0/753143520 wait complete. 2024-09-11T22:31:51.740 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:31:52.001 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:52.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:51 smithi022 ceph-mon[30966]: pgmap v88: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 620 KiB/s wr, 419 op/s 2024-09-11T22:31:52.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:51 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:31:52.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:51 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:31:52.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:51 smithi169 ceph-mon[35628]: pgmap v88: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 620 KiB/s wr, 419 op/s 2024-09-11T22:31:52.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:51 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:31:52.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:51 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:31:52.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:51 smithi045 ceph-mon[35556]: pgmap v88: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 620 KiB/s wr, 419 op/s 2024-09-11T22:31:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:51 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:31:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:51 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:31:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:31:52.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 -- 172.21.15.22:0/1066208694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90103660 msgr2=0x7ffb9010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 --2- 172.21.15.22:0/1066208694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90103660 0x7ffb9010bb50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009900 tx=0x7ffb7802a480 comp rx=0 tx=0).stop 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 -- 172.21.15.22:0/1066208694 shutdown_connections 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 --2- 172.21.15.22:0/1066208694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb9010c170 0x7ffb9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 --2- 172.21.15.22:0/1066208694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90103660 0x7ffb9010bb50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 --2- 172.21.15.22:0/1066208694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb90103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 -- 172.21.15.22:0/1066208694 >> 172.21.15.22:0/1066208694 conn(0x7ffb900fc7a0 msgr2=0x7ffb900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 -- 172.21.15.22:0/1066208694 shutdown_connections 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.471+0000 7ffb952a1640 1 -- 172.21.15.22:0/1066208694 wait complete. 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 Processor -- start 2024-09-11T22:31:52.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 -- start start 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb9019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb90103660 0x7ffb9019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90112090 con 0x7ffb9010c170 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90111f10 con 0x7ffb90102d40 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb952a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90112210 con 0x7ffb90103660 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56662/0 (socket says 172.21.15.22:56662) 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.472+0000 7ffb8f7fe640 1 -- 172.21.15.22:0/2530897702 learned_addr learned my addr 172.21.15.22:0/2530897702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8effd640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb9019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb87fff640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb90103660 0x7ffb9019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 -- 172.21.15.22:0/2530897702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb90103660 msgr2=0x7ffb9019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb90103660 0x7ffb9019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 -- 172.21.15.22:0/2530897702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 msgr2=0x7ffb9019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb9019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 -- 172.21.15.22:0/2530897702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9019f6b0 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8effd640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb9019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8f7fe640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800cad0 tx=0x7ffb8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8cff9640 1 -- 172.21.15.22:0/2530897702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800ae20 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8cff9640 1 -- 172.21.15.22:0/2530897702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb88004b20 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9019f9a0 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb8cff9640 1 -- 172.21.15.22:0/2530897702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800f780 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.473+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb901a7280 con 0x7ffb9010c170 2024-09-11T22:31:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.475+0000 7ffb8cff9640 1 -- 172.21.15.22:0/2530897702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ffb88004cd0 con 0x7ffb9010c170 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 Processor -- start 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 -- start start 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 0x55b88febf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fecca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b88fe252e0 con 0x55b88febfdc0 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b88fdccce0 con 0x55b88feca680 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb9767a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b88fe212a0 con 0x55b88febf4a0 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb8cff9640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 0x7ffb7c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56674/0 (socket says 172.21.15.22:56674) 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.476+0000 7ffb8effd640 1 -- 172.21.15.22:0/708463782 learned_addr learned my addr 172.21.15.22:0/708463782 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:52.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8f7fe640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 0x7ffb7c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb87fff640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fecca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8cff9640 1 -- 172.21.15.22:0/2530897702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffb880cf490 con 0x7ffb9010c170 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb87fff640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 0x55b88febf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 -- 172.21.15.22:0/708463782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 msgr2=0x55b88febf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 0x55b88febf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 -- 172.21.15.22:0/708463782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 msgr2=0x55b88fecca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fecca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 -- 172.21.15.22:0/708463782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b88fdb1440 con 0x55b88febfdc0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb87fff640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 0x55b88febf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8f7fe640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 0x7ffb7c0a5230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb880a40e0 tx=0x7ffb88097520 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb8effd640 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffb80008c60 tx=0x7ffb8000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00056616c5052f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb857fa640 1 -- 172.21.15.22:0/708463782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80014070 con 0x55b88febfdc0 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb857fa640 1 -- 172.21.15.22:0/708463782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb800047a0 con 0x55b88febfdc0 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.477+0000 7ffb857fa640 1 -- 172.21.15.22:0/708463782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80010850 con 0x55b88febfdc0 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 -- 172.21.15.22:0/708463782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 msgr2=0x55b88feca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffb80008c60 tx=0x7ffb8000e720 comp rx=0 tx=0).stop 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 -- 172.21.15.22:0/708463782 shutdown_connections 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fecca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88feca140 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 --2- 172.21.15.22:0/708463782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febf4a0 0x55b88febf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 -- 172.21.15.22:0/708463782 >> 172.21.15.22:0/708463782 conn(0x55b88febba30 msgr2=0x55b88febbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 -- 172.21.15.22:0/708463782 shutdown_connections 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.478+0000 7ffb9767a740 1 -- 172.21.15.22:0/708463782 wait complete. 2024-09-11T22:31:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 -- start start 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 Processor -- start 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febfdc0 0x55b88fec7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fec7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b88fecd250 con 0x55b88febf4a0 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b88fde0050 con 0x55b88febfdc0 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b88fecd3d0 con 0x55b88feca680 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb9767a740 10 client.0 _ll_register_callbacks cb 0x55b88fe20160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56680/0 (socket says 172.21.15.22:56680) 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 -- 172.21.15.22:0/317424202 learned_addr learned my addr 172.21.15.22:0/317424202 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:52.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fec7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb8effd640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febfdc0 0x55b88fec7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 -- 172.21.15.22:0/317424202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 msgr2=0x55b88fec7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fec7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 -- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febfdc0 msgr2=0x55b88fec7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febfdc0 0x55b88fec7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.479+0000 7ffb87fff640 1 -- 172.21.15.22:0/317424202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b88fb963c0 con 0x55b88febf4a0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb87fff640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffb78005940 tx=0x7ffb78031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591af67c0dee15d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78035040 con 0x55b88febf4a0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffb78005220 con 0x55b88febf4a0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb800047a0 con 0x55b88febf4a0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ffb78050050 con 0x55b88febf4a0 2024-09-11T22:31:52.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 10 client.15942 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b88fed8b30 con 0x55b88febf4a0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb800047a0 con 0x55b88febf4a0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ffb78048020 con 0x55b88febf4a0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 10 client.15942 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 20 client.15942 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88fed9ff0 0x55b88fedc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 4 client.15942 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.480+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b88fe32850 con 0x55b88fed9ff0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.481+0000 7ffb8effd640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88fed9ff0 0x55b88fedc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.481+0000 7ffb8effd640 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88fed9ff0 0x55b88fedc3e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6dd4aa1192bc4e5 server_cookie=6f4ccf577a4f7034 in_seq=0 out_seq=0 2024-09-11T22:31:52.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.481+0000 7ffb767fc640 10 client.15942 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb767fc640 1 -- 172.21.15.22:0/317424202 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b88fe32850 con 0x55b88fed9ff0 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb767fc640 10 client.15942 handle_command_reply: tid=0 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 client.15942 shutdown 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 msgr2=0x55b88fec9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffb78005940 tx=0x7ffb78031400 comp rx=0 tx=0).stop 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 shutdown_connections 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88fed9ff0 0x55b88fedc3e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fec7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febfdc0 0x55b88fec7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 --2- 172.21.15.22:0/317424202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88fec9f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb767fc640 0 client.15942 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 >> 172.21.15.22:0/317424202 conn(0x55b88febba30 msgr2=0x55b88fec1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 shutdown_connections 2024-09-11T22:31:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 1 -- 172.21.15.22:0/317424202 wait complete. 2024-09-11T22:31:52.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.482+0000 7ffb9767a740 20 client.15942 trim_cache size 0 max 16384 2024-09-11T22:31:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 Processor -- start 2024-09-11T22:31:52.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 -- start start 2024-09-11T22:31:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febfdc0 0x55b88fee1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fee21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901adac0 con 0x55b88febf4a0 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901b0340 con 0x55b88feca680 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb9767a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901ae130 con 0x55b88febfdc0 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56686/0 (socket says 172.21.15.22:56686) 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 -- 172.21.15.22:0/1436894170 learned_addr learned my addr 172.21.15.22:0/1436894170 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb8effd640 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febfdc0 0x55b88fee1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 -- 172.21.15.22:0/1436894170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febfdc0 msgr2=0x55b88fee1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febfdc0 0x55b88fee1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 -- 172.21.15.22:0/1436894170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 msgr2=0x55b88fee21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fee21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.500+0000 7ffb87fff640 1 -- 172.21.15.22:0/1436894170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b88febc6c0 con 0x55b88febf4a0 2024-09-11T22:31:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.501+0000 7ffb87fff640 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffb780092a0 tx=0x7ffb78005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9e8dcb7467e21f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.501+0000 7ffb84ff9640 1 -- 172.21.15.22:0/1436894170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78035030 con 0x55b88febf4a0 2024-09-11T22:31:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.501+0000 7ffb84ff9640 1 -- 172.21.15.22:0/1436894170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb78003d00 con 0x55b88febf4a0 2024-09-11T22:31:52.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.501+0000 7ffb84ff9640 1 -- 172.21.15.22:0/1436894170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7803dc30 con 0x55b88febf4a0 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- 172.21.15.22:0/1436894170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 msgr2=0x55b88febaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffb780092a0 tx=0x7ffb78005e40 comp rx=0 tx=0).stop 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- 172.21.15.22:0/1436894170 shutdown_connections 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88feca680 0x55b88fee21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88febfdc0 0x55b88fee1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- 172.21.15.22:0/1436894170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febf4a0 0x55b88febaa80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- 172.21.15.22:0/1436894170 >> 172.21.15.22:0/1436894170 conn(0x55b88febba30 msgr2=0x55b88feba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- 172.21.15.22:0/1436894170 shutdown_connections 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- 172.21.15.22:0/1436894170 wait complete. 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 -- start start 2024-09-11T22:31:52.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 Processor -- start 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 0x55b88fed26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.502+0000 7ffb9767a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fecfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb9767a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901ae800 con 0x55b88febfdc0 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb9767a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901afc70 con 0x55b88febf4a0 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb9767a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901aeed0 con 0x55b88feca680 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb9767a740 10 client.0 _ll_register_callbacks cb 0x7ffb9006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56702/0 (socket says 172.21.15.22:56702) 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 -- 172.21.15.22:0/3804920558 learned_addr learned my addr 172.21.15.22:0/3804920558 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb87fff640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fecfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb87fff640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 0x55b88fed26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 -- 172.21.15.22:0/3804920558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 msgr2=0x55b88fecfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fecfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 -- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 msgr2=0x55b88fed26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 0x55b88fed26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 -- 172.21.15.22:0/3804920558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b88fed0370 con 0x55b88febfdc0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb87fff640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 0x55b88fed26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb8effd640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000f010 tx=0x7ffb80008770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b6d5028bdd44e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb767fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80014050 con 0x55b88febfdc0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffb80005520 con 0x55b88febfdc0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.503+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb78003d00 con 0x55b88febfdc0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ffb800035f0 con 0x55b88febfdc0 2024-09-11T22:31:52.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 10 client.15948 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b88ff44780 con 0x55b88febfdc0 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb78003d00 con 0x55b88febfdc0 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ffb80010b70 con 0x55b88febfdc0 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 10 client.15948 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 20 client.15948 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88ff44f30 0x55b88ff47350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 4 client.15948 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b88fec7af0 con 0x55b88ff44f30 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.504+0000 7ffb87fff640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88ff44f30 0x55b88ff47350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb767fc640 10 client.15948 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:52.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb87fff640 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88ff44f30 0x55b88ff47350 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e804bbf180570c server_cookie=c0db8ce41892bc38 in_seq=0 out_seq=0 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb767fc640 1 -- 172.21.15.22:0/3804920558 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b88fec7af0 con 0x55b88ff44f30 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb767fc640 10 client.15948 handle_command_reply: tid=0 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 client.15948 shutdown 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 msgr2=0x55b88fed2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000f010 tx=0x7ffb80008770 comp rx=0 tx=0).stop 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 shutdown_connections 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b88ff44f30 0x55b88ff47350 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b88feca680 0x55b88fecfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b88febfdc0 0x55b88fed2c30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 --2- 172.21.15.22:0/3804920558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b88febf4a0 0x55b88fed26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 >> 172.21.15.22:0/3804920558 conn(0x55b88febba30 msgr2=0x55b88feba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb767fc640 0 client.15948 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 shutdown_connections 2024-09-11T22:31:52.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 1 -- 172.21.15.22:0/3804920558 wait complete. 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.505+0000 7ffb9767a740 20 client.15948 trim_cache size 0 max 16384 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "0ed4dafc-090a-4938-9085-41aa88bca991": { 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "0ed4dafc-090a-4938-9085-41aa88bca991", 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:31:52.512 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:52.513 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:31:52.513 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:31:52.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 msgr2=0x7ffb7c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 0x7ffb7c0a5230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb880a40e0 tx=0x7ffb88097520 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 msgr2=0x7ffb9019efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800cad0 tx=0x7ffb8800cf90 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 shutdown_connections 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffb7c0a2d70 0x7ffb7c0a5230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb9010c170 0x7ffb9019efd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb90103660 0x7ffb9019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 --2- 172.21.15.22:0/2530897702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb90102d40 0x7ffb9019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 >> 172.21.15.22:0/2530897702 conn(0x7ffb900fc7a0 msgr2=0x7ffb9010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 shutdown_connections 2024-09-11T22:31:52.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:31:52.506+0000 7ffb952a1640 1 -- 172.21.15.22:0/2530897702 wait complete. 2024-09-11T22:31:53.413 INFO:tasks.cephfs.filesystem:scrub status for tag:0ed4dafc-090a-4938-9085-41aa88bca991 - {'path': '/', 'tag': '0ed4dafc-090a-4938-9085-41aa88bca991', 'options': 'recursive,force'} 2024-09-11T22:31:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:53 smithi022 ceph-mon[30966]: pgmap v89: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 609 KiB/s wr, 388 op/s 2024-09-11T22:31:54.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:53 smithi169 ceph-mon[35628]: pgmap v89: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 609 KiB/s wr, 388 op/s 2024-09-11T22:31:54.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:53 smithi045 ceph-mon[35556]: pgmap v89: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 609 KiB/s wr, 388 op/s 2024-09-11T22:31:55.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:54 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:31:55.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:54 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:31:55.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:54 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:31:56.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:55 smithi022 ceph-mon[30966]: pgmap v90: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 616 KiB/s wr, 460 op/s 2024-09-11T22:31:56.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:55 smithi169 ceph-mon[35628]: pgmap v90: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 616 KiB/s wr, 460 op/s 2024-09-11T22:31:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:55 smithi045 ceph-mon[35556]: pgmap v90: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 616 KiB/s wr, 460 op/s 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 -- 172.21.15.22:0/902129365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260101ae0 msgr2=0x7fa260101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 --2- 172.21.15.22:0/902129365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260101ae0 0x7fa260101f40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa250009930 tx=0x7fa25002a420 comp rx=0 tx=0).stop 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 -- 172.21.15.22:0/902129365 shutdown_connections 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 --2- 172.21.15.22:0/902129365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa26010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 --2- 172.21.15.22:0/902129365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260101ae0 0x7fa260101f40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 --2- 172.21.15.22:0/902129365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260107b80 0x7fa260107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 -- 172.21.15.22:0/902129365 >> 172.21.15.22:0/902129365 conn(0x7fa2600fd7e0 msgr2=0x7fa2600ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 -- 172.21.15.22:0/902129365 shutdown_connections 2024-09-11T22:31:57.606 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.603+0000 7fa267cba640 1 -- 172.21.15.22:0/902129365 wait complete. 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 Processor -- start 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 -- start start 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260101ae0 0x7fa2600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa260074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa260112010 con 0x7fa260107b80 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa260111e90 con 0x7fa260101ae0 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa267cba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa260112190 con 0x7fa260102480 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48342/0 (socket says 172.21.15.22:48342) 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 -- 172.21.15.22:0/409669428 learned_addr learned my addr 172.21.15.22:0/409669428 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:57.607 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa265a56640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260101ae0 0x7fa2600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa265255640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa260074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 -- 172.21.15.22:0/409669428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 msgr2=0x7fa260074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa260074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 -- 172.21.15.22:0/409669428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260101ae0 msgr2=0x7fa2600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260101ae0 0x7fa2600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa266257640 1 -- 172.21.15.22:0/409669428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2601a6960 con 0x7fa260107b80 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.604+0000 7fa265255640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa260074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa266257640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fd0 tx=0x7fa25800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.608 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa256ffd640 1 -- 172.21.15.22:0/409669428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258017070 con 0x7fa260107b80 2024-09-11T22:31:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa256ffd640 1 -- 172.21.15.22:0/409669428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa258004020 con 0x7fa260107b80 2024-09-11T22:31:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2601a6c50 con 0x7fa260107b80 2024-09-11T22:31:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa256ffd640 1 -- 172.21.15.22:0/409669428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2580106c0 con 0x7fa260107b80 2024-09-11T22:31:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.605+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2601a7120 con 0x7fa260107b80 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.607+0000 7fa256ffd640 1 -- 172.21.15.22:0/409669428 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa2580041d0 con 0x7fa260107b80 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 Processor -- start 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 -- start start 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac55ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac60cb0 0x5568bac630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5568babba2f0 con 0x5568bac56410 2024-09-11T22:31:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5568bab62270 con 0x5568bac60cb0 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568babb62b0 con 0x5568bac55af0 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48346/0 (socket says 172.21.15.22:48346) 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa265a56640 1 -- 172.21.15.22:0/1597871360 learned_addr learned my addr 172.21.15.22:0/1597871360 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.608+0000 7fa265255640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac55ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265255640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac60cb0 0x5568bac630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa256ffd640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 0x7fa24c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 -- 172.21.15.22:0/1597871360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 msgr2=0x5568bac55ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac55ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 -- 172.21.15.22:0/1597871360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac60cb0 msgr2=0x5568bac630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac60cb0 0x5568bac630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 -- 172.21.15.22:0/1597871360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568bab61340 con 0x5568bac56410 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265255640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac55ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa266257640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 0x7fa24c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa265a56640 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00bc90 tx=0x7fa25c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc43a9288b216d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa256ffd640 1 -- 172.21.15.22:0/409669428 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa2580cf190 con 0x7fa260107b80 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa24bfff640 1 -- 172.21.15.22:0/1597871360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c01c480 con 0x5568bac56410 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa24bfff640 1 -- 172.21.15.22:0/1597871360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa25c01cb20 con 0x5568bac56410 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.609+0000 7fa24bfff640 1 -- 172.21.15.22:0/1597871360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c011cb0 con 0x5568bac56410 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- 172.21.15.22:0/1597871360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 msgr2=0x5568bac60770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa266257640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 0x7fa24c0a5260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa25800dfd0 tx=0x7fa25800bf30 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00bc90 tx=0x7fa25c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- 172.21.15.22:0/1597871360 shutdown_connections 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac60cb0 0x5568bac630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac60770 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.616 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/1597871360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac55ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- 172.21.15.22:0/1597871360 >> 172.21.15.22:0/1597871360 conn(0x5568bac52060 msgr2=0x5568bac52440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- 172.21.15.22:0/1597871360 shutdown_connections 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- 172.21.15.22:0/1597871360 wait complete. 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.610+0000 7fa26aa5b740 1 -- start start 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 Processor -- start 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac5e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5568bac63880 con 0x5568bac56410 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5568bab43290 con 0x5568bac55af0 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568bac63a00 con 0x5568bac60cb0 2024-09-11T22:31:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa26aa5b740 10 client.0 _ll_register_callbacks cb 0x5568bab74140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48352/0 (socket says 172.21.15.22:48352) 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 -- 172.21.15.22:0/2717391442 learned_addr learned my addr 172.21.15.22:0/2717391442 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265255640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265255640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac5e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 -- 172.21.15.22:0/2717391442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 msgr2=0x5568bac5e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac5e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 -- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 msgr2=0x5568bac5dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.611+0000 7fa265a56640 1 -- 172.21.15.22:0/2717391442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ba8cd210 con 0x5568bac56410 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa265a56640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa25c011890 tx=0x7fa25c011510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712ff1b7c08ec389 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c011e00 con 0x5568bac56410 2024-09-11T22:31:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa25c01c480 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa25c01cb20 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa25c01c680 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa26aa5b740 10 client.15960 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5568ba999620 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa25c01cb20 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fa25c01dce0 con 0x5568bac56410 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa26aa5b740 10 client.15960 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.612+0000 7fa26aa5b740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa26aa5b740 20 client.15960 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bac70c10 0x5568bac73000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa26aa5b740 4 client.15960 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568babc7a20 con 0x5568bac70c10 2024-09-11T22:31:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa265255640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bac70c10 0x5568bac73000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa265255640 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bac70c10 0x5568bac73000 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6027e6a8388599 server_cookie=290f65813f6507b4 in_seq=0 out_seq=0 2024-09-11T22:31:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.613+0000 7fa2497fa640 10 client.15960 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa2497fa640 1 -- 172.21.15.22:0/2717391442 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568babc7a20 con 0x5568bac70c10 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa2497fa640 10 client.15960 handle_command_reply: tid=0 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 client.15960 shutdown 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 msgr2=0x5568bac5e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa25c011890 tx=0x7fa25c011510 comp rx=0 tx=0).stop 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 shutdown_connections 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bac70c10 0x5568bac73000 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac5e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.614+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac5e150 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/2717391442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa2497fa640 0 client.15960 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 >> 172.21.15.22:0/2717391442 conn(0x5568bac52060 msgr2=0x5568bac511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 shutdown_connections 2024-09-11T22:31:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa26aa5b740 1 -- 172.21.15.22:0/2717391442 wait complete. 2024-09-11T22:31:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.615+0000 7fa26aa5b740 20 client.15960 trim_cache size 0 max 16384 2024-09-11T22:31:57.634 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 Processor -- start 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 -- start start 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac78c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601ad990 con 0x5568bac56410 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601b0210 con 0x5568bac55af0 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.629+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601ae000 con 0x5568bac60cb0 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48366/0 (socket says 172.21.15.22:48366) 2024-09-11T22:31:57.635 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 -- 172.21.15.22:0/698377669 learned_addr learned my addr 172.21.15.22:0/698377669 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265255640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265255640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac78c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 -- 172.21.15.22:0/698377669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 msgr2=0x5568bac78c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac78c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 -- 172.21.15.22:0/698377669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 msgr2=0x5568bac5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 -- 172.21.15.22:0/698377669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568bac55870 con 0x5568bac56410 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265255640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac78c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa265a56640 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa25c000c00 tx=0x7fa25c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f83b0d97fa44ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa24b7fe640 1 -- 172.21.15.22:0/698377669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c010ca0 con 0x5568bac56410 2024-09-11T22:31:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa24b7fe640 1 -- 172.21.15.22:0/698377669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa25c005540 con 0x5568bac56410 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.630+0000 7fa24b7fe640 1 -- 172.21.15.22:0/698377669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c01cbe0 con 0x5568bac56410 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- 172.21.15.22:0/698377669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 msgr2=0x5568bac78740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa25c000c00 tx=0x7fa25c0107a0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- 172.21.15.22:0/698377669 shutdown_connections 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac60cb0 0x5568bac78c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac56410 0x5568bac78740 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/698377669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac55af0 0x5568bac5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- 172.21.15.22:0/698377669 >> 172.21.15.22:0/698377669 conn(0x5568bac52060 msgr2=0x5568bac5fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- 172.21.15.22:0/698377669 shutdown_connections 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- 172.21.15.22:0/698377669 wait complete. 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 -- start start 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.631+0000 7fa26aa5b740 1 Processor -- start 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac68e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac56410 0x5568bac693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601ae6d0 con 0x5568bac60cb0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601afb40 con 0x5568bac56410 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2601aeda0 con 0x5568bac55af0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa26aa5b740 10 client.0 _ll_register_callbacks cb 0x7fa25c00bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48380/0 (socket says 172.21.15.22:48380) 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 -- 172.21.15.22:0/3909568422 learned_addr learned my addr 172.21.15.22:0/3909568422 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265a56640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac56410 0x5568bac693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac68e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 -- 172.21.15.22:0/3909568422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 msgr2=0x5568bac68e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac68e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 -- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac56410 msgr2=0x5568bac693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac56410 0x5568bac693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 -- 172.21.15.22:0/3909568422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568bac5ac50 con 0x5568bac60cb0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa265255640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa250005940 tx=0x7fa250005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9fb7e58145f7da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.632+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250035040 con 0x5568bac60cb0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fa250047040 con 0x5568bac60cb0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa25c005540 con 0x5568bac60cb0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa250004310 con 0x5568bac60cb0 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 10 client.15966 fetch_fsmap learned FSMap version 22 2024-09-11T22:31:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5568bacdb150 con 0x5568bac60cb0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa25c005540 con 0x5568bac60cb0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fa25003a040 con 0x5568bac60cb0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 10 client.15966 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 20 client.15966 populate_metadata read hostname 'smithi022' 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bacdb8a0 0x5568bacddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 4 client.15966 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568babc1d70 con 0x5568bacdb8a0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.633+0000 7fa265a56640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bacdb8a0 0x5568bacddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.634+0000 7fa265a56640 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bacdb8a0 0x5568bacddcc0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50477ca7c99f67e server_cookie=9534dac42d3c2ee5 in_seq=0 out_seq=0 2024-09-11T22:31:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.634+0000 7fa2497fa640 10 client.15966 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa2497fa640 1 -- 172.21.15.22:0/3909568422 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568babc1d70 con 0x5568bacdb8a0 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa2497fa640 10 client.15966 handle_command_reply: tid=0 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 client.15966 shutdown 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 msgr2=0x5568bac5a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa250005940 tx=0x7fa250005a20 comp rx=0 tx=0).stop 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 shutdown_connections 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5568bacdb8a0 0x5568bacddcc0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5568bac60cb0 0x5568bac5a420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5568bac56410 0x5568bac693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa2497fa640 0 client.15966 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:31:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 --2- 172.21.15.22:0/3909568422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568bac55af0 0x5568bac68e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 >> 172.21.15.22:0/3909568422 conn(0x5568bac52060 msgr2=0x5568bac574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 shutdown_connections 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 1 -- 172.21.15.22:0/3909568422 wait complete. 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.665+0000 7fa26aa5b740 20 client.15966 trim_cache size 0 max 16384 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:31:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 msgr2=0x7fa24c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 0x7fa24c0a5260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa25800dfd0 tx=0x7fa25800bf30 comp rx=0 tx=0).stop 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 msgr2=0x7fa260074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fd0 tx=0x7fa25800b260 comp rx=0 tx=0).stop 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 shutdown_connections 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fa24c0a2da0 0x7fa24c0a5260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa260107b80 0x7fa260074f70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa260102480 0x7fa260074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 --2- 172.21.15.22:0/409669428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa260101ae0 0x7fa2600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 >> 172.21.15.22:0/409669428 conn(0x7fa2600fd7e0 msgr2=0x7fa2600fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 shutdown_connections 2024-09-11T22:31:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:31:57.666+0000 7fa267cba640 1 -- 172.21.15.22:0/409669428 wait complete. 2024-09-11T22:31:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:57 smithi022 ceph-mon[30966]: pgmap v91: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 70 KiB/s wr, 263 op/s 2024-09-11T22:31:58.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:57 smithi169 ceph-mon[35628]: pgmap v91: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 70 KiB/s wr, 263 op/s 2024-09-11T22:31:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:57 smithi045 ceph-mon[35556]: pgmap v91: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 70 KiB/s wr, 263 op/s 2024-09-11T22:32:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:31:59 smithi022 ceph-mon[30966]: pgmap v92: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 83 KiB/s wr, 275 op/s 2024-09-11T22:32:00.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:31:59 smithi169 ceph-mon[35628]: pgmap v92: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 83 KiB/s wr, 275 op/s 2024-09-11T22:32:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:31:59 smithi045 ceph-mon[35556]: pgmap v92: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 83 KiB/s wr, 275 op/s 2024-09-11T22:32:02.205 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:01 smithi169 ceph-mon[35628]: pgmap v93: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 25 KiB/s wr, 122 op/s 2024-09-11T22:32:02.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:01 smithi022 ceph-mon[30966]: pgmap v93: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 25 KiB/s wr, 122 op/s 2024-09-11T22:32:02.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:01 smithi045 ceph-mon[35556]: pgmap v93: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 25 KiB/s wr, 122 op/s 2024-09-11T22:32:02.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:32:03.207 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:04.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:03 smithi022 ceph-mon[30966]: pgmap v94: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 KiB/s wr, 84 op/s 2024-09-11T22:32:04.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 -- 172.21.15.22:0/1157155842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 msgr2=0x7f302c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 --2- 172.21.15.22:0/1157155842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c100090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3028009900 tx=0x7f302802a400 comp rx=0 tx=0).stop 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 -- 172.21.15.22:0/1157155842 shutdown_connections 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 --2- 172.21.15.22:0/1157155842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c10e810 0x7f302c110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 --2- 172.21.15.22:0/1157155842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c102fc0 0x7f302c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.173+0000 7f30341ce640 1 --2- 172.21.15.22:0/1157155842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c100090 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 -- 172.21.15.22:0/1157155842 >> 172.21.15.22:0/1157155842 conn(0x7f302c077210 msgr2=0x7f302c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 -- 172.21.15.22:0/1157155842 shutdown_connections 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 -- 172.21.15.22:0/1157155842 wait complete. 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 Processor -- start 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 -- start start 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 0x7f302c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.174+0000 7f30341ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c19ef80 0x7f302c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f30341ce640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f302c1142f0 con 0x7f302c102b50 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f30341ce640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f302c114170 con 0x7f302c19ef80 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f30341ce640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f302c114470 con 0x7f302c10e810 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42662/0 (socket says 172.21.15.22:42662) 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 -- 172.21.15.22:0/3018890 learned_addr learned my addr 172.21.15.22:0/3018890 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f303276b640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c19ef80 0x7f302c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031769640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 0x7f302c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 -- 172.21.15.22:0/3018890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 msgr2=0x7f302c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 0x7f302c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 -- 172.21.15.22:0/3018890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c19ef80 msgr2=0x7f302c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c19ef80 0x7f302c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 -- 172.21.15.22:0/3018890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c19fa40 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031769640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 0x7f302c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3031f6a640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3028006010 tx=0x7f30280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302803f030 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c19fcd0 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3028003d00 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028035070 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.175+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c1a74b0 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.176+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c100090 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.178+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3028042030 con 0x7f302c102b50 2024-09-11T22:32:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.178+0000 7f3022ffd640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 0x7f30180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.178+0000 7f3031769640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 0x7f30180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.178+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f30280efa10 con 0x7f302c102b50 2024-09-11T22:32:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.179+0000 7f3031769640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 0x7f30180a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f302c0fed00 tx=0x7f301c00a5c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.182+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30280bc740 con 0x7f302c102b50 2024-09-11T22:32:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.396+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f302c103100 con 0x7f302c102b50 2024-09-11T22:32:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.397+0000 7f3022ffd640 1 -- 172.21.15.22:0/3018890 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f30280bc040 con 0x7f302c102b50 2024-09-11T22:32:04.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:32:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:32:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 msgr2=0x7f30180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 0x7f30180a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f302c0fed00 tx=0x7f301c00a5c0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 msgr2=0x7f302c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3028006010 tx=0x7f30280042f0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 shutdown_connections 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30180a2cf0 0x7f30180a51b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f302c19ef80 0x7f302c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f302c10e810 0x7f302c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 --2- 172.21.15.22:0/3018890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f302c102b50 0x7f302c19a6b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 >> 172.21.15.22:0/3018890 conn(0x7f302c077210 msgr2=0x7f302c10fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:04.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 shutdown_connections 2024-09-11T22:32:04.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:04.399+0000 7f30341ce640 1 -- 172.21.15.22:0/3018890 wait complete. 2024-09-11T22:32:04.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:03 smithi169 ceph-mon[35628]: pgmap v94: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 KiB/s wr, 84 op/s 2024-09-11T22:32:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:03 smithi045 ceph-mon[35556]: pgmap v94: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 KiB/s wr, 84 op/s 2024-09-11T22:32:05.184 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 450de0df --release --await' 2024-09-11T22:32:05.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 450de0df --release --await 2024-09-11T22:32:05.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:04 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3018890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:05.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:04 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3018890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:04 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3018890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:05.451 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 -- 172.21.15.22:0/3512946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c102db0 msgr2=0x7f396c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 --2- 172.21.15.22:0/3512946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c102db0 0x7f396c103190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f395c009cd0 tx=0x7f395c02a8e0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 -- 172.21.15.22:0/3512946477 shutdown_connections 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 --2- 172.21.15.22:0/3512946477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c1082e0 0x7f396c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 --2- 172.21.15.22:0/3512946477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c103760 0x7f396c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 --2- 172.21.15.22:0/3512946477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c102db0 0x7f396c103190 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 -- 172.21.15.22:0/3512946477 >> 172.21.15.22:0/3512946477 conn(0x7f396c0fc7d0 msgr2=0x7f396c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 -- 172.21.15.22:0/3512946477 shutdown_connections 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 -- 172.21.15.22:0/3512946477 wait complete. 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.939+0000 7f39716d1640 1 Processor -- start 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 -- start start 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c102db0 0x7f396c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 0x7f396c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1121d0 con 0x7f396c103760 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f396c112050 con 0x7f396c102db0 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f39716d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f396c112350 con 0x7f396c1082e0 2024-09-11T22:32:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 0x7f396c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42680/0 (socket says 172.21.15.22:42680) 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 -- 172.21.15.22:0/2879079615 learned_addr learned my addr 172.21.15.22:0/2879079615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396affd640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c102db0 0x7f396c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 -- 172.21.15.22:0/2879079615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 msgr2=0x7f396c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 0x7f396c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 -- 172.21.15.22:0/2879079615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c102db0 msgr2=0x7f396c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c102db0 0x7f396c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396a7fc640 1 -- 172.21.15.22:0/2879079615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19af70 con 0x7f396c103760 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.940+0000 7f396b7fe640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 0x7f396c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f396a7fc640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f396000c970 tx=0x7f396000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f3953fff640 1 -- 172.21.15.22:0/2879079615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960007bb0 con 0x7f396c103760 2024-09-11T22:32:05.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f3953fff640 1 -- 172.21.15.22:0/2879079615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3960007d50 con 0x7f396c103760 2024-09-11T22:32:05.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19b260 con 0x7f396c103760 2024-09-11T22:32:05.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f3953fff640 1 -- 172.21.15.22:0/2879079615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396000f450 con 0x7f396c103760 2024-09-11T22:32:05.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.941+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a75b0 con 0x7f396c103760 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.943+0000 7f3953fff640 1 -- 172.21.15.22:0/2879079615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3960005000 con 0x7f396c103760 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.943+0000 7f3973aaa740 1 Processor -- start 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 -- start start 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4b2240 0x56041a4b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56041a40c620 con 0x56041a4a7980 2024-09-11T22:32:05.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56041a3b3e50 con 0x56041a4b2240 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3973aaa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56041a4085e0 con 0x56041a4a7060 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42692/0 (socket says 172.21.15.22:42692) 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 -- 172.21.15.22:0/3746816341 learned_addr learned my addr 172.21.15.22:0/3746816341 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3953fff640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 0x7f39540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396b7fe640 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396b7fe640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 0x7f39540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 -- 172.21.15.22:0/3746816341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 msgr2=0x56041a4a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 -- 172.21.15.22:0/3746816341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4b2240 msgr2=0x56041a4b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f3953fff640 1 -- 172.21.15.22:0/2879079615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f39600cf070 con 0x7f396c103760 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4b2240 0x56041a4b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.944+0000 7f396affd640 1 -- 172.21.15.22:0/3746816341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041a3a4d40 con 0x56041a4a7980 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f396affd640 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f395c009cd0 tx=0x7f395c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3be920dba11c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f396b7fe640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 0x7f39540a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3964005fd0 tx=0x7f3964005cc0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f39517fa640 1 -- 172.21.15.22:0/3746816341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c048070 con 0x56041a4a7980 2024-09-11T22:32:05.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f39517fa640 1 -- 172.21.15.22:0/3746816341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f395c036070 con 0x56041a4a7980 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f39517fa640 1 -- 172.21.15.22:0/3746816341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c0044c0 con 0x56041a4a7980 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f3973aaa740 1 -- 172.21.15.22:0/3746816341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 msgr2=0x56041a4b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.945+0000 7f3973aaa740 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f395c009cd0 tx=0x7f395c009a20 comp rx=0 tx=0).stop 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- 172.21.15.22:0/3746816341 shutdown_connections 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4b2240 0x56041a4b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4b1d00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- 172.21.15.22:0/3746816341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- 172.21.15.22:0/3746816341 >> 172.21.15.22:0/3746816341 conn(0x56041a4a35f0 msgr2=0x56041a4a39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- 172.21.15.22:0/3746816341 shutdown_connections 2024-09-11T22:32:05.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- 172.21.15.22:0/3746816341 wait complete. 2024-09-11T22:32:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- start start 2024-09-11T22:32:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 Processor -- start 2024-09-11T22:32:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56041a4b4e10 con 0x56041a4b2240 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56041a394f10 con 0x56041a4a7980 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56041a4b4f90 con 0x56041a4a7060 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.946+0000 7f3973aaa740 10 client.0 _ll_register_callbacks cb 0x56041a3b8db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42708/0 (socket says 172.21.15.22:42708) 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 -- 172.21.15.22:0/956577750 learned_addr learned my addr 172.21.15.22:0/956577750 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396affd640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396a7fc640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 -- 172.21.15.22:0/956577750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 msgr2=0x56041a4af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 -- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 msgr2=0x56041a4af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 -- 172.21.15.22:0/956577750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041a11b580 con 0x56041a4b2240 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f396b7fe640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f396400b610 tx=0x7f39640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c86efcc8bef5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f394eff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964024070 con 0x56041a4b2240 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3964010df0 con 0x56041a4b2240 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f395c036070 con 0x56041a4b2240 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.947+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3964029460 con 0x56041a4b2240 2024-09-11T22:32:05.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 10 client.15984 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56041a1e5960 con 0x56041a4b2240 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f395c036070 con 0x56041a4b2240 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f39640328e0 con 0x56041a4b2240 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 10 client.15984 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 10 client.15984 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 20 client.15984 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a4c1da0 0x56041a4c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 4 client.15984 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56041a419b90 con 0x56041a4c1da0 2024-09-11T22:32:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.948+0000 7f396affd640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a4c1da0 0x56041a4c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.949+0000 7f396affd640 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a4c1da0 0x56041a4c41f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fb299b5ce4a5bd7 server_cookie=d28192a527823b1c in_seq=0 out_seq=0 2024-09-11T22:32:05.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.949+0000 7f394eff5640 10 client.15984 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.949+0000 7f394eff5640 1 -- 172.21.15.22:0/956577750 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56041a419b90 con 0x56041a4c1da0 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.949+0000 7f394eff5640 10 client.15984 handle_command_reply: tid=0 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.949+0000 7f3973aaa740 1 client.15984 shutdown 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 msgr2=0x56041a4afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f396400b610 tx=0x7f39640046c0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 shutdown_connections 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a4c1da0 0x56041a4c41f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4b2240 0x56041a4afbc0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 --2- 172.21.15.22:0/956577750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4a7060 0x56041a4af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 >> 172.21.15.22:0/956577750 conn(0x56041a4a35f0 msgr2=0x56041a4a92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f394eff5640 0 client.15984 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 shutdown_connections 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 1 -- 172.21.15.22:0/956577750 wait complete. 2024-09-11T22:32:05.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.950+0000 7f3973aaa740 20 client.15984 trim_cache size 0 max 16384 2024-09-11T22:32:05.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.967+0000 7f3973aaa740 1 Processor -- start 2024-09-11T22:32:05.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.967+0000 7f3973aaa740 1 -- start start 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7060 0x56041a4ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a4ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1ada60 con 0x56041a4a7980 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1b02e0 con 0x56041a4a7060 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f3973aaa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1ae0d0 con 0x56041a4b2240 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42724/0 (socket says 172.21.15.22:42724) 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 -- 172.21.15.22:0/987236919 learned_addr learned my addr 172.21.15.22:0/987236919 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396affd640 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7060 0x56041a4ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396b7fe640 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a4ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 -- 172.21.15.22:0/987236919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 msgr2=0x56041a4ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a4ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 -- 172.21.15.22:0/987236919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7060 msgr2=0x56041a4ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7060 0x56041a4ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 -- 172.21.15.22:0/987236919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041a4a4780 con 0x56041a4a7980 2024-09-11T22:32:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.968+0000 7f396a7fc640 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3960098100 tx=0x7f396009b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d23546200a0685 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3950ff9640 1 -- 172.21.15.22:0/987236919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396001d040 con 0x56041a4a7980 2024-09-11T22:32:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3950ff9640 1 -- 172.21.15.22:0/987236919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39600a42f0 con 0x56041a4a7980 2024-09-11T22:32:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3950ff9640 1 -- 172.21.15.22:0/987236919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600052f0 con 0x56041a4a7980 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 -- 172.21.15.22:0/987236919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 msgr2=0x56041a4c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3960098100 tx=0x7f396009b330 comp rx=0 tx=0).stop 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 -- 172.21.15.22:0/987236919 shutdown_connections 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a4ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7980 0x56041a4c9ac0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 --2- 172.21.15.22:0/987236919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7060 0x56041a4ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 -- 172.21.15.22:0/987236919 >> 172.21.15.22:0/987236919 conn(0x56041a4a35f0 msgr2=0x56041a4b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 -- 172.21.15.22:0/987236919 shutdown_connections 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.969+0000 7f3973aaa740 1 -- 172.21.15.22:0/987236919 wait complete. 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 -- start start 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 Processor -- start 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a525a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1ae7a0 con 0x56041a4a7060 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1afc10 con 0x56041a4a7980 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1aee70 con 0x56041a4b2240 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f3973aaa740 10 client.0 _ll_register_callbacks cb 0x7f396400d690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42740/0 (socket says 172.21.15.22:42740) 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 -- 172.21.15.22:0/1043248233 learned_addr learned my addr 172.21.15.22:0/1043248233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396a7fc640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396b7fe640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a525a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 -- 172.21.15.22:0/1043248233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 msgr2=0x56041a525a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a525a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 -- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 msgr2=0x56041a4b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.970+0000 7f396affd640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:05.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f396affd640 1 -- 172.21.15.22:0/1043248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041a526050 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f396b7fe640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a525a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f396affd640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f395c005e30 tx=0x7f395c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a4bb4c4379b439 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c048040 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f395c031a70 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39600a42f0 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f395c031c70 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f3973aaa740 10 client.15990 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56041a52d470 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39600a42f0 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.971+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f395c042030 con 0x56041a4a7060 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 10 client.15990 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:05.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 10 client.15990 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 20 client.15990 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a52d870 0x56041a52fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 4 client.15990 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "450de0df", "release": true, "await": true}] 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "set_id": "450de0df", "release": true, "await": true}) -- 0x56041a4140a0 con 0x56041a52d870 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f396a7fc640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a52d870 0x56041a52fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f394eff5640 10 client.15990 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:05.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:05.972+0000 7f396a7fc640 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a52d870 0x56041a52fc60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853413a5271d70df server_cookie=b4f4c99811edd4be in_seq=0 out_seq=0 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f394eff5640 1 -- 172.21.15.22:0/1043248233 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f39600b3260 con 0x56041a52d870 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f394eff5640 10 client.15990 handle_command_reply: tid=0 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 client.15990 shutdown 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 msgr2=0x56041a4b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f395c005e30 tx=0x7f395c0095c0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 shutdown_connections 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56041a52d870 0x56041a52fc60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56041a4b2240 0x56041a525a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56041a4a7980 0x56041a4b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f394eff5640 0 client.15990 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 --2- 172.21.15.22:0/1043248233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56041a4a7060 0x56041a4b67c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 >> 172.21.15.22:0/1043248233 conn(0x56041a4a35f0 msgr2=0x56041a4b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 shutdown_connections 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 1 -- 172.21.15.22:0/1043248233 wait complete. 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.011+0000 7f3973aaa740 20 client.15990 trim_cache size 0 max 16384 2024-09-11T22:32:06.013 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 22, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 12, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "450de0df": { 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 12, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.7, 2024-09-11T22:32:06.014 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:06.015 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 msgr2=0x7f39540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 0x7f39540a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3964005fd0 tx=0x7f3964005cc0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 msgr2=0x7f396c1a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f396000c970 tx=0x7f396000ce30 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 shutdown_connections 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f39540a2cf0 0x7f39540a51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f396c1082e0 0x7f396c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f396c103760 0x7f396c1a0b70 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 --2- 172.21.15.22:0/2879079615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f396c102db0 0x7f396c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 >> 172.21.15.22:0/2879079615 conn(0x7f396c0fc7d0 msgr2=0x7f396c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:06.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 shutdown_connections 2024-09-11T22:32:06.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:06.012+0000 7f39716d1640 1 -- 172.21.15.22:0/2879079615 wait complete. 2024-09-11T22:32:06.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:05 smithi022 ceph-mon[30966]: pgmap v95: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 42 KiB/s wr, 100 op/s 2024-09-11T22:32:06.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:05 smithi169 ceph-mon[35628]: pgmap v95: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 42 KiB/s wr, 100 op/s 2024-09-11T22:32:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:05 smithi045 ceph-mon[35556]: pgmap v95: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 42 KiB/s wr, 100 op/s 2024-09-11T22:32:06.883 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '450de0df', total seconds elapsed: 28.6 2024-09-11T22:32:08.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:07 smithi022 ceph-mon[30966]: pgmap v96: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-09-11T22:32:08.295 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-11T22:32:08.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T22:32:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:07 smithi169 ceph-mon[35628]: pgmap v96: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-09-11T22:32:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:07 smithi045 ceph-mon[35556]: pgmap v96: 97 pgs: 97 active+clean; 130 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 KiB/s wr, 27 op/s 2024-09-11T22:32:08.630 DEBUG:teuthology.parallel:result is None 2024-09-11T22:32:08.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:32:08.664 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:32:08.664 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-11T22:32:08.674 INFO:tasks.quiescer:joining Quiescers 2024-09-11T22:32:08.674 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-11T22:32:08.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:32:08.962 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 -- 172.21.15.22:0/1094457853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0103780 msgr2=0x7fe2e0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1094457853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0103780 0x7fe2e0107bc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009cd0 tx=0x7fe2c802a8d0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 -- 172.21.15.22:0/1094457853 shutdown_connections 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1094457853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0108300 0x7fe2e010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1094457853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0103780 0x7fe2e0107bc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1094457853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 0x7fe2e01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 -- 172.21.15.22:0/1094457853 >> 172.21.15.22:0/1094457853 conn(0x7fe2e00fc7d0 msgr2=0x7fe2e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 -- 172.21.15.22:0/1094457853 shutdown_connections 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 -- 172.21.15.22:0/1094457853 wait complete. 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.489+0000 7fe2e52af640 1 Processor -- start 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 -- start start 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 0x7fe2e0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0103780 0x7fe2e0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01121f0 con 0x7fe2e0108300 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0112070 con 0x7fe2e0102dd0 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2e52af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0112370 con 0x7fe2e0103780 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42764/0 (socket says 172.21.15.22:42764) 2024-09-11T22:32:09.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 -- 172.21.15.22:0/1909851684 learned_addr learned my addr 172.21.15.22:0/1909851684 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2de7fc640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0103780 0x7fe2e0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2deffd640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 0x7fe2e0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 -- 172.21.15.22:0/1909851684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0103780 msgr2=0x7fe2e0100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0103780 0x7fe2e0100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 -- 172.21.15.22:0/1909851684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 msgr2=0x7fe2e0100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 0x7fe2e0100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.490+0000 7fe2df7fe640 1 -- 172.21.15.22:0/1909851684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e01a6b50 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2df7fe640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800d750 tx=0x7fe2d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8017070 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2d8005520 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e01a6e40 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8004e00 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.491+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e01a7300 con 0x7fe2e0108300 2024-09-11T22:32:09.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.492+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e006a7b0 con 0x7fe2e0108300 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.493+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe2d8004fa0 con 0x7fe2e0108300 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.494+0000 7fe2d7fff640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 0x7fe2cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.494+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe2d80cf070 con 0x7fe2e0108300 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.494+0000 7fe2deffd640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 0x7fe2cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.495+0000 7fe2deffd640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 0x7fe2cc0a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009bd0 tx=0x7fe2d0005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:09.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.501+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2d809b690 con 0x7fe2e0108300 2024-09-11T22:32:09.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.716+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2e01031b0 con 0x7fe2e0108300 2024-09-11T22:32:09.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.717+0000 7fe2d7fff640 1 -- 172.21.15.22:0/1909851684 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7fe2e01031b0 con 0x7fe2e0108300 2024-09-11T22:32:09.718 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:32:09.718 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:32:09.718 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:32:09.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.719+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 msgr2=0x7fe2cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:09.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.719+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 0x7fe2cc0a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009bd0 tx=0x7fe2d0005f90 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.719+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 msgr2=0x7fe2e01014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.719+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800d750 tx=0x7fe2d800dc10 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 shutdown_connections 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2cc0a2cf0 0x7fe2cc0a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0108300 0x7fe2e01014b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2e0103780 0x7fe2e0100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 --2- 172.21.15.22:0/1909851684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e0102dd0 0x7fe2e0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 >> 172.21.15.22:0/1909851684 conn(0x7fe2e00fc7d0 msgr2=0x7fe2e0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 shutdown_connections 2024-09-11T22:32:09.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:09.720+0000 7fe2e52af640 1 -- 172.21.15.22:0/1909851684 wait complete. 2024-09-11T22:32:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:09 smithi022 ceph-mon[30966]: pgmap v97: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 428 KiB/s wr, 68 op/s 2024-09-11T22:32:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:09 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1909851684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:09 smithi169 ceph-mon[35628]: pgmap v97: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 428 KiB/s wr, 68 op/s 2024-09-11T22:32:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:09 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1909851684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:09 smithi045 ceph-mon[35556]: pgmap v97: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 428 KiB/s wr, 68 op/s 2024-09-11T22:32:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:09 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1909851684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:10.458 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --cancel --all' 2024-09-11T22:32:10.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --cancel --all 2024-09-11T22:32:10.719 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 -- 172.21.15.22:0/4222215751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7180101150 msgr2=0x7f7180107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 --2- 172.21.15.22:0/4222215751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7180101150 0x7f7180107990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7174009930 tx=0x7f717402a4d0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 -- 172.21.15.22:0/4222215751 shutdown_connections 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 --2- 172.21.15.22:0/4222215751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71801080f0 0x7f718010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 --2- 172.21.15.22:0/4222215751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7180101150 0x7f7180107990 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 --2- 172.21.15.22:0/4222215751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180100830 0x7f7180100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 -- 172.21.15.22:0/4222215751 >> 172.21.15.22:0/4222215751 conn(0x7f7180075ec0 msgr2=0x7f71800762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 -- 172.21.15.22:0/4222215751 shutdown_connections 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.771+0000 7f7185a47640 1 -- 172.21.15.22:0/4222215751 wait complete. 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 Processor -- start 2024-09-11T22:32:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 -- start start 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180100830 0x7f7180198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 0x7f7180198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7180112040 con 0x7f71801080f0 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7180111ec0 con 0x7f7180100830 2024-09-11T22:32:10.775 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f7185a47640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71801121c0 con 0x7f7180101150 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f717f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f717f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42780/0 (socket says 172.21.15.22:42780) 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.772+0000 7f717f7fe640 1 -- 172.21.15.22:0/3911886357 learned_addr learned my addr 172.21.15.22:0/3911886357 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717effd640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180100830 0x7f7180198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717e7fc640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 0x7f7180198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 -- 172.21.15.22:0/3911886357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 msgr2=0x7f7180198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 0x7f7180198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 -- 172.21.15.22:0/3911886357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180100830 msgr2=0x7f7180198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180100830 0x7f7180198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 -- 172.21.15.22:0/3911886357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718019d440 con 0x7f71801080f0 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717e7fc640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 0x7f7180198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:10.776 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f717f7fe640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f717800eaa0 tx=0x7f717800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f7184a45640 1 -- 172.21.15.22:0/3911886357 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717800cdb0 con 0x7f71801080f0 2024-09-11T22:32:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f7184a45640 1 -- 172.21.15.22:0/3911886357 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7178004b20 con 0x7f71801080f0 2024-09-11T22:32:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718019d730 con 0x7f71801080f0 2024-09-11T22:32:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f7184a45640 1 -- 172.21.15.22:0/3911886357 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178011760 con 0x7f71801080f0 2024-09-11T22:32:10.777 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.773+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801a4fc0 con 0x7f71801080f0 2024-09-11T22:32:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.775+0000 7f7184a45640 1 -- 172.21.15.22:0/3911886357 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7178004cd0 con 0x7f71801080f0 2024-09-11T22:32:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 Processor -- start 2024-09-11T22:32:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 -- start start 2024-09-11T22:32:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784a9f0 0x55777784add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 0x55777785c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5577777af2f0 con 0x55777784b310 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557777757270 con 0x55777784a9f0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f71887dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5577777ab2b0 con 0x55777785a0c0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42786/0 (socket says 172.21.15.22:42786) 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 -- 172.21.15.22:0/266350590 learned_addr learned my addr 172.21.15.22:0/266350590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f7184a45640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 0x7f71680a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717e7fc640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 0x55777785c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717e7fc640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784a9f0 0x55777784add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717f7fe640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 0x7f71680a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 -- 172.21.15.22:0/266350590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 msgr2=0x55777785c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 0x55777785c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 -- 172.21.15.22:0/266350590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784a9f0 msgr2=0x55777784add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784a9f0 0x55777784add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717effd640 1 -- 172.21.15.22:0/266350590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557777756340 con 0x55777784b310 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f7184a45640 1 -- 172.21.15.22:0/3911886357 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f71780cf5b0 con 0x7f71801080f0 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.776+0000 7f717e7fc640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 0x55777785c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f717effd640 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f717000b760 tx=0x7f717000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316d043712ac12e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f717f7fe640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 0x7f71680a52e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f717800efd0 tx=0x7f717806aa50 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f7165ffb640 1 -- 172.21.15.22:0/266350590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170003dd0 con 0x55777784b310 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f7165ffb640 1 -- 172.21.15.22:0/266350590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7170015070 con 0x55777784b310 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f7165ffb640 1 -- 172.21.15.22:0/266350590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170011440 con 0x55777784b310 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f71887dc740 1 -- 172.21.15.22:0/266350590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 msgr2=0x557777859b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f71887dc740 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f717000b760 tx=0x7f717000bc20 comp rx=0 tx=0).stop 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f71887dc740 1 -- 172.21.15.22:0/266350590 shutdown_connections 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f71887dc740 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777785a0c0 0x55777785c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.777+0000 7f71887dc740 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x557777859b80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 --2- 172.21.15.22:0/266350590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784a9f0 0x55777784add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- 172.21.15.22:0/266350590 >> 172.21.15.22:0/266350590 conn(0x557777847060 msgr2=0x557777847440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- 172.21.15.22:0/266350590 shutdown_connections 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- 172.21.15.22:0/266350590 wait complete. 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- start start 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 Processor -- start 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x557777856f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 0x5577778574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55777785cd20 con 0x55777785a0c0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557777738290 con 0x55777784b310 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55777785cea0 con 0x55777784a9f0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f71887dc740 10 client.0 _ll_register_callbacks cb 0x557777769140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.778+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 0x5577778574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42802/0 (socket says 172.21.15.22:42802) 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 -- 172.21.15.22:0/1852369047 learned_addr learned my addr 172.21.15.22:0/1852369047 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x557777856f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 -- 172.21.15.22:0/1852369047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 msgr2=0x557777856f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x557777856f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 -- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 msgr2=0x5577778574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 0x5577778574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 -- 172.21.15.22:0/1852369047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577774c2210 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717effd640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 0x5577778574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f717e7fc640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7174033000 tx=0x7f717402a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70df5a53ebcad44e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f715effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174035040 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7174004040 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7170015070 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7174004240 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f71887dc740 10 client.16008 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.779+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55777758e620 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7170015070 con 0x55777785a0c0 2024-09-11T22:32:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f717403a040 con 0x55777785a0c0 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 10 client.16008 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 10 client.16008 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 20 client.16008 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557777869f90 0x55777786c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 4 client.16008 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577777bca20 con 0x557777869f90 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f717effd640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557777869f90 0x55777786c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f717effd640 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557777869f90 0x55777786c380 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76e57a3fcbe5d8b4 server_cookie=c232f6bfb702a98b in_seq=0 out_seq=0 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.780+0000 7f715effd640 10 client.16008 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f715effd640 1 -- 172.21.15.22:0/1852369047 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577777bca20 con 0x557777869f90 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f715effd640 10 client.16008 handle_command_reply: tid=0 2024-09-11T22:32:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 client.16008 shutdown 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 msgr2=0x557777857a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7174033000 tx=0x7f717402a4d0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 shutdown_connections 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557777869f90 0x55777786c380 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777785a0c0 0x557777857a00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777784b310 0x5577778574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f715effd640 0 client.16008 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 --2- 172.21.15.22:0/1852369047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x557777856f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.781+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 >> 172.21.15.22:0/1852369047 conn(0x557777847060 msgr2=0x55777784cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.782+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 shutdown_connections 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.782+0000 7f71887dc740 1 -- 172.21.15.22:0/1852369047 wait complete. 2024-09-11T22:32:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.782+0000 7f71887dc740 20 client.16008 trim_cache size 0 max 16384 2024-09-11T22:32:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 Processor -- start 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 -- start start 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784b310 0x557777872190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x55777784c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71801a9550 con 0x55777784a9f0 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71801abdd0 con 0x55777785a0c0 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f71887dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71801a9bc0 con 0x55777784b310 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42818/0 (socket says 172.21.15.22:42818) 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 -- 172.21.15.22:0/56883461 learned_addr learned my addr 172.21.15.22:0/56883461 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 -- 172.21.15.22:0/56883461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784b310 msgr2=0x557777872190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784b310 0x557777872190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 -- 172.21.15.22:0/56883461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 msgr2=0x55777784c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x55777784c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.796+0000 7f717e7fc640 1 -- 172.21.15.22:0/56883461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777786c6f0 con 0x55777784a9f0 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f717e7fc640 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7174005b90 tx=0x7f7174009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c93566c4803b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71657fa640 1 -- 172.21.15.22:0/56883461 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174035040 con 0x55777784a9f0 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71657fa640 1 -- 172.21.15.22:0/56883461 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7174031640 con 0x55777784a9f0 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71657fa640 1 -- 172.21.15.22:0/56883461 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717403d7a0 con 0x55777784a9f0 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 -- 172.21.15.22:0/56883461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 msgr2=0x557777871c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7174005b90 tx=0x7f7174009230 comp rx=0 tx=0).stop 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 -- 172.21.15.22:0/56883461 shutdown_connections 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x55777784c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784b310 0x557777872190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 --2- 172.21.15.22:0/56883461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784a9f0 0x557777871c50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 -- 172.21.15.22:0/56883461 >> 172.21.15.22:0/56883461 conn(0x557777847060 msgr2=0x557777847440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 -- 172.21.15.22:0/56883461 shutdown_connections 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.797+0000 7f71887dc740 1 -- 172.21.15.22:0/56883461 wait complete. 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 -- start start 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 Processor -- start 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x55777785d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x5577778d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71801aa290 con 0x55777784b310 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71801ab700 con 0x55777785a0c0 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71801aa960 con 0x55777784a9f0 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f71887dc740 10 client.0 _ll_register_callbacks cb 0x7f7174009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f717effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f717effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42830/0 (socket says 172.21.15.22:42830) 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.798+0000 7f717effd640 1 -- 172.21.15.22:0/3948461430 learned_addr learned my addr 172.21.15.22:0/3948461430 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 -- 172.21.15.22:0/3948461430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 msgr2=0x55777785d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x55777785d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 -- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 msgr2=0x5577778d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717e7fc640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x5577778d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x5577778d2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 -- 172.21.15.22:0/3948461430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577778d3220 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f717effd640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7170018000 tx=0x7f7170005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2f1272b00d4364 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170011440 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7174031640 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f71700115e0 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7170033020 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f71887dc740 10 client.16014 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5577778d4510 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7174031640 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.799+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7170038990 con 0x55777784b310 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 10 client.16014 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 20 client.16014 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5577778d4b30 0x5577778d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 4 client.16014 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577777b6d70 con 0x5577778d4b30 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f717e7fc640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5577778d4b30 0x5577778d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f715effd640 10 client.16014 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.800+0000 7f717e7fc640 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5577778d4b30 0x5577778d6f50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df796cdd3bd2463f server_cookie=43396bf1d0d962c in_seq=0 out_seq=0 2024-09-11T22:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.894+0000 7f715effd640 1 -- 172.21.15.22:0/3948461430 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577777b6d70 con 0x5577778d4b30 2024-09-11T22:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.894+0000 7f715effd640 10 client.16014 handle_command_reply: tid=0 2024-09-11T22:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.894+0000 7f71887dc740 1 client.16014 shutdown 2024-09-11T22:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 msgr2=0x55777785dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7170018000 tx=0x7f7170005c90 comp rx=0 tx=0).stop 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 shutdown_connections 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5577778d4b30 0x5577778d6f50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55777785a0c0 0x5577778d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55777784b310 0x55777785dbb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f715effd640 0 client.16014 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 --2- 172.21.15.22:0/3948461430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55777784a9f0 0x55777785d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 >> 172.21.15.22:0/3948461430 conn(0x557777847060 msgr2=0x5577778587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 shutdown_connections 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 1 -- 172.21.15.22:0/3948461430 wait complete. 2024-09-11T22:32:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f71887dc740 20 client.16014 trim_cache size 0 max 16384 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:{ 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "message": "", 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout: "return_code": 0 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stdout:} 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 msgr2=0x7f71680a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 0x7f71680a52e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f717800efd0 tx=0x7f717806aa50 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 msgr2=0x7f718019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.895+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f717800eaa0 tx=0x7f717800ef60 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 shutdown_connections 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f71680a2e20 0x7f71680a52e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71801080f0 0x7f718019cd10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7180101150 0x7f7180198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 --2- 172.21.15.22:0/3911886357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7180100830 0x7f7180198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 >> 172.21.15.22:0/3911886357 conn(0x7f7180075ec0 msgr2=0x7f71800ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 shutdown_connections 2024-09-11T22:32:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi022.front.sepia.ceph.com.smithi022.stderr:2024-09-11T22:32:10.896+0000 7f7185a47640 1 -- 172.21.15.22:0/3911886357 wait complete. 2024-09-11T22:32:11.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 -- 172.21.15.22:0/2492018808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274106f10 msgr2=0x7fb27410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 --2- 172.21.15.22:0/2492018808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274106f10 0x7fb27410ea90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 -- 172.21.15.22:0/2492018808 shutdown_connections 2024-09-11T22:32:11.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 --2- 172.21.15.22:0/2492018808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274106f10 0x7fb27410ea90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 --2- 172.21.15.22:0/2492018808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 0x7fb2741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 --2- 172.21.15.22:0/2492018808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274101de0 0x7fb2741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 -- 172.21.15.22:0/2492018808 >> 172.21.15.22:0/2492018808 conn(0x7fb2740fd8c0 msgr2=0x7fb2740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 -- 172.21.15.22:0/2492018808 shutdown_connections 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.250+0000 7fb27c61f640 1 -- 172.21.15.22:0/2492018808 wait complete. 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 Processor -- start 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 -- start start 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 0x7fb274074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274106f10 0x7fb274074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb274112090 con 0x7fb274101de0 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb274111f10 con 0x7fb274106f10 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27c61f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb274112210 con 0x7fb274102790 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42848/0 (socket says 172.21.15.22:42848) 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27a3bb640 1 -- 172.21.15.22:0/49959293 learned_addr learned my addr 172.21.15.22:0/49959293 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb27abbc640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274106f10 0x7fb274074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.251+0000 7fb279bba640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 0x7fb274074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 -- 172.21.15.22:0/49959293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 msgr2=0x7fb274074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 0x7fb274074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 -- 172.21.15.22:0/49959293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274106f10 msgr2=0x7fb274074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274106f10 0x7fb274074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 -- 172.21.15.22:0/49959293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2741a6920 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb27000d950 tx=0x7fb27000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb26b7fe640 1 -- 172.21.15.22:0/49959293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270017070 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb26b7fe640 1 -- 172.21.15.22:0/49959293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb270009c30 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb26b7fe640 1 -- 172.21.15.22:0/49959293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27000f740 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2741a6c10 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.252+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2741a71a0 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.254+0000 7fb26b7fe640 1 -- 172.21.15.22:0/49959293 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb270010a80 con 0x7fb274101de0 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 Processor -- start 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 -- start start 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36793a00 0x564f36793de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f367a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564f366f8200 con 0x564f36794320 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f3669edc0 con 0x564f36793a00 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f366f41c0 con 0x564f3679ebe0 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42856/0 (socket says 172.21.15.22:42856) 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1650807314 learned_addr learned my addr 172.21.15.22:0/1650807314 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.255+0000 7fb279bba640 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f367a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27abbc640 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36793a00 0x564f36793de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb26b7fe640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 0x7fb2600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1650807314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 msgr2=0x564f367a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f367a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1650807314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36793a00 msgr2=0x564f36793de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36793a00 0x564f36793de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1650807314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f36469620 con 0x564f36794320 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27abbc640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 0x7fb2600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb26b7fe640 1 -- 172.21.15.22:0/49959293 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb2700cef60 con 0x7fb274101de0 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb2700cc670 tx=0x7fb2700661b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94d07807b1db7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb268ff9640 1 -- 172.21.15.22:0/1650807314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270020070 con 0x564f36794320 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb268ff9640 1 -- 172.21.15.22:0/1650807314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb270009de0 con 0x564f36794320 2024-09-11T22:32:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.256+0000 7fb268ff9640 1 -- 172.21.15.22:0/1650807314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27006a2c0 con 0x564f36794320 2024-09-11T22:32:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1650807314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 msgr2=0x564f3679e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27abbc640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 0x7fb2600a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006010 tx=0x7fb26c03f040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb2700cc670 tx=0x7fb2700661b0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1650807314 shutdown_connections 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f367a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f3679e6a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1650807314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36793a00 0x564f36793de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1650807314 >> 172.21.15.22:0/1650807314 conn(0x564f3678ff90 msgr2=0x564f36790370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1650807314 shutdown_connections 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1650807314 wait complete. 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.257+0000 7fb27e9f8740 1 -- start start 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 Processor -- start 2024-09-11T22:32:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f3679b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f3679bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564f367a1750 con 0x564f36793a00 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f36692c50 con 0x564f36794320 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f367a18d0 con 0x564f3679ebe0 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27e9f8740 10 client.0 _ll_register_callbacks cb 0x564f366a4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42858/0 (socket says 172.21.15.22:42858) 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1762727954 learned_addr learned my addr 172.21.15.22:0/1762727954 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb279bba640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f3679b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1762727954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 msgr2=0x564f3679bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f3679bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 msgr2=0x564f3679b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f3679b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 -- 172.21.15.22:0/1762727954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f3679c520 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb270064f20 tx=0x7fb270010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0427a76f7e613fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.258+0000 7fb25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270020040 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb2700d2740 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb270009de0 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb27009b580 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 10 client.16026 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564f367ad2d0 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb270009de0 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fb270097bf0 con 0x564f36793a00 2024-09-11T22:32:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 10 client.16026 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 10 client.16026 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 20 client.16026 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f367ae620 0x564f367b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 4 client.16026 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.259+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f36705770 con 0x564f367ae620 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.260+0000 7fb279bba640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f367ae620 0x564f367b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.260+0000 7fb279bba640 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f367ae620 0x564f367b0a10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753a90a9daf68fa2 server_cookie=8f14aacc6f6262ec in_seq=0 out_seq=0 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.260+0000 7fb25dffb640 10 client.16026 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb25dffb640 1 -- 172.21.15.22:0/1762727954 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f36705770 con 0x564f367ae620 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb25dffb640 10 client.16026 handle_command_reply: tid=0 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 client.16026 shutdown 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 msgr2=0x564f3679e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb270064f20 tx=0x7fb270010e20 comp rx=0 tx=0).stop 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 shutdown_connections 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f367ae620 0x564f367b0a10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3679ebe0 0x564f3679bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f3679b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/1762727954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f3679e4e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb25dffb640 0 client.16026 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 >> 172.21.15.22:0/1762727954 conn(0x564f3678ff90 msgr2=0x564f3678f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 shutdown_connections 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 1 -- 172.21.15.22:0/1762727954 wait complete. 2024-09-11T22:32:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.261+0000 7fb27e9f8740 20 client.16026 trim_cache size 0 max 16384 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.278+0000 7fb27e9f8740 1 Processor -- start 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.278+0000 7fb27e9f8740 1 -- start start 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3678ff90 0x564f367aab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f367b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741ad9f0 con 0x564f36793a00 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741b0290 con 0x564f36794320 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741ae080 con 0x564f3678ff90 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42862/0 (socket says 172.21.15.22:42862) 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 -- 172.21.15.22:0/2294175018 learned_addr learned my addr 172.21.15.22:0/2294175018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27abbc640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f367b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3678ff90 0x564f367aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 -- 172.21.15.22:0/2294175018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3678ff90 msgr2=0x564f367aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3678ff90 0x564f367aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 -- 172.21.15.22:0/2294175018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 msgr2=0x564f367b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f367b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 -- 172.21.15.22:0/2294175018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f36790b40 con 0x564f36793a00 2024-09-11T22:32:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb27abbc640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f367b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb279bba640 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb26400ac30 tx=0x7fb264010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aa0280d07022d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.279+0000 7fb25ffff640 1 -- 172.21.15.22:0/2294175018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264004220 con 0x564f36793a00 2024-09-11T22:32:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb25ffff640 1 -- 172.21.15.22:0/2294175018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2640043c0 con 0x564f36793a00 2024-09-11T22:32:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb25ffff640 1 -- 172.21.15.22:0/2294175018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264003d30 con 0x564f36793a00 2024-09-11T22:32:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- 172.21.15.22:0/2294175018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 msgr2=0x564f367b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb26400ac30 tx=0x7fb264010800 comp rx=0 tx=0).stop 2024-09-11T22:32:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- 172.21.15.22:0/2294175018 shutdown_connections 2024-09-11T22:32:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f36794320 0x564f367b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36793a00 0x564f367b3a30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/2294175018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f3678ff90 0x564f367aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- 172.21.15.22:0/2294175018 >> 172.21.15.22:0/2294175018 conn(0x564f3679be30 msgr2=0x564f36796640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- 172.21.15.22:0/2294175018 shutdown_connections 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- 172.21.15.22:0/2294175018 wait complete. 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.280+0000 7fb27e9f8740 1 -- start start 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 Processor -- start 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f3678ff90 0x564f367b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f36793a00 0x564f367b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741ae750 con 0x564f36794320 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741afbc0 con 0x564f3678ff90 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2741aee20 con 0x564f36793a00 2024-09-11T22:32:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27e9f8740 10 client.0 _ll_register_callbacks cb 0x7fb26400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42866/0 (socket says 172.21.15.22:42866) 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 -- 172.21.15.22:0/721613810 learned_addr learned my addr 172.21.15.22:0/721613810 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f3678ff90 0x564f367b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb279bba640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f36793a00 0x564f367b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 -- 172.21.15.22:0/721613810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f36793a00 msgr2=0x564f367b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f36793a00 0x564f367b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 -- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f3678ff90 msgr2=0x564f367b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f3678ff90 0x564f367b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.281+0000 7fb27abbc640 1 -- 172.21.15.22:0/721613810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f367b2240 con 0x564f36794320 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb27abbc640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babf457d5bdc1b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c02f610 con 0x564f36794320 2024-09-11T22:32:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fb26c02f7b0 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2640043c0 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb26c057030 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb27e9f8740 10 client.16032 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564f36818f70 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2640043c0 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fb26c0305c0 con 0x564f36794320 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.282+0000 7fb27e9f8740 10 client.16032 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27e9f8740 10 client.16032 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27e9f8740 20 client.16032 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f3679ebe0 0x564f3681b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27e9f8740 4 client.16032 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x564f366ffc80 con 0x564f3679ebe0 2024-09-11T22:32:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f3679ebe0 0x564f3681b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb27a3bb640 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f3679ebe0 0x564f3681b780 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c41ed5de786dad server_cookie=6ca3fb65d10d952b in_seq=0 out_seq=0 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.283+0000 7fb25dffb640 10 client.16032 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb25dffb640 1 -- 172.21.15.22:0/721613810 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x564f366ffc80 con 0x564f3679ebe0 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb25dffb640 10 client.16032 handle_command_reply: tid=0 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 client.16032 shutdown 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 msgr2=0x564f367b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c031f40 comp rx=0 tx=0).stop 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 shutdown_connections 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x564f3679ebe0 0x564f3681b780 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564f36794320 0x564f367b1a10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f36793a00 0x564f367b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 --2- 172.21.15.22:0/721613810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f3678ff90 0x564f367b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 >> 172.21.15.22:0/721613810 conn(0x564f3679be30 msgr2=0x564f3678e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb25dffb640 0 client.16032 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 shutdown_connections 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 1 -- 172.21.15.22:0/721613810 wait complete. 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27e9f8740 20 client.16032 trim_cache size 0 max 16384 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 22, 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24497, 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 12, 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": {} 2024-09-11T22:32:11.290 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:32:11.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 msgr2=0x7fb2600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 0x7fb2600a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006010 tx=0x7fb26c03f040 comp rx=0 tx=0).stop 2024-09-11T22:32:11.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 msgr2=0x7fb2740744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:11.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb27000d950 tx=0x7fb27000de10 comp rx=0 tx=0).stop 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 shutdown_connections 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2600a2d70 0x7fb2600a5230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb274106f10 0x7fb274074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb274102790 0x7fb274074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.284+0000 7fb27c61f640 1 --2- 172.21.15.22:0/49959293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb274101de0 0x7fb2740744f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.285+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 >> 172.21.15.22:0/49959293 conn(0x7fb2740fd8c0 msgr2=0x7fb2740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.285+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 shutdown_connections 2024-09-11T22:32:11.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:11.285+0000 7fb27c61f640 1 -- 172.21.15.22:0/49959293 wait complete. 2024-09-11T22:32:12.062 INFO:tasks.quiescer:done joining Quiescers 2024-09-11T22:32:12.062 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-11T22:32:12.072 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:32:12.081 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-11T22:32:12.090 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-11T22:32:12.090 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:32:12.090 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:32:12.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-11T22:32:12.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:11 smithi022 ceph-mon[30966]: pgmap v98: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 66 op/s 2024-09-11T22:32:12.143 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:11 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:12.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-11T22:32:12.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:11 smithi169 ceph-mon[35628]: pgmap v98: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 66 op/s 2024-09-11T22:32:12.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:11 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:11 smithi045 ceph-mon[35556]: pgmap v98: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 66 op/s 2024-09-11T22:32:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:11 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:12 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:12 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:12 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:32:13.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:12 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:13.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:12 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:12 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:32:13.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:12 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:13.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:12 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:12 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:32:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:13 smithi022 ceph-mon[30966]: pgmap v99: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 65 op/s 2024-09-11T22:32:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:13 smithi169 ceph-mon[35628]: pgmap v99: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 65 op/s 2024-09-11T22:32:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:13 smithi045 ceph-mon[35556]: pgmap v99: 97 pgs: 97 active+clean; 134 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 415 KiB/s wr, 65 op/s 2024-09-11T22:32:16.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:15 smithi022 ceph-mon[30966]: pgmap v100: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 490 KiB/s wr, 140 op/s 2024-09-11T22:32:16.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:15 smithi169 ceph-mon[35628]: pgmap v100: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 490 KiB/s wr, 140 op/s 2024-09-11T22:32:16.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:15 smithi045 ceph-mon[35556]: pgmap v100: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 490 KiB/s wr, 140 op/s 2024-09-11T22:32:18.227 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:17 smithi045 ceph-mon[35556]: pgmap v101: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 468 KiB/s wr, 125 op/s 2024-09-11T22:32:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:17 smithi022 ceph-mon[30966]: pgmap v101: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 468 KiB/s wr, 125 op/s 2024-09-11T22:32:18.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:17 smithi169 ceph-mon[35628]: pgmap v101: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 468 KiB/s wr, 125 op/s 2024-09-11T22:32:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:19 smithi022 ceph-mon[30966]: pgmap v102: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 476 KiB/s wr, 135 op/s 2024-09-11T22:32:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:19 smithi169 ceph-mon[35628]: pgmap v102: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 476 KiB/s wr, 135 op/s 2024-09-11T22:32:20.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:19 smithi045 ceph-mon[35556]: pgmap v102: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 476 KiB/s wr, 135 op/s 2024-09-11T22:32:22.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:21 smithi022 ceph-mon[30966]: pgmap v103: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 96 op/s 2024-09-11T22:32:22.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:21 smithi169 ceph-mon[35628]: pgmap v103: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 96 op/s 2024-09-11T22:32:22.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:21 smithi045 ceph-mon[35556]: pgmap v103: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 96 op/s 2024-09-11T22:32:23.414 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:32:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:24.071 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:23 smithi022 ceph-mon[30966]: pgmap v104: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 87 op/s 2024-09-11T22:32:24.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 -- 172.21.15.22:0/2714066534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c102570 msgr2=0x7f370c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 --2- 172.21.15.22:0/2714066534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c102570 0x7f370c1029b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009900 tx=0x7f36f402a480 comp rx=0 tx=0).stop 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 -- 172.21.15.22:0/2714066534 shutdown_connections 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 --2- 172.21.15.22:0/2714066534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 --2- 172.21.15.22:0/2714066534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c102570 0x7f370c1029b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 --2- 172.21.15.22:0/2714066534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c100e20 0x7f370c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 -- 172.21.15.22:0/2714066534 >> 172.21.15.22:0/2714066534 conn(0x7f370c0fc7d0 msgr2=0x7f370c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 -- 172.21.15.22:0/2714066534 shutdown_connections 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 -- 172.21.15.22:0/2714066534 wait complete. 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.158+0000 7f3711fb3640 1 Processor -- start 2024-09-11T22:32:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 -- start start 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c102570 0x7f370c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1110a0 con 0x7f370c100e20 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f370c110f20 con 0x7f370c102570 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3711fb3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f370c111220 con 0x7f370c102ef0 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f370b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f370b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36242/0 (socket says 172.21.15.22:36242) 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f370b7fe640 1 -- 172.21.15.22:0/591354537 learned_addr learned my addr 172.21.15.22:0/591354537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.159+0000 7f3702ffd640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c102570 0x7f370c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370bfff640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 -- 172.21.15.22:0/591354537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 msgr2=0x7f370c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 -- 172.21.15.22:0/591354537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c102570 msgr2=0x7f370c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c102570 0x7f370c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 -- 172.21.15.22:0/591354537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c19d600 con 0x7f370c100e20 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370bfff640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f370b7fe640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d950 tx=0x7f36fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f37097fa640 1 -- 172.21.15.22:0/591354537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc017070 con 0x7f370c100e20 2024-09-11T22:32:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f37097fa640 1 -- 172.21.15.22:0/591354537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36fc009c30 con 0x7f370c100e20 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c19d8f0 con 0x7f370c100e20 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f37097fa640 1 -- 172.21.15.22:0/591354537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00f740 con 0x7f370c100e20 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.160+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c1a51d0 con 0x7f370c100e20 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f37097fa640 1 -- 172.21.15.22:0/591354537 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f36fc010a80 con 0x7f370c100e20 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 Processor -- start 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 -- start start 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55566761b2e0 con 0x5556676b54a0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5556675c2ce0 con 0x5556676c0680 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f371438c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556676172a0 con 0x5556676b5dc0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.163+0000 7f370bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36248/0 (socket says 172.21.15.22:36248) 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 -- 172.21.15.22:0/3108098708 learned_addr learned my addr 172.21.15.22:0/3108098708 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370b7fe640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f3702ffd640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 -- 172.21.15.22:0/3108098708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 msgr2=0x5556676c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 -- 172.21.15.22:0/3108098708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 msgr2=0x5556676c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 -- 172.21.15.22:0/3108098708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556675a7440 con 0x5556676b54a0 2024-09-11T22:32:24.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370b7fe640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f3702ffd640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f37097fa640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 0x7f36f80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370bfff640 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3704009f30 tx=0x7f3704010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c45d98c6a852d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f370b7fe640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 0x7f36f80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f37097fa640 1 -- 172.21.15.22:0/591354537 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f36fc0cefe0 con 0x7f370c100e20 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f3701ffb640 1 -- 172.21.15.22:0/3108098708 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704016070 con 0x5556676b54a0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.164+0000 7f3701ffb640 1 -- 172.21.15.22:0/3108098708 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f370401bb60 con 0x5556676b54a0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f3701ffb640 1 -- 172.21.15.22:0/3108098708 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704012d20 con 0x5556676b54a0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 -- 172.21.15.22:0/3108098708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 msgr2=0x5556676b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f370b7fe640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 0x7f36f80a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0cc830 tx=0x7f36fc086040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3704009f30 tx=0x7f3704010800 comp rx=0 tx=0).stop 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 -- 172.21.15.22:0/3108098708 shutdown_connections 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 --2- 172.21.15.22:0/3108098708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676b5880 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 -- 172.21.15.22:0/3108098708 >> 172.21.15.22:0/3108098708 conn(0x5556676b1a30 msgr2=0x5556676b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 -- 172.21.15.22:0/3108098708 shutdown_connections 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.165+0000 7f371438c740 1 -- 172.21.15.22:0/3108098708 wait complete. 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 -- start start 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 Processor -- start 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676bff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5556676c7660 con 0x5556676b5dc0 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5556675d6050 con 0x5556676b54a0 2024-09-11T22:32:24.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556676c77e0 con 0x5556676c0680 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f371438c740 10 client.0 _ll_register_callbacks cb 0x555667616160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f3702ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f3702ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36260/0 (socket says 172.21.15.22:36260) 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f3702ffd640 1 -- 172.21.15.22:0/2348986310 learned_addr learned my addr 172.21.15.22:0/2348986310 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.166+0000 7f370bfff640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f370bfff640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 -- 172.21.15.22:0/2348986310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 msgr2=0x5556676bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 -- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 msgr2=0x5556676bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676bff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 -- 172.21.15.22:0/2348986310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55566738c3c0 con 0x5556676b5dc0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f3702ffd640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36f402a9a0 tx=0x7f36f4031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c9145b5f8d256b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f36eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4035040 con 0x5556676b5dc0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f36f4004240 con 0x5556676b5dc0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f370401bb60 con 0x5556676b5dc0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f36f4004440 con 0x5556676b5dc0 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f371438c740 10 client.16044 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:24.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.167+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5556676d2fd0 con 0x5556676b5dc0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f370401bb60 con 0x5556676b5dc0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f36f40035f0 con 0x5556676b5dc0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 10 client.16044 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 20 client.16044 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x5556676d6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 4 client.16044 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555667628850 con 0x5556676d43e0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.168+0000 7f370bfff640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x5556676d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.169+0000 7f370bfff640 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x5556676d6820 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b71d6b58fc844f3 server_cookie=fdb4b341cdfa6d74 in_seq=0 out_seq=0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.169+0000 7f36eaffd640 10 client.16044 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.169+0000 7f36eaffd640 1 -- 172.21.15.22:0/2348986310 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555667628850 con 0x5556676d43e0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.169+0000 7f36eaffd640 10 client.16044 handle_command_reply: tid=0 2024-09-11T22:32:24.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.169+0000 7f371438c740 1 client.16044 shutdown 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 msgr2=0x5556676bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36f402a9a0 tx=0x7f36f4031900 comp rx=0 tx=0).stop 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 shutdown_connections 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x5556676d6820 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f36eaffd640 0 client.16044 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676bd220 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 --2- 172.21.15.22:0/2348986310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676bff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 >> 172.21.15.22:0/2348986310 conn(0x5556676b1a30 msgr2=0x5556676b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 shutdown_connections 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 1 -- 172.21.15.22:0/2348986310 wait complete. 2024-09-11T22:32:24.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.170+0000 7f371438c740 20 client.16044 trim_cache size 0 max 16384 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.187+0000 7f371438c740 1 Processor -- start 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.187+0000 7f371438c740 1 -- start start 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676dc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1a96a0 con 0x5556676b54a0 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1abf20 con 0x5556676c0680 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f371438c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1a9d10 con 0x5556676b5dc0 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36268/0 (socket says 172.21.15.22:36268) 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 -- 172.21.15.22:0/140961402 learned_addr learned my addr 172.21.15.22:0/140961402 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f3702ffd640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 -- 172.21.15.22:0/140961402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 msgr2=0x5556676dc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676dc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 -- 172.21.15.22:0/140961402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 msgr2=0x5556676dc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676dc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 -- 172.21.15.22:0/140961402 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556676bf930 con 0x5556676b54a0 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f3702ffd640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676dc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f370bfff640 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f37040128d0 tx=0x7f3704012900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc99f3976c2a52a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.188+0000 7f37017fa640 1 -- 172.21.15.22:0/140961402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704016040 con 0x5556676b54a0 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f37017fa640 1 -- 172.21.15.22:0/140961402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f370402f070 con 0x5556676b54a0 2024-09-11T22:32:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f37017fa640 1 -- 172.21.15.22:0/140961402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370401b7c0 con 0x5556676b54a0 2024-09-11T22:32:24.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 -- 172.21.15.22:0/140961402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 msgr2=0x5556676bea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f37040128d0 tx=0x7f3704012900 comp rx=0 tx=0).stop 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 -- 172.21.15.22:0/140961402 shutdown_connections 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676c0680 0x5556676dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676b5dc0 0x5556676dc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 --2- 172.21.15.22:0/140961402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b54a0 0x5556676bea80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.189+0000 7f371438c740 1 -- 172.21.15.22:0/140961402 >> 172.21.15.22:0/140961402 conn(0x5556676b1a30 msgr2=0x5556676b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.190+0000 7f371438c740 1 -- 172.21.15.22:0/140961402 shutdown_connections 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.190+0000 7f371438c740 1 -- 172.21.15.22:0/140961402 wait complete. 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.190+0000 7f371438c740 1 -- start start 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.190+0000 7f371438c740 1 Processor -- start 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1aa3e0 con 0x5556676b5dc0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1ab850 con 0x5556676b54a0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1aaab0 con 0x5556676c0680 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 10 client.0 _ll_register_callbacks cb 0x7f36f4031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36280/0 (socket says 172.21.15.22:36280) 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 -- 172.21.15.22:0/3907707874 learned_addr learned my addr 172.21.15.22:0/3907707874 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f370bfff640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f370bfff640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 -- 172.21.15.22:0/3907707874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 msgr2=0x5556676cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 -- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 msgr2=0x5556676ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 -- 172.21.15.22:0/3907707874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556676c02e0 con 0x5556676b5dc0 2024-09-11T22:32:24.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f3702ffd640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009850 tx=0x7f36f4003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95b5b3934194462 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f36eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4035070 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f36f4004190 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.191+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f370402f070 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f36f405c050 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 10 client.16050 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55566773f2c0 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f370402f070 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f36f4004aa0 con 0x5556676b5dc0 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 10 client.16050 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 20 client.16050 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:24.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x555667741a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 4 client.16050 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555667622d60 con 0x5556676d43e0 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.192+0000 7f370bfff640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x555667741a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f370bfff640 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x555667741a10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72313978b2a503b5 server_cookie=17c530f3c70d5c91 in_seq=0 out_seq=0 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f36eaffd640 10 client.16050 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f36eaffd640 1 -- 172.21.15.22:0/3907707874 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555667622d60 con 0x5556676d43e0 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f36eaffd640 10 client.16050 handle_command_reply: tid=0 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 client.16050 shutdown 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 msgr2=0x5556676cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009850 tx=0x7f36f4003e90 comp rx=0 tx=0).stop 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 shutdown_connections 2024-09-11T22:32:24.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5556676d43e0 0x555667741a10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f36eaffd640 0 client.16050 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556676c0680 0x5556676cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5556676b5dc0 0x5556676cadc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 --2- 172.21.15.22:0/3907707874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5556676b54a0 0x5556676ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 >> 172.21.15.22:0/3907707874 conn(0x5556676b1a30 msgr2=0x5556676bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 shutdown_connections 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.193+0000 7f371438c740 1 -- 172.21.15.22:0/3907707874 wait complete. 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f371438c740 20 client.16050 trim_cache size 0 max 16384 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:32:24.210 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 msgr2=0x7f36f80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 0x7f36f80a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0cc830 tx=0x7f36fc086040 comp rx=0 tx=0).stop 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 msgr2=0x7f370c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d950 tx=0x7f36fc00de10 comp rx=0 tx=0).stop 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 shutdown_connections 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f36f80a2d70 0x7f36f80a5230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f370c102ef0 0x7f370c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c102570 0x7f370c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 --2- 172.21.15.22:0/591354537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f370c100e20 0x7f370c198650 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:24.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 >> 172.21.15.22:0/591354537 conn(0x7f370c0fc7d0 msgr2=0x7f370c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:24.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 shutdown_connections 2024-09-11T22:32:24.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:24.194+0000 7f3711fb3640 1 -- 172.21.15.22:0/591354537 wait complete. 2024-09-11T22:32:24.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:23 smithi169 ceph-mon[35628]: pgmap v104: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 87 op/s 2024-09-11T22:32:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:23 smithi045 ceph-mon[35556]: pgmap v104: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 87 op/s 2024-09-11T22:32:25.070 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:32:25.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:32:25.331 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 -- 172.21.15.22:0/2766992062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494100e20 msgr2=0x7fe494101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 --2- 172.21.15.22:0/2766992062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494100e20 0x7fe494101200 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe484009900 tx=0x7fe48402a480 comp rx=0 tx=0).stop 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 -- 172.21.15.22:0/2766992062 shutdown_connections 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 --2- 172.21.15.22:0/2766992062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494102ef0 0x7fe49410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 --2- 172.21.15.22:0/2766992062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102570 0x7fe4941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.810+0000 7fe499485640 1 --2- 172.21.15.22:0/2766992062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494100e20 0x7fe494101200 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.811+0000 7fe499485640 1 -- 172.21.15.22:0/2766992062 >> 172.21.15.22:0/2766992062 conn(0x7fe4940fc7d0 msgr2=0x7fe4940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.811+0000 7fe499485640 1 -- 172.21.15.22:0/2766992062 shutdown_connections 2024-09-11T22:32:25.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.811+0000 7fe499485640 1 -- 172.21.15.22:0/2766992062 wait complete. 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 Processor -- start 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 -- start start 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494100e20 0x7fe4941a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 0x7fe49419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:25.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe494111070 con 0x7fe494102570 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe494110ef0 con 0x7fe494102ef0 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe499485640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941111f0 con 0x7fe494100e20 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe48bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe48bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36304/0 (socket says 172.21.15.22:36304) 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe48bfff640 1 -- 172.21.15.22:0/492572844 learned_addr learned my addr 172.21.15.22:0/492572844 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe492ffd640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494100e20 0x7fe4941a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.812+0000 7fe4937fe640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 0x7fe49419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 -- 172.21.15.22:0/492572844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494100e20 msgr2=0x7fe4941a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494100e20 0x7fe4941a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 -- 172.21.15.22:0/492572844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 msgr2=0x7fe49419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 0x7fe49419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:25.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 -- 172.21.15.22:0/492572844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49419b0d0 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe4937fe640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 0x7fe49419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe48bfff640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9f0 tx=0x7fe47c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00cd80 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49419b3c0 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe47c010930 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c018b00 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.813+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4941a7280 con 0x7fe494102570 2024-09-11T22:32:25.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.814+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe494101200 con 0x7fe494102570 2024-09-11T22:32:25.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.816+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe47c018ca0 con 0x7fe494102570 2024-09-11T22:32:25.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.817+0000 7fe490ff9640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 0x7fe4800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:25.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.817+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe47c0cfbd0 con 0x7fe494102570 2024-09-11T22:32:25.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.817+0000 7fe492ffd640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 0x7fe4800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:25.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.817+0000 7fe492ffd640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 0x7fe4800a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe484009230 tx=0x7fe4840058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:25.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:25.820+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe47c09c7e0 con 0x7fe494102570 2024-09-11T22:32:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.032+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4941a74b0 con 0x7fe494102570 2024-09-11T22:32:26.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.033+0000 7fe490ff9640 1 -- 172.21.15.22:0/492572844 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7fe47c09c0e0 con 0x7fe494102570 2024-09-11T22:32:26.035 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:32:26.035 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:32:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 msgr2=0x7fe4800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 0x7fe4800a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe484009230 tx=0x7fe4840058d0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 msgr2=0x7fe4941a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9f0 tx=0x7fe47c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 shutdown_connections 2024-09-11T22:32:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe4800a2cf0 0x7fe4800a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe494102ef0 0x7fe49419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe494102570 0x7fe4941a0960 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 --2- 172.21.15.22:0/492572844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe494100e20 0x7fe4941a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 >> 172.21.15.22:0/492572844 conn(0x7fe4940fc7d0 msgr2=0x7fe494103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 shutdown_connections 2024-09-11T22:32:26.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:26.035+0000 7fe499485640 1 -- 172.21.15.22:0/492572844 wait complete. 2024-09-11T22:32:26.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:25 smithi022 ceph-mon[30966]: pgmap v105: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 88 op/s 2024-09-11T22:32:26.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:25 smithi169 ceph-mon[35628]: pgmap v105: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 88 op/s 2024-09-11T22:32:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:25 smithi045 ceph-mon[35556]: pgmap v105: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 88 op/s 2024-09-11T22:32:26.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:32:27.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:27.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:26 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/492572844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:27.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:26 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/492572844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:27.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:26 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/492572844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:32:27.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 -- 172.21.15.22:0/2222579788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103740 msgr2=0x7f44c4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 --2- 172.21.15.22:0/2222579788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103740 0x7f44c4107b80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009930 tx=0x7f44b802a420 comp rx=0 tx=0).stop 2024-09-11T22:32:27.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 -- 172.21.15.22:0/2222579788 shutdown_connections 2024-09-11T22:32:27.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 --2- 172.21.15.22:0/2222579788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4108290 0x7f44c410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 --2- 172.21.15.22:0/2222579788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103740 0x7f44c4107b80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 --2- 172.21.15.22:0/2222579788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 -- 172.21.15.22:0/2222579788 >> 172.21.15.22:0/2222579788 conn(0x7f44c40fc7d0 msgr2=0x7f44c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 -- 172.21.15.22:0/2222579788 shutdown_connections 2024-09-11T22:32:27.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.445+0000 7f44c9571640 1 -- 172.21.15.22:0/2222579788 wait complete. 2024-09-11T22:32:27.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 Processor -- start 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 -- start start 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c41009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4103740 0x7f44c4100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4112240 con 0x7f44c4108290 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41120c0 con 0x7f44c4102d90 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.446+0000 7f44c9571640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41123c0 con 0x7f44c4103740 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c41009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36320/0 (socket says 172.21.15.22:36320) 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 -- 172.21.15.22:0/1179167553 learned_addr learned my addr 172.21.15.22:0/1179167553 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:27.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4103740 0x7f44c4100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 -- 172.21.15.22:0/1179167553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4103740 msgr2=0x7f44c4100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4103740 0x7f44c4100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 -- 172.21.15.22:0/1179167553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 msgr2=0x7f44c41009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c41009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 -- 172.21.15.22:0/1179167553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c41a6bb0 con 0x7f44c4108290 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c37fe640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009fd0 tx=0x7f44bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44abfff640 1 -- 172.21.15.22:0/1179167553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc011830 con 0x7f44c4108290 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c41a6ea0 con 0x7f44c4108290 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44abfff640 1 -- 172.21.15.22:0/1179167553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44bc016070 con 0x7f44c4108290 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.447+0000 7f44abfff640 1 -- 172.21.15.22:0/1179167553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00f2e0 con 0x7f44c4108290 2024-09-11T22:32:27.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.448+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c41a7360 con 0x7f44c4108290 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44abfff640 1 -- 172.21.15.22:0/1179167553 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f44bc01b460 con 0x7f44c4108290 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 Processor -- start 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 -- start start 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa6884090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6884a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aa67ea2f0 con 0x559aa688f370 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559aa6791cf0 con 0x559aa6885b40 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44cb94a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aa67e62b0 con 0x559aa68845d0 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44c27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44c27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36322/0 (socket says 172.21.15.22:36322) 2024-09-11T22:32:27.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44c27fc640 1 -- 172.21.15.22:0/1948274951 learned_addr learned my addr 172.21.15.22:0/1948274951 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa6884090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.451+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6884a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44abfff640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 0x7f44ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 -- 172.21.15.22:0/1948274951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 msgr2=0x559aa6884a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6884a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 -- 172.21.15.22:0/1948274951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 msgr2=0x559aa6884090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa6884090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 -- 172.21.15.22:0/1948274951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa67763a0 con 0x559aa688f370 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c37fe640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 0x7f44ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f44c40697d0 tx=0x7f44b8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0cb141906187e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44abfff640 1 -- 172.21.15.22:0/1179167553 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f44bc0ce8b0 con 0x7f44c4108290 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44a97fa640 1 -- 172.21.15.22:0/1948274951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8035070 con 0x559aa688f370 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44a97fa640 1 -- 172.21.15.22:0/1948274951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b80327c0 con 0x559aa688f370 2024-09-11T22:32:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.452+0000 7f44a97fa640 1 -- 172.21.15.22:0/1948274951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8004bc0 con 0x559aa688f370 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- 172.21.15.22:0/1948274951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 msgr2=0x559aa6891760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44c37fe640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 0x7f44ac0a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44bc097390 tx=0x7f44bc069e60 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f44c40697d0 tx=0x7f44b8005fd0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- 172.21.15.22:0/1948274951 shutdown_connections 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa688f370 0x559aa6891760 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6884a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1948274951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa6884090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- 172.21.15.22:0/1948274951 >> 172.21.15.22:0/1948274951 conn(0x559aa684d310 msgr2=0x559aa6880c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- 172.21.15.22:0/1948274951 shutdown_connections 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- 172.21.15.22:0/1948274951 wait complete. 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.453+0000 7f44cb94a740 1 -- start start 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 Processor -- start 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa688ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa688c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aa6892010 con 0x559aa6885b40 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559aa67a5060 con 0x559aa688f370 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aa6892190 con 0x559aa68845d0 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44cb94a740 10 client.0 _ll_register_callbacks cb 0x559aa64f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:27.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36338/0 (socket says 172.21.15.22:36338) 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 -- 172.21.15.22:0/3357927695 learned_addr learned my addr 172.21.15.22:0/3357927695 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c27fc640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa688ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c27fc640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa688c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 -- 172.21.15.22:0/3357927695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 msgr2=0x559aa688ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa688ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 -- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 msgr2=0x559aa688c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa688c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 -- 172.21.15.22:0/3357927695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa655b3c0 con 0x559aa6885b40 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c27fc640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa688c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f44b4011e60 tx=0x7f44b4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdd93b698a3ba3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.454+0000 7f44a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:27.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4003d80 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f44b4004b20 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44b80327c0 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f44b4004d20 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 10 client.16068 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559aa689db70 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b80327c0 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f44b401a070 con 0x559aa6885b40 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 10 client.16068 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 20 client.16068 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa689f0d0 0x559aa68a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 4 client.16068 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:27.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.455+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aa67f7860 con 0x559aa689f0d0 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.456+0000 7f44c27fc640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa689f0d0 0x559aa68a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.456+0000 7f44c27fc640 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa689f0d0 0x559aa68a14f0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b127397a47c30fd1 server_cookie=23c845fc53b4d6d8 in_seq=0 out_seq=0 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.456+0000 7f44a6ff5640 10 client.16068 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44a6ff5640 1 -- 172.21.15.22:0/3357927695 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559aa67f7860 con 0x559aa689f0d0 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44a6ff5640 10 client.16068 handle_command_reply: tid=0 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 client.16068 shutdown 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 msgr2=0x559aa688c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f44b4011e60 tx=0x7f44b4013830 comp rx=0 tx=0).stop 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 shutdown_connections 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa689f0d0 0x559aa68a14f0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa688c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa688c030 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 --2- 172.21.15.22:0/3357927695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa688ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 >> 172.21.15.22:0/3357927695 conn(0x559aa684d310 msgr2=0x559aa6886960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44a6ff5640 0 client.16068 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 shutdown_connections 2024-09-11T22:32:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 1 -- 172.21.15.22:0/3357927695 wait complete. 2024-09-11T22:32:27.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.457+0000 7f44cb94a740 20 client.16068 trim_cache size 0 max 16384 2024-09-11T22:32:27.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.470+0000 7f44cb94a740 1 Processor -- start 2024-09-11T22:32:27.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.470+0000 7f44cb94a740 1 -- start start 2024-09-11T22:32:27.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa689b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa688f370 0x559aa68a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41adb90 con 0x559aa68845d0 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41b03f0 con 0x559aa6885b40 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44cb94a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41ae1e0 con 0x559aa688f370 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36340/0 (socket says 172.21.15.22:36340) 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 -- 172.21.15.22:0/1362628945 learned_addr learned my addr 172.21.15.22:0/1362628945 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa689b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 -- 172.21.15.22:0/1362628945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa688f370 msgr2=0x559aa68a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa688f370 0x559aa68a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 -- 172.21.15.22:0/1362628945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 msgr2=0x559aa689b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa689b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 -- 172.21.15.22:0/1362628945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa688c9b0 con 0x559aa68845d0 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44c27fc640 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x559aa6885070 tx=0x7f44b8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5c56a1890809ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44a8ff9640 1 -- 172.21.15.22:0/1362628945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8035040 con 0x559aa68845d0 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44a8ff9640 1 -- 172.21.15.22:0/1362628945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b80035f0 con 0x559aa68845d0 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.471+0000 7f44a8ff9640 1 -- 172.21.15.22:0/1362628945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b803d6b0 con 0x559aa68845d0 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- 172.21.15.22:0/1362628945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 msgr2=0x559aa688c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x559aa6885070 tx=0x7f44b8005e80 comp rx=0 tx=0).stop 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- 172.21.15.22:0/1362628945 shutdown_connections 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa688f370 0x559aa68a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa6885b40 0x559aa689b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 --2- 172.21.15.22:0/1362628945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa68845d0 0x559aa688c000 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- 172.21.15.22:0/1362628945 >> 172.21.15.22:0/1362628945 conn(0x559aa684d310 msgr2=0x559aa688b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- 172.21.15.22:0/1362628945 shutdown_connections 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- 172.21.15.22:0/1362628945 wait complete. 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 -- start start 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.472+0000 7f44cb94a740 1 Processor -- start 2024-09-11T22:32:27.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6889ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa68979f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41ae8b0 con 0x559aa6885b40 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41afd20 con 0x559aa688f370 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41aef80 con 0x559aa68845d0 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44cb94a740 10 client.0 _ll_register_callbacks cb 0x7f44b40113e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36350/0 (socket says 172.21.15.22:36350) 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 -- 172.21.15.22:0/994177544 learned_addr learned my addr 172.21.15.22:0/994177544 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c27fc640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6889ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c27fc640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa68979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 -- 172.21.15.22:0/994177544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 msgr2=0x559aa6889ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6889ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 -- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 msgr2=0x559aa68979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa68979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 -- 172.21.15.22:0/994177544 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa68882e0 con 0x559aa6885b40 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44c2ffd640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f44b4000f80 tx=0x7f44b4013e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42cd77f674003e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.473+0000 7f44a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4028040 con 0x559aa6885b40 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f44b4003d80 con 0x559aa6885b40 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44b80035f0 con 0x559aa6885b40 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f44b403a050 con 0x559aa6885b40 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 10 client.16074 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559aa6908fc0 con 0x559aa6885b40 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b80035f0 con 0x559aa6885b40 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f44b402b030 con 0x559aa6885b40 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 10 client.16074 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 20 client.16074 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa6909790 0x559aa690bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 4 client.16074 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.474+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559aa67f1d70 con 0x559aa6909790 2024-09-11T22:32:27.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44c27fc640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa6909790 0x559aa690bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44c27fc640 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa6909790 0x559aa690bbb0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92de2cfd2540da53 server_cookie=a6addc93a623f54c in_seq=0 out_seq=0 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44a6ff5640 10 client.16074 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44a6ff5640 1 -- 172.21.15.22:0/994177544 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559aa67f1d70 con 0x559aa6909790 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44a6ff5640 10 client.16074 handle_command_reply: tid=0 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 client.16074 shutdown 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 msgr2=0x559aa6897450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f44b4000f80 tx=0x7f44b4013e70 comp rx=0 tx=0).stop 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 shutdown_connections 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559aa6909790 0x559aa690bbb0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559aa688f370 0x559aa68979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aa6885b40 0x559aa6897450 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44a6ff5640 0 client.16074 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 --2- 172.21.15.22:0/994177544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aa68845d0 0x559aa6889ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 >> 172.21.15.22:0/994177544 conn(0x559aa684d310 msgr2=0x559aa688a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 shutdown_connections 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.475+0000 7f44cb94a740 1 -- 172.21.15.22:0/994177544 wait complete. 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44cb94a740 20 client.16074 trim_cache size 0 max 16384 2024-09-11T22:32:27.484 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:32:27.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 msgr2=0x7f44ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 0x7f44ac0a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44bc097390 tx=0x7f44bc069e60 comp rx=0 tx=0).stop 2024-09-11T22:32:27.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 msgr2=0x7f44c4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009fd0 tx=0x7f44bc00b8e0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 shutdown_connections 2024-09-11T22:32:27.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44ac0a2cf0 0x7f44ac0a51b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4108290 0x7f44c4101470 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4103740 0x7f44c4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 --2- 172.21.15.22:0/1179167553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4102d90 0x7f44c41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 >> 172.21.15.22:0/1179167553 conn(0x7f44c40fc7d0 msgr2=0x7f44c4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 shutdown_connections 2024-09-11T22:32:27.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:27.476+0000 7f44c9571640 1 -- 172.21.15.22:0/1179167553 wait complete. 2024-09-11T22:32:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:27 smithi022 ceph-mon[30966]: pgmap v106: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 KiB/s wr, 13 op/s 2024-09-11T22:32:28.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:27 smithi169 ceph-mon[35628]: pgmap v106: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 KiB/s wr, 13 op/s 2024-09-11T22:32:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:27 smithi045 ceph-mon[35556]: pgmap v106: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 KiB/s wr, 13 op/s 2024-09-11T22:32:29.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:32:29.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:32:29.418 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:29.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 -- 172.21.15.22:0/607866395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708106f10 msgr2=0x7f970810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 --2- 172.21.15.22:0/607866395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708106f10 0x7f970810ea90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9700009ca0 tx=0x7f970002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 -- 172.21.15.22:0/607866395 shutdown_connections 2024-09-11T22:32:29.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 --2- 172.21.15.22:0/607866395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708106f10 0x7f970810ea90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 --2- 172.21.15.22:0/607866395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708102790 0x7f97081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 --2- 172.21.15.22:0/607866395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708101de0 0x7f97081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 -- 172.21.15.22:0/607866395 >> 172.21.15.22:0/607866395 conn(0x7f97080fd8c0 msgr2=0x7f97080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 -- 172.21.15.22:0/607866395 shutdown_connections 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.903+0000 7f970d7cf640 1 -- 172.21.15.22:0/607866395 wait complete. 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 Processor -- start 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 -- start start 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708101de0 0x7f97080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708106f10 0x7f9708074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97081120d0 con 0x7f9708102790 2024-09-11T22:32:29.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9708111f50 con 0x7f9708101de0 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.904+0000 7f970d7cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9708112250 con 0x7f9708106f10 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36362/0 (socket says 172.21.15.22:36362) 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 -- 172.21.15.22:0/1576892284 learned_addr learned my addr 172.21.15.22:0/1576892284 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f9706ffd640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708101de0 0x7f97080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97077fe640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708106f10 0x7f9708074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 -- 172.21.15.22:0/1576892284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708106f10 msgr2=0x7f9708074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708106f10 0x7f9708074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 -- 172.21.15.22:0/1576892284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708101de0 msgr2=0x7f97080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708101de0 0x7f97080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 -- 172.21.15.22:0/1576892284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97081a69c0 con 0x7f9708102790 2024-09-11T22:32:29.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f97067fc640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00d950 tx=0x7f96fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f96effff640 1 -- 172.21.15.22:0/1576892284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc017070 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f96effff640 1 -- 172.21.15.22:0/1576892284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f96fc009c30 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97081a6cb0 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f96effff640 1 -- 172.21.15.22:0/1576892284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00f740 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.905+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97081a71a0 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.907+0000 7f96effff640 1 -- 172.21.15.22:0/1576892284 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f96fc010a80 con 0x7f9708102790 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 Processor -- start 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 -- start start 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27637800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba2763a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba27592280 con 0x55ba2762cb60 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ba27539b10 con 0x55ba27637d40 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f970fba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba2758e240 con 0x55ba2762d480 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36364/0 (socket says 172.21.15.22:36364) 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f97077fe640 1 -- 172.21.15.22:0/2680219588 learned_addr learned my addr 172.21.15.22:0/2680219588 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.908+0000 7f96effff640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 0x7f96f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97067fc640 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba2763a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 -- 172.21.15.22:0/2680219588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 msgr2=0x55ba27637800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27637800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 -- 172.21.15.22:0/2680219588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 msgr2=0x55ba2763a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba2763a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 -- 172.21.15.22:0/2680219588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba275461f0 con 0x55ba2762cb60 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f96effff640 1 -- 172.21.15.22:0/1576892284 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f96fc0cf140 con 0x7f9708102790 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 0x7f96f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9700005cc0 tx=0x7f97000099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60362b9f87fce58a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f96ed7fa640 1 -- 172.21.15.22:0/2680219588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700041040 con 0x55ba2762cb60 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f97077fe640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 0x7f96f00a51b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f970004c000 tx=0x7f970004d000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f96ed7fa640 1 -- 172.21.15.22:0/2680219588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9700036070 con 0x55ba2762cb60 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.909+0000 7f96ed7fa640 1 -- 172.21.15.22:0/2680219588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970002fc20 con 0x55ba2762cb60 2024-09-11T22:32:29.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- 172.21.15.22:0/2680219588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 msgr2=0x55ba2762cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9700005cc0 tx=0x7f97000099e0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- 172.21.15.22:0/2680219588 shutdown_connections 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba2763a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27637800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 --2- 172.21.15.22:0/2680219588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba2762cf40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- 172.21.15.22:0/2680219588 >> 172.21.15.22:0/2680219588 conn(0x55ba276290f0 msgr2=0x55ba276294d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- 172.21.15.22:0/2680219588 shutdown_connections 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- 172.21.15.22:0/2680219588 wait complete. 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.910+0000 7f970fba8740 1 -- start start 2024-09-11T22:32:29.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 Processor -- start 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba276351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba276356e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba2763a910 con 0x55ba2762cb60 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ba2754cf10 con 0x55ba27637d40 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba2763aa90 con 0x55ba2762d480 2024-09-11T22:32:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f970fba8740 10 client.0 _ll_register_callbacks cb 0x55ba27515a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36378/0 (socket says 172.21.15.22:36378) 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 -- 172.21.15.22:0/117986959 learned_addr learned my addr 172.21.15.22:0/117986959 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f97077fe640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba276356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 -- 172.21.15.22:0/117986959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 msgr2=0x55ba276351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba276351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 -- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 msgr2=0x55ba276356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba276356e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 -- 172.21.15.22:0/117986959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba273036a0 con 0x55ba2762cb60 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f9706ffd640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f96f800d190 tx=0x7f96f800d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470043ad28b6666f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.911+0000 7f96eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f800de80 con 0x55ba2762cb60 2024-09-11T22:32:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f96f80125f0 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9700036070 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f96f8021050 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 10 client.16086 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba276465e0 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9700036070 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f96f8013c80 con 0x55ba2762cb60 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 10 client.16086 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 20 client.16086 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba27647aa0 0x55ba27649f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 4 client.16086 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.912+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba2759f7f0 con 0x55ba27647aa0 2024-09-11T22:32:29.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.913+0000 7f97067fc640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba27647aa0 0x55ba27649f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.913+0000 7f97067fc640 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba27647aa0 0x55ba27649f40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96b4b9fe0ba7dd1 server_cookie=17d3d982cb8b42f6 in_seq=0 out_seq=0 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.913+0000 7f96eaff5640 10 client.16086 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f96eaff5640 1 -- 172.21.15.22:0/117986959 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba2759f7f0 con 0x55ba27647aa0 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f96eaff5640 10 client.16086 handle_command_reply: tid=0 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 client.16086 shutdown 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 msgr2=0x55ba27634c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f96f800d190 tx=0x7f96f800d650 comp rx=0 tx=0).stop 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 shutdown_connections 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba27647aa0 0x55ba27649f40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba27637d40 0x55ba276356e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba276351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 --2- 172.21.15.22:0/117986959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba2762cb60 0x55ba27634c60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 >> 172.21.15.22:0/117986959 conn(0x55ba276290f0 msgr2=0x55ba27628270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f96eaff5640 0 client.16086 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:29.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 shutdown_connections 2024-09-11T22:32:29.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 1 -- 172.21.15.22:0/117986959 wait complete. 2024-09-11T22:32:29.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.914+0000 7f970fba8740 20 client.16086 trim_cache size 0 max 16384 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.931+0000 7f970fba8740 1 Processor -- start 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.931+0000 7f970fba8740 1 -- start start 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.931+0000 7f970fba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 0x55ba2762f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.931+0000 7f970fba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27636ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f970fba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f970fba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97081ada90 con 0x55ba27637d40 2024-09-11T22:32:29.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f970fba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f97081b0310 con 0x55ba2762cb60 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f970fba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97081ae100 con 0x55ba2762d480 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36390/0 (socket says 172.21.15.22:36390) 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 -- 172.21.15.22:0/1366605432 learned_addr learned my addr 172.21.15.22:0/1366605432 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f9706ffd640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 0x55ba2762f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 -- 172.21.15.22:0/1366605432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 msgr2=0x55ba27636ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97067fc640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27636ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27636ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 -- 172.21.15.22:0/1366605432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 msgr2=0x55ba2762f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 0x55ba2762f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 -- 172.21.15.22:0/1366605432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba27633c10 con 0x55ba27637d40 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f9706ffd640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 0x55ba2762f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97067fc640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27636ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f97077fe640 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9700009650 tx=0x7f9700005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92828a75a698884a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f96ecff9640 1 -- 172.21.15.22:0/1366605432 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700041040 con 0x55ba27637d40 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f96ecff9640 1 -- 172.21.15.22:0/1366605432 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9700055030 con 0x55ba27637d40 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.932+0000 7f96ecff9640 1 -- 172.21.15.22:0/1366605432 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700004420 con 0x55ba27637d40 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- 172.21.15.22:0/1366605432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 msgr2=0x55ba2764f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9700009650 tx=0x7f9700005ef0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- 172.21.15.22:0/1366605432 shutdown_connections 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2764f860 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762d480 0x55ba27636ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 --2- 172.21.15.22:0/1366605432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762cb60 0x55ba2762f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- 172.21.15.22:0/1366605432 >> 172.21.15.22:0/1366605432 conn(0x55ba276290f0 msgr2=0x55ba276363b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- 172.21.15.22:0/1366605432 shutdown_connections 2024-09-11T22:32:29.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- 172.21.15.22:0/1366605432 wait complete. 2024-09-11T22:32:29.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 -- start start 2024-09-11T22:32:29.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.933+0000 7f970fba8740 1 Processor -- start 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 0x55ba2763fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762d480 0x55ba27640220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f97081ae7d0 con 0x55ba27637d40 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f97081afc40 con 0x55ba2762d480 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97081aeea0 con 0x55ba2762cb60 2024-09-11T22:32:29.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f970fba8740 10 client.0 _ll_register_callbacks cb 0x7f96f800b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36402/0 (socket says 172.21.15.22:36402) 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 -- 172.21.15.22:0/485783648 learned_addr learned my addr 172.21.15.22:0/485783648 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97067fc640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762d480 0x55ba27640220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f9706ffd640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 0x55ba2763fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 -- 172.21.15.22:0/485783648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 msgr2=0x55ba2763fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 0x55ba2763fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 -- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762d480 msgr2=0x55ba27640220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762d480 0x55ba27640220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 -- 172.21.15.22:0/485783648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba27640860 con 0x55ba27637d40 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f9706ffd640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 0x55ba2763fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f97077fe640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9700031fd0 tx=0x7f970002fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad19f54c52460fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.934+0000 7f96eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:29.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700041030 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f97000042a0 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9700055030 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9700068050 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 10 client.16092 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba276b2d10 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9700055030 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9700030940 con 0x55ba27637d40 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 10 client.16092 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 20 client.16092 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba276b3040 0x55ba276b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 4 client.16092 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:32:29.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.935+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ba27599d00 con 0x55ba276b3040 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.936+0000 7f9706ffd640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba276b3040 0x55ba276b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.936+0000 7f96eaff5640 10 client.16092 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.936+0000 7f9706ffd640 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba276b3040 0x55ba276b5430 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d72fb7239ec6ed server_cookie=3316ef0280f015ed in_seq=0 out_seq=0 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f96eaff5640 1 -- 172.21.15.22:0/485783648 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ba27599d00 con 0x55ba276b3040 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f96eaff5640 10 client.16092 handle_command_reply: tid=0 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 client.16092 shutdown 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 msgr2=0x55ba2763ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9700031fd0 tx=0x7f970002fbd0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 shutdown_connections 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba276b3040 0x55ba276b5430 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba27637d40 0x55ba2763ccb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba2762d480 0x55ba27640220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 --2- 172.21.15.22:0/485783648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba2762cb60 0x55ba2763fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 >> 172.21.15.22:0/485783648 conn(0x55ba276290f0 msgr2=0x55ba27628270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f96eaff5640 0 client.16092 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.937+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 shutdown_connections 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970fba8740 1 -- 172.21.15.22:0/485783648 wait complete. 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970fba8740 20 client.16092 trim_cache size 0 max 16384 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "a42e170e-96ad-492b-85da-d8eb0e7cd84e", 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:32:29.945 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 msgr2=0x7f96f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 0x7f96f00a51b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f970004c000 tx=0x7f970004d000 comp rx=0 tx=0).stop 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 msgr2=0x7f9708074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00d950 tx=0x7f96fc00de10 comp rx=0 tx=0).stop 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 shutdown_connections 2024-09-11T22:32:29.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f96f00a2cf0 0x7f96f00a51b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9708106f10 0x7f9708074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9708102790 0x7f9708074a30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 --2- 172.21.15.22:0/1576892284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708101de0 0x7f97080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 >> 172.21.15.22:0/1576892284 conn(0x7f97080fd8c0 msgr2=0x7f97080fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 shutdown_connections 2024-09-11T22:32:29.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:29.938+0000 7f970d7cf640 1 -- 172.21.15.22:0/1576892284 wait complete. 2024-09-11T22:32:30.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:29 smithi022 ceph-mon[30966]: pgmap v107: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 KiB/s wr, 14 op/s 2024-09-11T22:32:30.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:29 smithi169 ceph-mon[35628]: pgmap v107: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 KiB/s wr, 14 op/s 2024-09-11T22:32:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:29 smithi045 ceph-mon[35556]: pgmap v107: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 KiB/s wr, 14 op/s 2024-09-11T22:32:30.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:32:30.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:32:31.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:31 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:32:31.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:31 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:31 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:32:31.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:31 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:31 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:32:31.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:31 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:31 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:32:31.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:31 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:31 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:32:31.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:31 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:31 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:32:31.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:31 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:32:31.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1059175276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8106f10 msgr2=0x7f63b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1059175276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8106f10 0x7f63b810ea90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009900 tx=0x7f63b002a410 comp rx=0 tx=0).stop 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1059175276 shutdown_connections 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1059175276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8106f10 0x7f63b810ea90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1059175276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8102790 0x7f63b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1059175276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8101de0 0x7f63b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1059175276 >> 172.21.15.22:0/1059175276 conn(0x7f63b80fd8c0 msgr2=0x7f63b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1059175276 shutdown_connections 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.427+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1059175276 wait complete. 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.428+0000 7f63bcd3b640 1 Processor -- start 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.428+0000 7f63bcd3b640 1 -- start start 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 0x7f63b8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8106f10 0x7f63b819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81120d0 con 0x7f63b8102790 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8111f50 con 0x7f63b8106f10 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8112250 con 0x7f63b8101de0 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36418/0 (socket says 172.21.15.22:36418) 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 -- 172.21.15.22:0/1895251702 learned_addr learned my addr 172.21.15.22:0/1895251702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8106f10 0x7f63b819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b659c640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 0x7f63b8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 -- 172.21.15.22:0/1895251702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 msgr2=0x7f63b8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 0x7f63b8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 -- 172.21.15.22:0/1895251702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8106f10 msgr2=0x7f63b819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8106f10 0x7f63b819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 -- 172.21.15.22:0/1895251702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b819d4c0 con 0x7f63b8102790 2024-09-11T22:32:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b659c640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 0x7f63b8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00ba50 tx=0x7f63ac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63a77fe640 1 -- 172.21.15.22:0/1895251702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac019070 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b819d7b0 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63a77fe640 1 -- 172.21.15.22:0/1895251702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63ac00cbe0 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63a77fe640 1 -- 172.21.15.22:0/1895251702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007770 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.429+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b81a5090 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.432+0000 7f63a77fe640 1 -- 172.21.15.22:0/1895251702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f63ac01c070 con 0x7f63b8102790 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.432+0000 7f63bf114740 1 Processor -- start 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 -- start start 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646931760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b646940550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b6468972e0 con 0x55b646940a90 2024-09-11T22:32:31.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b64683ece0 con 0x55b646931ca0 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63bf114740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b6468932a0 con 0x55b646931380 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63a77fe640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 0x7f63a00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b646940550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36434/0 (socket says 172.21.15.22:36434) 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 -- 172.21.15.22:0/3383803152 learned_addr learned my addr 172.21.15.22:0/3383803152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646931760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 0x7f63a00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63a77fe640 1 -- 172.21.15.22:0/1895251702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f63ac0ce950 con 0x7f63b8102790 2024-09-11T22:32:31.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 -- 172.21.15.22:0/3383803152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 msgr2=0x55b646931760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646931760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 -- 172.21.15.22:0/3383803152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 msgr2=0x55b646940550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b646940550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.433+0000 7f63b5d9b640 1 -- 172.21.15.22:0/3383803152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b646823440 con 0x55b646940a90 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63b659c640 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b646940550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63ac09b1e0 tx=0x7f63ac014e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380f2ecf79587348 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 0x7f63a00a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63b00315e0 tx=0x7f63b0009260 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63a4ff9640 1 -- 172.21.15.22:0/3383803152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0bb070 con 0x55b646940a90 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63a4ff9640 1 -- 172.21.15.22:0/3383803152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63ac09f320 con 0x55b646940a90 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.434+0000 7f63a4ff9640 1 -- 172.21.15.22:0/3383803152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0a3750 con 0x55b646940a90 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- 172.21.15.22:0/3383803152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 msgr2=0x55b646942e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63ac09b1e0 tx=0x7f63ac014e10 comp rx=0 tx=0).stop 2024-09-11T22:32:31.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- 172.21.15.22:0/3383803152 shutdown_connections 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b646942e80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b646940550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 --2- 172.21.15.22:0/3383803152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646931760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- 172.21.15.22:0/3383803152 >> 172.21.15.22:0/3383803152 conn(0x55b64692da30 msgr2=0x55b64692de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- 172.21.15.22:0/3383803152 shutdown_connections 2024-09-11T22:32:31.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- 172.21.15.22:0/3383803152 wait complete. 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 -- start start 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.435+0000 7f63bf114740 1 Processor -- start 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646940400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b646943660 con 0x55b646940a90 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b646852050 con 0x55b646931ca0 2024-09-11T22:32:31.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b6469437e0 con 0x55b646931380 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63bf114740 10 client.0 _ll_register_callbacks cb 0x55b646892160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36450/0 (socket says 172.21.15.22:36450) 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1861194915 learned_addr learned my addr 172.21.15.22:0/1861194915 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b659c640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646940400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1861194915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 msgr2=0x55b646940400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646940400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 msgr2=0x55b64693d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1861194915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6466083c0 con 0x55b646940a90 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b659c640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646940400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:31.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f63b0033000 tx=0x7f63b00095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7feb0d3241b4738e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.436+0000 7f639dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0050030 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f63b0004480 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ac09f320 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f63b005a050 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 10 client.16104 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b64694f0b0 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63ac09f320 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f63b00047a0 con 0x55b646940a90 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 10 client.16104 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 20 client.16104 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469505c0 0x55b646952a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 4 client.16104 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.437+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6468a4850 con 0x55b6469505c0 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.438+0000 7f63b659c640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469505c0 0x55b646952a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.438+0000 7f639dffb640 10 client.16104 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.438+0000 7f63b659c640 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469505c0 0x55b646952a10 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=751e5cb26437e37a server_cookie=4921f6ff05373453 in_seq=0 out_seq=0 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f639dffb640 1 -- 172.21.15.22:0/1861194915 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6468a4850 con 0x55b6469505c0 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f639dffb640 10 client.16104 handle_command_reply: tid=0 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 client.16104 shutdown 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 msgr2=0x55b64693dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f63b0033000 tx=0x7f63b00095a0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 shutdown_connections 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469505c0 0x55b646952a10 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b64693dd10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 --2- 172.21.15.22:0/1861194915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931380 0x55b646940400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 >> 172.21.15.22:0/1861194915 conn(0x55b64692da30 msgr2=0x55b646933790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f639dffb640 0 client.16104 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 shutdown_connections 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 1 -- 172.21.15.22:0/1861194915 wait complete. 2024-09-11T22:32:31.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.439+0000 7f63bf114740 20 client.16104 trim_cache size 0 max 16384 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.456+0000 7f63bf114740 1 Processor -- start 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.456+0000 7f63bf114740 1 -- start start 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646940a90 0x55b64693f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81a96f0 con 0x55b646931380 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81abf70 con 0x55b646931ca0 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63bf114740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81a9d60 con 0x55b646940a90 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36456/0 (socket says 172.21.15.22:36456) 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 -- 172.21.15.22:0/224785581 learned_addr learned my addr 172.21.15.22:0/224785581 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646940a90 0x55b64693f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 -- 172.21.15.22:0/224785581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646940a90 msgr2=0x55b64693f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646940a90 0x55b64693f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 -- 172.21.15.22:0/224785581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 msgr2=0x55b64693bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 -- 172.21.15.22:0/224785581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b646940770 con 0x55b646931380 2024-09-11T22:32:31.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f63b659c640 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63a8004700 tx=0x7f63a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68010375151191bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.457+0000 7f639ffff640 1 -- 172.21.15.22:0/224785581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8004020 con 0x55b646931380 2024-09-11T22:32:31.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f639ffff640 1 -- 172.21.15.22:0/224785581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63a80041c0 con 0x55b646931380 2024-09-11T22:32:31.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f639ffff640 1 -- 172.21.15.22:0/224785581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a801c7a0 con 0x55b646931380 2024-09-11T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 -- 172.21.15.22:0/224785581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 msgr2=0x55b64694c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63a8004700 tx=0x7f63a800cc40 comp rx=0 tx=0).stop 2024-09-11T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 -- 172.21.15.22:0/224785581 shutdown_connections 2024-09-11T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646940a90 0x55b64693f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931ca0 0x55b64693bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 --2- 172.21.15.22:0/224785581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646931380 0x55b64694c900 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 -- 172.21.15.22:0/224785581 >> 172.21.15.22:0/224785581 conn(0x55b64692da30 msgr2=0x55b64693ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 -- 172.21.15.22:0/224785581 shutdown_connections 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.458+0000 7f63bf114740 1 -- 172.21.15.22:0/224785581 wait complete. 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 -- start start 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 Processor -- start 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931380 0x55b646949180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 0x55b6469444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81aa430 con 0x55b646940a90 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81ab8a0 con 0x55b646931380 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81aab00 con 0x55b646931ca0 2024-09-11T22:32:31.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63bf114740 10 client.0 _ll_register_callbacks cb 0x7f63b0031460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36462/0 (socket says 172.21.15.22:36462) 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1670373415 learned_addr learned my addr 172.21.15.22:0/1670373415 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 0x55b6469444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b659c640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931380 0x55b646949180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1670373415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 msgr2=0x55b6469444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 0x55b6469444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931380 msgr2=0x55b646949180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931380 0x55b646949180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b6d9d640 1 -- 172.21.15.22:0/1670373415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6469451f0 con 0x55b646940a90 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.459+0000 7f63b5d9b640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 0x55b6469444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f63b6d9d640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f63b0004bc0 tx=0x7f63b0004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902524312c43e890 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:32:31.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0062070 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a80041c0 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f63b0003a00 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f63b006e050 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f63bf114740 10 client.16110 fetch_fsmap learned FSMap version 22 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b6469bb290 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63a80041c0 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.460+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f63b003e460 con 0x55b646940a90 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 10 client.16110 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 20 client.16110 populate_metadata read hostname 'smithi022' 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469bb950 0x55b6469bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 4 client.16110 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b64689ed60 con 0x55b6469bb950 2024-09-11T22:32:31.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63b659c640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469bb950 0x55b6469bdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63b659c640 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469bb950 0x55b6469bdd60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7032bac6e43f8ddb server_cookie=b8b8766549eaf482 in_seq=0 out_seq=0 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f639dffb640 10 client.16110 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f639dffb640 1 -- 172.21.15.22:0/1670373415 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b64689ed60 con 0x55b6469bb950 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f639dffb640 10 client.16110 handle_command_reply: tid=0 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.461+0000 7f63bf114740 1 client.16110 shutdown 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 msgr2=0x55b6469449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f63b0004bc0 tx=0x7f63b0004590 comp rx=0 tx=0).stop 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 shutdown_connections 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b6469bb950 0x55b6469bdd60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b646940a90 0x55b6469449f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b646931ca0 0x55b6469444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 --2- 172.21.15.22:0/1670373415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b646931380 0x55b646949180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 >> 172.21.15.22:0/1670373415 conn(0x55b64692da30 msgr2=0x55b64693f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f639dffb640 0 client.16110 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 shutdown_connections 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 1 -- 172.21.15.22:0/1670373415 wait complete. 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bf114740 20 client.16110 trim_cache size 0 max 16384 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout: "a42e170e-96ad-492b-85da-d8eb0e7cd84e": { 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:32:31.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "a42e170e-96ad-492b-85da-d8eb0e7cd84e", 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 msgr2=0x7f63a00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 0x7f63a00a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63b00315e0 tx=0x7f63b0009260 comp rx=0 tx=0).stop 2024-09-11T22:32:31.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 msgr2=0x7f63b8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.462+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00ba50 tx=0x7f63ac00bf10 comp rx=0 tx=0).stop 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 shutdown_connections 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63a00a2cf0 0x7f63a00a51b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b8106f10 0x7f63b819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63b8102790 0x7f63b8198a50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 --2- 172.21.15.22:0/1895251702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63b8101de0 0x7f63b8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 >> 172.21.15.22:0/1895251702 conn(0x7f63b80fd8c0 msgr2=0x7f63b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 shutdown_connections 2024-09-11T22:32:31.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:32:31.463+0000 7f63bcd3b640 1 -- 172.21.15.22:0/1895251702 wait complete. 2024-09-11T22:32:32.131 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:32 smithi022 ceph-mon[30966]: pgmap v108: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:32.162 INFO:tasks.cephfs.filesystem:scrub status for tag:a42e170e-96ad-492b-85da-d8eb0e7cd84e - {'path': '/', 'tag': 'a42e170e-96ad-492b-85da-d8eb0e7cd84e', 'options': 'recursive,force'} 2024-09-11T22:32:32.304 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:32 smithi169 ceph-mon[35628]: pgmap v108: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:32 smithi045 ceph-mon[35556]: pgmap v108: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:34 smithi022 ceph-mon[30966]: pgmap v109: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-11T22:32:34.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:34 smithi169 ceph-mon[35628]: pgmap v109: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-11T22:32:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:34 smithi045 ceph-mon[35556]: pgmap v109: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-11T22:32:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:35 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:32:35.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:35 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:32:35.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:35 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:32:36.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:36 smithi022 ceph-mon[30966]: pgmap v110: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:36.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:36 smithi169 ceph-mon[35628]: pgmap v110: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:36.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:36 smithi045 ceph-mon[35556]: pgmap v110: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T22:32:38.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:38 smithi022 ceph-mon[30966]: pgmap v111: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:38.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:38 smithi169 ceph-mon[35628]: pgmap v111: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:38.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:38 smithi045 ceph-mon[35556]: pgmap v111: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:40 smithi022 ceph-mon[30966]: pgmap v112: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:40.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:40 smithi169 ceph-mon[35628]: pgmap v112: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:40.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:40 smithi045 ceph-mon[35556]: pgmap v112: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:42.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:42 smithi022 ceph-mon[30966]: pgmap v113: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:42.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:42 smithi169 ceph-mon[35628]: pgmap v113: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:42.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:42 smithi045 ceph-mon[35556]: pgmap v113: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:44.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:44 smithi022 ceph-mon[30966]: pgmap v114: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:44.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:44 smithi169 ceph-mon[35628]: pgmap v114: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:44 smithi045 ceph-mon[35556]: pgmap v114: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:32:46.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:46 smithi022 ceph-mon[30966]: pgmap v115: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:46.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:46 smithi169 ceph-mon[35628]: pgmap v115: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:46.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:46 smithi045 ceph-mon[35556]: pgmap v115: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:32:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:48 smithi022 ceph-mon[30966]: pgmap v116: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:48 smithi169 ceph-mon[35628]: pgmap v116: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:48 smithi045 ceph-mon[35556]: pgmap v116: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:50 smithi022 ceph-mon[30966]: pgmap v117: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:50.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:50 smithi169 ceph-mon[35628]: pgmap v117: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:50 smithi045 ceph-mon[35556]: pgmap v117: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:52 smithi022 ceph-mon[30966]: pgmap v118: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:52.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:52 smithi169 ceph-mon[35628]: pgmap v118: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:52 smithi045 ceph-mon[35556]: pgmap v118: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:54 smithi022 ceph-mon[30966]: pgmap v119: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:54.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:54 smithi169 ceph-mon[35628]: pgmap v119: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:54.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:54 smithi045 ceph-mon[35556]: pgmap v119: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:56 smithi022 ceph-mon[30966]: pgmap v120: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:56.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:56 smithi169 ceph-mon[35628]: pgmap v120: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:56 smithi045 ceph-mon[35556]: pgmap v120: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:32:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:32:58 smithi022 ceph-mon[30966]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:58.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:32:58 smithi169 ceph-mon[35628]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:32:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:32:58 smithi045 ceph-mon[35556]: pgmap v121: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:00 smithi022 ceph-mon[30966]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:00.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:00 smithi169 ceph-mon[35628]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:00 smithi045 ceph-mon[35556]: pgmap v122: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:02.163 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:33:02.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:02 smithi022 ceph-mon[30966]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:02.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:02 smithi169 ceph-mon[35628]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:02.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:02 smithi045 ceph-mon[35556]: pgmap v123: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:02.440 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 -- 172.21.15.22:0/3515245459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428100a60 msgr2=0x7fc428100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 --2- 172.21.15.22:0/3515245459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428100a60 0x7fc428100ec0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc414009930 tx=0x7fc41402a420 comp rx=0 tx=0).stop 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 -- 172.21.15.22:0/3515245459 shutdown_connections 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 --2- 172.21.15.22:0/3515245459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428101400 0x7fc42810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 --2- 172.21.15.22:0/3515245459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428100a60 0x7fc428100ec0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 --2- 172.21.15.22:0/3515245459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428106a60 0x7fc428106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 -- 172.21.15.22:0/3515245459 >> 172.21.15.22:0/3515245459 conn(0x7fc4280fc780 msgr2=0x7fc4280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 -- 172.21.15.22:0/3515245459 shutdown_connections 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.018+0000 7fc42ee84640 1 -- 172.21.15.22:0/3515245459 wait complete. 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 Processor -- start 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 -- start start 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428100a60 0x7fc42819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428106a60 0x7fc42819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc428110f80 con 0x7fc428101400 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc428110e00 con 0x7fc428106a60 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42ee84640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc428111100 con 0x7fc428100a60 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc427fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc427fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38084/0 (socket says 172.21.15.22:38084) 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc427fff640 1 -- 172.21.15.22:0/1676358329 learned_addr learned my addr 172.21.15.22:0/1676358329 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42d421640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428106a60 0x7fc42819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.019+0000 7fc42cc20640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428100a60 0x7fc42819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 -- 172.21.15.22:0/1676358329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428100a60 msgr2=0x7fc42819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428100a60 0x7fc42819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 -- 172.21.15.22:0/1676358329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428106a60 msgr2=0x7fc42819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428106a60 0x7fc42819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 -- 172.21.15.22:0/1676358329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42819f6e0 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc427fff640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc414009230 tx=0x7fc414004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc425ffb640 1 -- 172.21.15.22:0/1676358329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41403f030 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc425ffb640 1 -- 172.21.15.22:0/1676358329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc414003af0 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42819f970 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc425ffb640 1 -- 172.21.15.22:0/1676358329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414035070 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.020+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4281a72b0 con 0x7fc428101400 2024-09-11T22:33:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.022+0000 7fc425ffb640 1 -- 172.21.15.22:0/1676358329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc414042030 con 0x7fc428101400 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 Processor -- start 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 -- start start 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab764a0 0x55bcbab76880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 0x55bcbab81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc425ffb640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 0x7fc4180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bcbaadc2e0 con 0x55bcbab81680 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bcbaa83ce0 con 0x55bcbab76dc0 2024-09-11T22:33:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc43125d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcbaad82a0 con 0x55bcbab764a0 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc427fff640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 0x7fc4180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38088/0 (socket says 172.21.15.22:38088) 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.023+0000 7fc42d421640 1 -- 172.21.15.22:0/2615344772 learned_addr learned my addr 172.21.15.22:0/2615344772 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab764a0 0x55bcbab76880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42cc20640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 0x55bcbab81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc425ffb640 1 -- 172.21.15.22:0/1676358329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc4140ef9a0 con 0x7fc428101400 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 -- 172.21.15.22:0/2615344772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab764a0 msgr2=0x55bcbab76880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab764a0 0x55bcbab76880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 -- 172.21.15.22:0/2615344772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 msgr2=0x55bcbab81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 0x55bcbab81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 -- 172.21.15.22:0/2615344772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbaa68440 con 0x55bcbab81680 2024-09-11T22:33:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42cc20640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 0x55bcbab81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc427fff640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 0x7fc4180a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4140b8480 tx=0x7fc4140b7c20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc42d421640 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc420012aa0 tx=0x7fc420009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a449bf843a549ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc412ffd640 1 -- 172.21.15.22:0/2615344772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420003a30 con 0x55bcbab81680 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc412ffd640 1 -- 172.21.15.22:0/2615344772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc420010d30 con 0x55bcbab81680 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.024+0000 7fc412ffd640 1 -- 172.21.15.22:0/2615344772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4200045c0 con 0x55bcbab81680 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- 172.21.15.22:0/2615344772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 msgr2=0x55bcbab83a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc420012aa0 tx=0x7fc420009a70 comp rx=0 tx=0).stop 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- 172.21.15.22:0/2615344772 shutdown_connections 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab83a70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab76dc0 0x55bcbab81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 --2- 172.21.15.22:0/2615344772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab764a0 0x55bcbab76880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- 172.21.15.22:0/2615344772 >> 172.21.15.22:0/2615344772 conn(0x55bcbab72a30 msgr2=0x55bcbab72e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- 172.21.15.22:0/2615344772 shutdown_connections 2024-09-11T22:33:03.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- 172.21.15.22:0/2615344772 wait complete. 2024-09-11T22:33:03.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 -- start start 2024-09-11T22:33:03.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.025+0000 7fc43125d740 1 Processor -- start 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 0x55bcbab7e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bcbab84250 con 0x55bcbab76dc0 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bcbaa97050 con 0x55bcbab764a0 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcbab843d0 con 0x55bcbab81680 2024-09-11T22:33:03.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc43125d740 10 client.0 _ll_register_callbacks cb 0x55bcbaad7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38098/0 (socket says 172.21.15.22:38098) 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 -- 172.21.15.22:0/1785288529 learned_addr learned my addr 172.21.15.22:0/1785288529 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42d421640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42d421640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 0x55bcbab7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 -- 172.21.15.22:0/1785288529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 msgr2=0x55bcbab7e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 0x55bcbab7e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 -- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 msgr2=0x55bcbab810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab810a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42cc20640 1 -- 172.21.15.22:0/1785288529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcba84d3c0 con 0x55bcbab76dc0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.026+0000 7fc42d421640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 0x55bcbab7e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc42cc20640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00b9a0 tx=0x7fc41c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb785e82c96830b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c003ea0 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc41c005220 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc420010d30 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc41c005420 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 10 client.16122 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bcbab8fd40 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc420010d30 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc41c019030 con 0x55bcbab76dc0 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 10 client.16122 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 20 client.16122 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbab91420 0x55bcbab93810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 4 client.16122 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.027+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcbaae9850 con 0x55bcbab91420 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.028+0000 7fc42d421640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbab91420 0x55bcbab93810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.028+0000 7fc42d421640 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbab91420 0x55bcbab93810 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=758dc93508f40925 server_cookie=84e92b63bc9cc923 in_seq=0 out_seq=0 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.028+0000 7fc407fff640 10 client.16122 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc407fff640 1 -- 172.21.15.22:0/1785288529 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcbaae9850 con 0x55bcbab91420 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc407fff640 10 client.16122 handle_command_reply: tid=0 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 client.16122 shutdown 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 msgr2=0x55bcbab7e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00b9a0 tx=0x7fc41c00bda0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 shutdown_connections 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbab91420 0x55bcbab93810 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab81680 0x55bcbab7e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab76dc0 0x55bcbab7e350 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc407fff640 0 client.16122 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 --2- 172.21.15.22:0/1785288529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.029+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 >> 172.21.15.22:0/1785288529 conn(0x55bcbab72a30 msgr2=0x55bcbab78710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.030+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 shutdown_connections 2024-09-11T22:33:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.030+0000 7fc43125d740 1 -- 172.21.15.22:0/1785288529 wait complete. 2024-09-11T22:33:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.030+0000 7fc43125d740 20 client.16122 trim_cache size 0 max 16384 2024-09-11T22:33:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 Processor -- start 2024-09-11T22:33:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 -- start start 2024-09-11T22:33:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab98e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281adaa0 con 0x55bcbab81680 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281b0320 con 0x55bcbab764a0 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc43125d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281ae110 con 0x55bcbab76dc0 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38108/0 (socket says 172.21.15.22:38108) 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 -- 172.21.15.22:0/1262006168 learned_addr learned my addr 172.21.15.22:0/1262006168 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42cc20640 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab98e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 -- 172.21.15.22:0/1262006168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 msgr2=0x55bcbab98e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab98e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 -- 172.21.15.22:0/1262006168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 msgr2=0x55bcbab8d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab8d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.047+0000 7fc42d421640 1 -- 172.21.15.22:0/1262006168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbab81410 con 0x55bcbab81680 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc42d421640 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc420012aa0 tx=0x7fc420014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728c5ef4f148834 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc4127fc640 1 -- 172.21.15.22:0/1262006168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420003a30 con 0x55bcbab81680 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc4127fc640 1 -- 172.21.15.22:0/1262006168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc420010d00 con 0x55bcbab81680 2024-09-11T22:33:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc4127fc640 1 -- 172.21.15.22:0/1262006168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420005970 con 0x55bcbab81680 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 -- 172.21.15.22:0/1262006168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 msgr2=0x55bcbab993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc420012aa0 tx=0x7fc420014040 comp rx=0 tx=0).stop 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 -- 172.21.15.22:0/1262006168 shutdown_connections 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbab993b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab98e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 --2- 172.21.15.22:0/1262006168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab8d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 -- 172.21.15.22:0/1262006168 >> 172.21.15.22:0/1262006168 conn(0x55bcbab72a30 msgr2=0x55bcbab803d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 -- 172.21.15.22:0/1262006168 shutdown_connections 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.048+0000 7fc43125d740 1 -- 172.21.15.22:0/1262006168 wait complete. 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 -- start start 2024-09-11T22:33:03.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 Processor -- start 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab85fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbabfae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281ae7e0 con 0x55bcbab81680 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281afc50 con 0x55bcbab764a0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281aeeb0 con 0x55bcbab76dc0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc43125d740 10 client.0 _ll_register_callbacks cb 0x7fc41c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbabfae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc42d421640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbabfae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38116/0 (socket says 172.21.15.22:38116) 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.049+0000 7fc42d421640 1 -- 172.21.15.22:0/3447322702 learned_addr learned my addr 172.21.15.22:0/3447322702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab85fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42d421640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 -- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 msgr2=0x55bcbab85a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab85a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 -- 172.21.15.22:0/3447322702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 msgr2=0x55bcbabfae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbabfae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 -- 172.21.15.22:0/3447322702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbabfb380 con 0x55bcbab76dc0 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc42cc20640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab85fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bcbab93aa0 tx=0x7fc41c003ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921eee1010c5620d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc407fff640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c011640 con 0x55bcbab76dc0 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fc41c023430 con 0x55bcbab76dc0 2024-09-11T22:33:03.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.050+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc420010d00 con 0x55bcbab76dc0 2024-09-11T22:33:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc41c023650 con 0x55bcbab76dc0 2024-09-11T22:33:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc43125d740 10 client.25564 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bcbabfc630 con 0x55bcbab76dc0 2024-09-11T22:33:03.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc420010d00 con 0x55bcbab76dc0 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc41c019030 con 0x55bcbab76dc0 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.054+0000 7fc43125d740 10 client.25564 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 10 client.25564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 20 client.25564 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbabfcdd0 0x55bcbabff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 4 client.25564 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bcbaae3d60 con 0x55bcbabfcdd0 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc42d421640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbabfcdd0 0x55bcbabff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc42d421640 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbabfcdd0 0x55bcbabff1f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dab04b936dbc136 server_cookie=413745f222c864b in_seq=0 out_seq=0 2024-09-11T22:33:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc407fff640 10 client.25564 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc407fff640 1 -- 172.21.15.22:0/3447322702 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bcbaae3d60 con 0x55bcbabfcdd0 2024-09-11T22:33:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc407fff640 10 client.25564 handle_command_reply: tid=0 2024-09-11T22:33:03.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.055+0000 7fc43125d740 1 client.25564 shutdown 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 msgr2=0x55bcbab85fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab85fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55bcbab93aa0 tx=0x7fc41c003ad0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 shutdown_connections 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55bcbabfcdd0 0x55bcbabff1f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bcbab81680 0x55bcbabfae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbab76dc0 0x55bcbab85fb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc407fff640 0 client.25564 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 --2- 172.21.15.22:0/3447322702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bcbab764a0 0x55bcbab85a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 >> 172.21.15.22:0/3447322702 conn(0x55bcbab72a30 msgr2=0x55bcbab71220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 shutdown_connections 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 1 -- 172.21.15.22:0/3447322702 wait complete. 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc43125d740 20 client.25564 trim_cache size 0 max 16384 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 msgr2=0x7fc4180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 0x7fc4180a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc4140b8480 tx=0x7fc4140b7c20 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 msgr2=0x7fc42819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.056+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc414009230 tx=0x7fc414004270 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 shutdown_connections 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc4180a2cf0 0x7fc4180a51b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428106a60 0x7fc42819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc428101400 0x7fc42819ac70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 --2- 172.21.15.22:0/1676358329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc428100a60 0x7fc42819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 >> 172.21.15.22:0/1676358329 conn(0x7fc4280fc780 msgr2=0x7fc42806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 shutdown_connections 2024-09-11T22:33:03.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:03.057+0000 7fc42ee84640 1 -- 172.21.15.22:0/1676358329 wait complete. 2024-09-11T22:33:03.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:33:03.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:33:04.209 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:04.330 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:04 smithi022 ceph-mon[30966]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:04.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:04 smithi169 ceph-mon[35628]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:04 smithi045 ceph-mon[35556]: pgmap v124: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 -- 172.21.15.22:0/2827267310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58102d40 msgr2=0x7fbd58103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/2827267310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58102d40 0x7fbd58103120 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009900 tx=0x7fbd4802a480 comp rx=0 tx=0).stop 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 -- 172.21.15.22:0/2827267310 shutdown_connections 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/2827267310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 0x7fbd5810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/2827267310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58103660 0x7fbd5810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/2827267310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58102d40 0x7fbd58103120 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 -- 172.21.15.22:0/2827267310 >> 172.21.15.22:0/2827267310 conn(0x7fbd580fc7a0 msgr2=0x7fbd580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 -- 172.21.15.22:0/2827267310 shutdown_connections 2024-09-11T22:33:04.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 -- 172.21.15.22:0/2827267310 wait complete. 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.640+0000 7fbd5d63a640 1 Processor -- start 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 -- start start 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58102d40 0x7fbd5819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 0x7fbd5819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbd58112090 con 0x7fbd58103660 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbd58111f10 con 0x7fbd5810c170 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd5d63a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd58112210 con 0x7fbd58102d40 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd567fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33372/0 (socket says 172.21.15.22:33372) 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd567fc640 1 -- 172.21.15.22:0/3466789666 learned_addr learned my addr 172.21.15.22:0/3466789666 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd577fe640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 0x7fbd5819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:04.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.641+0000 7fbd56ffd640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58102d40 0x7fbd5819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 -- 172.21.15.22:0/3466789666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58102d40 msgr2=0x7fbd5819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58102d40 0x7fbd5819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 -- 172.21.15.22:0/3466789666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 msgr2=0x7fbd5819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 0x7fbd5819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 -- 172.21.15.22:0/3466789666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5819f6e0 con 0x7fbd58103660 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd567fc640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c970 tx=0x7fbd4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40007bb0 con 0x7fbd58103660 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5819f9d0 con 0x7fbd58103660 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbd40007d50 con 0x7fbd58103660 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000f450 con 0x7fbd58103660 2024-09-11T22:33:04.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.642+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd581a72b0 con 0x7fbd58103660 2024-09-11T22:33:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.644+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd58103120 con 0x7fbd58103660 2024-09-11T22:33:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.645+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbd40005020 con 0x7fbd58103660 2024-09-11T22:33:04.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.645+0000 7fbd4ffff640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 0x7fbd440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.645+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fbd400cf0a0 con 0x7fbd58103660 2024-09-11T22:33:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.645+0000 7fbd56ffd640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 0x7fbd440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:04.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.646+0000 7fbd56ffd640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 0x7fbd440a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009230 tx=0x7fbd480058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:04.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.650+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd40014030 con 0x7fbd58103660 2024-09-11T22:33:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.862+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd581a74e0 con 0x7fbd58103660 2024-09-11T22:33:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.862+0000 7fbd4ffff640 1 -- 172.21.15.22:0/3466789666 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7fbd4009b760 con 0x7fbd58103660 2024-09-11T22:33:04.863 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:33:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:33:04.864 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 msgr2=0x7fbd440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 0x7fbd440a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009230 tx=0x7fbd480058d0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 msgr2=0x7fbd5819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000c970 tx=0x7fbd4000ce30 comp rx=0 tx=0).stop 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 shutdown_connections 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbd440a2cf0 0x7fbd440a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5810c170 0x7fbd5819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd58103660 0x7fbd5819ac70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 --2- 172.21.15.22:0/3466789666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd58102d40 0x7fbd5819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 >> 172.21.15.22:0/3466789666 conn(0x7fbd580fc7a0 msgr2=0x7fbd581008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 shutdown_connections 2024-09-11T22:33:04.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:04.864+0000 7fbd5d63a640 1 -- 172.21.15.22:0/3466789666 wait complete. 2024-09-11T22:33:05.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:05 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3466789666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:05.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:05 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3466789666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:05.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:05 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3466789666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:05.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:33:05.926 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:06.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:06 smithi022 ceph-mon[30966]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:06.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:06 smithi169 ceph-mon[35628]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:06 smithi045 ceph-mon[35556]: pgmap v125: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:06.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 -- 172.21.15.22:0/1257270969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 msgr2=0x7fea4010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 --2- 172.21.15.22:0/1257270969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4010da40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fea38009ca0 tx=0x7fea3802a950 comp rx=0 tx=0).stop 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 -- 172.21.15.22:0/1257270969 shutdown_connections 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 --2- 172.21.15.22:0/1257270969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4010da40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 --2- 172.21.15.22:0/1257270969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40102570 0x7fea401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 --2- 172.21.15.22:0/1257270969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40100e20 0x7fea40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 -- 172.21.15.22:0/1257270969 >> 172.21.15.22:0/1257270969 conn(0x7fea400fc7d0 msgr2=0x7fea400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 -- 172.21.15.22:0/1257270969 shutdown_connections 2024-09-11T22:33:06.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.415+0000 7fea477cf640 1 -- 172.21.15.22:0/1257270969 wait complete. 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 Processor -- start 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 -- start start 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 0x7fea40198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40102570 0x7fea40198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea401110a0 con 0x7fea40102ef0 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea40110f20 con 0x7fea40100e20 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea477cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea40111220 con 0x7fea40102570 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea45d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea45d6c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33390/0 (socket says 172.21.15.22:33390) 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea45d6c640 1 -- 172.21.15.22:0/2231733990 learned_addr learned my addr 172.21.15.22:0/2231733990 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea44d6a640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40102570 0x7fea40198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea4556b640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 0x7fea40198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea45d6c640 1 -- 172.21.15.22:0/2231733990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40102570 msgr2=0x7fea40198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.416+0000 7fea45d6c640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40102570 0x7fea40198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea45d6c640 1 -- 172.21.15.22:0/2231733990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 msgr2=0x7fea40198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea45d6c640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 0x7fea40198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea45d6c640 1 -- 172.21.15.22:0/2231733990 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4019d540 con 0x7fea40102ef0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea4556b640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 0x7fea40198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea45d6c640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fea38005cc0 tx=0x7fea3802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea367fc640 1 -- 172.21.15.22:0/2231733990 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38034040 con 0x7fea40102ef0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4019d7d0 con 0x7fea40102ef0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea367fc640 1 -- 172.21.15.22:0/2231733990 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea38030940 con 0x7fea40102ef0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea367fc640 1 -- 172.21.15.22:0/2231733990 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea380456e0 con 0x7fea40102ef0 2024-09-11T22:33:06.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.417+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea401a5110 con 0x7fea40102ef0 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.419+0000 7fea367fc640 1 -- 172.21.15.22:0/2231733990 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fea38037020 con 0x7fea40102ef0 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 Processor -- start 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 -- start start 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 0x556f61961a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea367fc640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 0x7fea2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 0x556f6196e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556f618c72f0 con 0x556f61962b40 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f6186ecf0 con 0x556f619615d0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea49ba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556f618c32b0 con 0x556f6196c370 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33404/0 (socket says 172.21.15.22:33404) 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea44d6a640 1 -- 172.21.15.22:0/1181525305 learned_addr learned my addr 172.21.15.22:0/1181525305 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea44d6a640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 0x7fea2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.420+0000 7fea367fc640 1 -- 172.21.15.22:0/2231733990 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea380f03f0 con 0x7fea40102ef0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea4556b640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 0x556f61961a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea45d6c640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 0x556f6196e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 -- 172.21.15.22:0/1181525305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 msgr2=0x556f6196e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 0x556f6196e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 -- 172.21.15.22:0/1181525305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 msgr2=0x556f61961a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 0x556f61961a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 -- 172.21.15.22:0/1181525305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f618533a0 con 0x556f61962b40 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea45d6c640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 0x556f6196e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea4556b640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 0x556f61961a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fea30014c80 tx=0x7fea300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9832dfb1872ee578 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea44d6a640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 0x7fea2c0a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea30011cb0 tx=0x7fea30016000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea2b7fe640 1 -- 172.21.15.22:0/1181525305 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30014620 con 0x556f61962b40 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea2b7fe640 1 -- 172.21.15.22:0/1181525305 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea30023070 con 0x556f61962b40 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.421+0000 7fea2b7fe640 1 -- 172.21.15.22:0/1181525305 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea300035f0 con 0x556f61962b40 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- 172.21.15.22:0/1181525305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 msgr2=0x556f61961090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fea30014c80 tx=0x7fea300117b0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- 172.21.15.22:0/1181525305 shutdown_connections 2024-09-11T22:33:06.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f6196c370 0x556f6196e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f619615d0 0x556f61961a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 --2- 172.21.15.22:0/1181525305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61961090 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- 172.21.15.22:0/1181525305 >> 172.21.15.22:0/1181525305 conn(0x556f6192a310 msgr2=0x556f6195dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- 172.21.15.22:0/1181525305 shutdown_connections 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- 172.21.15.22:0/1181525305 wait complete. 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 -- start start 2024-09-11T22:33:06.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.422+0000 7fea49ba8740 1 Processor -- start 2024-09-11T22:33:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f619697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556f6196f010 con 0x556f61962b40 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f61882060 con 0x556f6196c370 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556f6196f190 con 0x556f619615d0 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea49ba8740 10 client.0 _ll_register_callbacks cb 0x556f615d58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33416/0 (socket says 172.21.15.22:33416) 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 -- 172.21.15.22:0/3171559871 learned_addr learned my addr 172.21.15.22:0/3171559871 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea45d6c640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f619697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea4556b640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 -- 172.21.15.22:0/3171559871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 msgr2=0x556f6196bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 -- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 msgr2=0x556f619697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f619697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea44d6a640 1 -- 172.21.15.22:0/3171559871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f616383c0 con 0x556f61962b40 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.423+0000 7fea4556b640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea44d6a640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fea30009cc0 tx=0x7fea30014410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e92d7c97adeddc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30009d60 con 0x556f61962b40 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea30013460 con 0x556f61962b40 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea30023070 con 0x556f61962b40 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea30013660 con 0x556f61962b40 2024-09-11T22:33:06.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea49ba8740 10 client.16146 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556f6197ab40 con 0x556f61962b40 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea30023070 con 0x556f61962b40 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.424+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea3001d030 con 0x556f61962b40 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 10 client.16146 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 20 client.16146 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f6197c000 0x556f6197e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 4 client.16146 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f618d4860 con 0x556f6197c000 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea4556b640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f6197c000 0x556f6197e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea4556b640 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f6197c000 0x556f6197e3f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8463fe447006e0a5 server_cookie=2084c81b58c84d75 in_seq=0 out_seq=0 2024-09-11T22:33:06.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.425+0000 7fea28ff9640 10 client.16146 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea28ff9640 1 -- 172.21.15.22:0/3171559871 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f618d4860 con 0x556f6197c000 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea28ff9640 10 client.16146 handle_command_reply: tid=0 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 client.16146 shutdown 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 msgr2=0x556f61969090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fea30009cc0 tx=0x7fea30014410 comp rx=0 tx=0).stop 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 shutdown_connections 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f6197c000 0x556f6197e3f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f619697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f61969090 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 --2- 172.21.15.22:0/3171559871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea28ff9640 0 client.16146 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 >> 172.21.15.22:0/3171559871 conn(0x556f6192a310 msgr2=0x556f61963960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 shutdown_connections 2024-09-11T22:33:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.426+0000 7fea49ba8740 1 -- 172.21.15.22:0/3171559871 wait complete. 2024-09-11T22:33:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.427+0000 7fea49ba8740 20 client.16146 trim_cache size 0 max 16384 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.439+0000 7fea49ba8740 1 Processor -- start 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.439+0000 7fea49ba8740 1 -- start start 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 0x556f619782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f61964120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea401ab720 con 0x556f619615d0 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea401adfa0 con 0x556f6196c370 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea49ba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea401abd90 con 0x556f61962b40 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33432/0 (socket says 172.21.15.22:33432) 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 -- 172.21.15.22:0/4079201407 learned_addr learned my addr 172.21.15.22:0/4079201407 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea44d6a640 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 0x556f619782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 -- 172.21.15.22:0/4079201407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 msgr2=0x556f619782b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 0x556f619782b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 -- 172.21.15.22:0/4079201407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 msgr2=0x556f61964120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f61964120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 -- 172.21.15.22:0/4079201407 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f61969b40 con 0x556f619615d0 2024-09-11T22:33:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea44d6a640 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 0x556f619782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea4556b640 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x556f6197eb50 tx=0x7fea3c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754eed894c61d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea2affd640 1 -- 172.21.15.22:0/4079201407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c005230 con 0x556f619615d0 2024-09-11T22:33:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea2affd640 1 -- 172.21.15.22:0/4079201407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea3c0053d0 con 0x556f619615d0 2024-09-11T22:33:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.440+0000 7fea2affd640 1 -- 172.21.15.22:0/4079201407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c01a960 con 0x556f619615d0 2024-09-11T22:33:06.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- 172.21.15.22:0/4079201407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 msgr2=0x556f61968950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x556f6197eb50 tx=0x7fea3c009380 comp rx=0 tx=0).stop 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- 172.21.15.22:0/4079201407 shutdown_connections 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f61964120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f61962b40 0x556f619782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 --2- 172.21.15.22:0/4079201407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f619615d0 0x556f61968950 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- 172.21.15.22:0/4079201407 >> 172.21.15.22:0/4079201407 conn(0x556f6192a310 msgr2=0x556f61968180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- 172.21.15.22:0/4079201407 shutdown_connections 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- 172.21.15.22:0/4079201407 wait complete. 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.441+0000 7fea49ba8740 1 -- start start 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 Processor -- start 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f6196ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea401ac460 con 0x556f61962b40 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea401ad8d0 con 0x556f6196c370 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea401acb30 con 0x556f619615d0 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea49ba8740 10 client.0 _ll_register_callbacks cb 0x7fea30014a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33448/0 (socket says 172.21.15.22:33448) 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 -- 172.21.15.22:0/837143440 learned_addr learned my addr 172.21.15.22:0/837143440 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea45d6c640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f6196ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea4556b640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 -- 172.21.15.22:0/837143440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 msgr2=0x556f6196f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 -- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 msgr2=0x556f6196ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f6196ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.442+0000 7fea44d6a640 1 -- 172.21.15.22:0/837143440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f619e4e60 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea44d6a640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fea30014b50 tx=0x7fea3000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be85c2778533832 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3003f070 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea3c0053d0 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea3000fb50 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea30009b10 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea49ba8740 10 client.16152 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556f619e60d0 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea3c0053d0 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.443+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea3001d040 con 0x556f61962b40 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 10 client.16152 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 20 client.16152 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:06.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f619e6770 0x556f619e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 4 client.16152 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f618ced70 con 0x556f619e6770 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea4556b640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f619e6770 0x556f619e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea4556b640 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f619e6770 0x556f619e8b90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa217a62cf5083ac server_cookie=fd28cdf28f32b70f in_seq=0 out_seq=0 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea28ff9640 10 client.16152 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea28ff9640 1 -- 172.21.15.22:0/837143440 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f618ced70 con 0x556f619e6770 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea28ff9640 10 client.16152 handle_command_reply: tid=0 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.444+0000 7fea49ba8740 1 client.16152 shutdown 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 msgr2=0x556f6196f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fea30014b50 tx=0x7fea3000cc90 comp rx=0 tx=0).stop 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 shutdown_connections 2024-09-11T22:33:06.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x556f619e6770 0x556f619e8b90 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f6196c370 0x556f6196ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556f61962b40 0x556f6196f9c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 --2- 172.21.15.22:0/837143440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556f619615d0 0x556f6196f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 >> 172.21.15.22:0/837143440 conn(0x556f6192a310 msgr2=0x556f6196a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea28ff9640 0 client.16152 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 shutdown_connections 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 1 -- 172.21.15.22:0/837143440 wait complete. 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea49ba8740 20 client.16152 trim_cache size 0 max 16384 2024-09-11T22:33:06.451 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 msgr2=0x7fea2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 0x7fea2c0a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea30011cb0 tx=0x7fea30016000 comp rx=0 tx=0).stop 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 msgr2=0x7fea4019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fea38005cc0 tx=0x7fea3802f790 comp rx=0 tx=0).stop 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 shutdown_connections 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea2c0a2cf0 0x7fea2c0a51b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.445+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea40102ef0 0x7fea4019ce60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.446+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea40102570 0x7fea40198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.446+0000 7fea477cf640 1 --2- 172.21.15.22:0/2231733990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea40100e20 0x7fea40198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.446+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 >> 172.21.15.22:0/2231733990 conn(0x7fea400fc7d0 msgr2=0x7fea4006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.446+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 shutdown_connections 2024-09-11T22:33:06.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:06.446+0000 7fea477cf640 1 -- 172.21.15.22:0/2231733990 wait complete. 2024-09-11T22:33:08.206 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:33:08.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:33:08.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:08 smithi022 ceph-mon[30966]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:08.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:08 smithi169 ceph-mon[35628]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:08 smithi045 ceph-mon[35556]: pgmap v126: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:08.482 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 -- 172.21.15.22:0/3440308749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094101de0 msgr2=0x7f30941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 --2- 172.21.15.22:0/3440308749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094101de0 0x7f30941021c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3084009900 tx=0x7f308402a410 comp rx=0 tx=0).stop 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 -- 172.21.15.22:0/3440308749 shutdown_connections 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 --2- 172.21.15.22:0/3440308749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094106f10 0x7f309410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 --2- 172.21.15.22:0/3440308749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f30941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 --2- 172.21.15.22:0/3440308749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094101de0 0x7f30941021c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 -- 172.21.15.22:0/3440308749 >> 172.21.15.22:0/3440308749 conn(0x7f30940fd8c0 msgr2=0x7f30940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 -- 172.21.15.22:0/3440308749 shutdown_connections 2024-09-11T22:33:08.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.953+0000 7f3098b4c640 1 -- 172.21.15.22:0/3440308749 wait complete. 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 Processor -- start 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 -- start start 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094101de0 0x7f30941984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f3094198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3094112090 con 0x7f3094106f10 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3094111f10 con 0x7f3094101de0 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.954+0000 7f3098b4c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3094112210 con 0x7f3094102790 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33472/0 (socket says 172.21.15.22:33472) 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 -- 172.21.15.22:0/1537846132 learned_addr learned my addr 172.21.15.22:0/1537846132 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f309259c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094101de0 0x7f30941984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f308bfff640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f3094198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 -- 172.21.15.22:0/1537846132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 msgr2=0x7f3094198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f3094198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 -- 172.21.15.22:0/1537846132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094101de0 msgr2=0x7f30941984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094101de0 0x7f30941984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 -- 172.21.15.22:0/1537846132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309419d4a0 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f308bfff640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f3094198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3092d9d640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f308c00eaa0 tx=0x7f308c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f308b7fe640 1 -- 172.21.15.22:0/1537846132 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c00cdb0 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f308b7fe640 1 -- 172.21.15.22:0/1537846132 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f308c004b20 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309419d790 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f308b7fe640 1 -- 172.21.15.22:0/1537846132 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c011760 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.955+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30941a5070 con 0x7f3094106f10 2024-09-11T22:33:08.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f308b7fe640 1 -- 172.21.15.22:0/1537846132 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f308c004cd0 con 0x7f3094106f10 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 Processor -- start 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 -- start start 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72aab60 0x5596b72aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596b7210280 con 0x5596b72ab480 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5596b71b7b10 con 0x5596b72b5d40 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309af25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5596b720c240 con 0x5596b72aab60 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f308b7fe640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 0x7f30800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.958+0000 7f309259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33488/0 (socket says 172.21.15.22:33488) 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 -- 172.21.15.22:0/2087356789 learned_addr learned my addr 172.21.15.22:0/2087356789 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:08.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f3092d9d640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 0x7f30800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f308bfff640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72aab60 0x5596b72aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f308b7fe640 1 -- 172.21.15.22:0/1537846132 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f308c0cf670 con 0x7f3094106f10 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f308bfff640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 -- 172.21.15.22:0/2087356789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72aab60 msgr2=0x5596b72aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72aab60 0x5596b72aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 -- 172.21.15.22:0/2087356789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 msgr2=0x5596b72b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 -- 172.21.15.22:0/2087356789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b71c41f0 con 0x5596b72ab480 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f308bfff640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f309259c640 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3084009900 tx=0x7f3084005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e99d7dcd2163b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f3092d9d640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 0x7f30800a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f308c0cce10 tx=0x7f308c00cf50 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f3088ff9640 1 -- 172.21.15.22:0/2087356789 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084040070 con 0x5596b72ab480 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f3088ff9640 1 -- 172.21.15.22:0/2087356789 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084031a00 con 0x5596b72ab480 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.959+0000 7f3088ff9640 1 -- 172.21.15.22:0/2087356789 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084035040 con 0x5596b72ab480 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 -- 172.21.15.22:0/2087356789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 msgr2=0x5596b72b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3084009900 tx=0x7f3084005c00 comp rx=0 tx=0).stop 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 -- 172.21.15.22:0/2087356789 shutdown_connections 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72ab480 0x5596b72b5800 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 --2- 172.21.15.22:0/2087356789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72aab60 0x5596b72aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 -- 172.21.15.22:0/2087356789 >> 172.21.15.22:0/2087356789 conn(0x5596b72a70f0 msgr2=0x5596b72a74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 -- 172.21.15.22:0/2087356789 shutdown_connections 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.960+0000 7f309af25740 1 -- 172.21.15.22:0/2087356789 wait complete. 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 -- start start 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 Processor -- start 2024-09-11T22:33:08.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72ab480 0x5596b72b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596b72b8910 con 0x5596b72aab60 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5596b71caf10 con 0x5596b72b5d40 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5596b72b8a90 con 0x5596b72ab480 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309af25740 10 client.0 _ll_register_callbacks cb 0x5596b7193a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33504/0 (socket says 172.21.15.22:33504) 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f308bfff640 1 -- 172.21.15.22:0/796210714 learned_addr learned my addr 172.21.15.22:0/796210714 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.961+0000 7f309259c640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72ab480 0x5596b72b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 -- 172.21.15.22:0/796210714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72ab480 msgr2=0x5596b72b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72ab480 0x5596b72b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 -- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 msgr2=0x5596b72b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 -- 172.21.15.22:0/796210714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b6f816a0 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f308bfff640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f307c012ee0 tx=0x7f307c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a2ab80dcc9f7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f3079ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c00f440 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f307c00f5e0 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3084031a00 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f307c027050 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f309af25740 10 client.16164 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.962+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5596b72c4320 con 0x5596b72aab60 2024-09-11T22:33:08.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084031a00 con 0x5596b72aab60 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f307c00e7f0 con 0x5596b72aab60 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 10 client.16164 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 20 client.16164 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b72c5730 0x5596b72c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 4 client.16164 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596b721d7f0 con 0x5596b72c5730 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309259c640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b72c5730 0x5596b72c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f309259c640 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b72c5730 0x5596b72c7b40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294f54ff8971d6d server_cookie=ede6ee4b70b54a7d in_seq=0 out_seq=0 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.963+0000 7f3079ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f3079ffb640 1 -- 172.21.15.22:0/796210714 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596b721d7f0 con 0x5596b72c5730 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f3079ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 client.16164 shutdown 2024-09-11T22:33:08.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 msgr2=0x5596b72b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f307c012ee0 tx=0x7f307c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 shutdown_connections 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b72c5730 0x5596b72c7b40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72b5d40 0x5596b72b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72ab480 0x5596b72b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f3079ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 --2- 172.21.15.22:0/796210714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72b5770 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 >> 172.21.15.22:0/796210714 conn(0x5596b72a70f0 msgr2=0x5596b72a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.964+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 shutdown_connections 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.965+0000 7f309af25740 1 -- 172.21.15.22:0/796210714 wait complete. 2024-09-11T22:33:08.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.965+0000 7f309af25740 20 client.16164 trim_cache size 0 max 16384 2024-09-11T22:33:08.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 Processor -- start 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 -- start start 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ab890 con 0x5596b72aab60 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ae110 con 0x5596b72ab480 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309af25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30941abf00 con 0x5596b72b5d40 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33516/0 (socket says 172.21.15.22:33516) 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 -- 172.21.15.22:0/2508429263 learned_addr learned my addr 172.21.15.22:0/2508429263 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309259c640 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 -- 172.21.15.22:0/2508429263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 msgr2=0x5596b72cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 -- 172.21.15.22:0/2508429263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 msgr2=0x5596b72b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f308bfff640 1 -- 172.21.15.22:0/2508429263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b72b35c0 con 0x5596b72aab60 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.982+0000 7f309259c640 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f308bfff640 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f307c010460 tx=0x7f307c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19de0f721c42fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f307bfff640 1 -- 172.21.15.22:0/2508429263 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c00cdd0 con 0x5596b72aab60 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f307bfff640 1 -- 172.21.15.22:0/2508429263 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f307c00ede0 con 0x5596b72aab60 2024-09-11T22:33:08.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f307bfff640 1 -- 172.21.15.22:0/2508429263 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0054d0 con 0x5596b72aab60 2024-09-11T22:33:08.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f309af25740 1 -- 172.21.15.22:0/2508429263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 msgr2=0x5596b72ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.983+0000 7f309af25740 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f307c010460 tx=0x7f307c00cf80 comp rx=0 tx=0).stop 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- 172.21.15.22:0/2508429263 shutdown_connections 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- 172.21.15.22:0/2508429263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72ad5c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- 172.21.15.22:0/2508429263 >> 172.21.15.22:0/2508429263 conn(0x5596b72a70f0 msgr2=0x5596b72b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- 172.21.15.22:0/2508429263 shutdown_connections 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- 172.21.15.22:0/2508429263 wait complete. 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- start start 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 Processor -- start 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72bacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ac5d0 con 0x5596b72aab60 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30941ada40 con 0x5596b72ab480 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30941acca0 con 0x5596b72b5d40 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f309af25740 10 client.0 _ll_register_callbacks cb 0x7f307c012d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f308bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33530/0 (socket says 172.21.15.22:33530) 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.984+0000 7f308bfff640 1 -- 172.21.15.22:0/1505053403 learned_addr learned my addr 172.21.15.22:0/1505053403 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f309259c640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72bacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 -- 172.21.15.22:0/1505053403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 msgr2=0x5596b72bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 -- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 msgr2=0x5596b72bacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72bacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 -- 172.21.15.22:0/1505053403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b72bb830 con 0x5596b72aab60 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f308bfff640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f307c00ed60 tx=0x7f307c012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b38e45a7b81c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:08.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f3079ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c037030 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f307c030040 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f307c00ede0 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f307c00e3e0 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f309af25740 10 client.16170 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5596b73311d0 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.985+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f307c00ede0 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f307c010bc0 con 0x5596b72aab60 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 10 client.16170 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 20 client.16170 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b7331830 0x5596b7333c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:08.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 4 client.16170 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5596b7217d00 con 0x5596b7331830 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309259c640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b7331830 0x5596b7333c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f309259c640 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b7331830 0x5596b7333c20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1394f3ab61bf87d0 server_cookie=c08802cb40c205a8 in_seq=0 out_seq=0 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.986+0000 7f3079ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.987+0000 7f3079ffb640 1 -- 172.21.15.22:0/1505053403 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5596b7217d00 con 0x5596b7331830 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.987+0000 7f3079ffb640 10 client.16170 handle_command_reply: tid=0 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.987+0000 7f309af25740 1 client.16170 shutdown 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 msgr2=0x5596b72be230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f307c00ed60 tx=0x7f307c012ca0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 shutdown_connections 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5596b7331830 0x5596b7333c20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5596b72b5d40 0x5596b72bb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5596b72ab480 0x5596b72bacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3079ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:08.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 --2- 172.21.15.22:0/1505053403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b72aab60 0x5596b72be230 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 >> 172.21.15.22:0/1505053403 conn(0x5596b72a70f0 msgr2=0x5596b72a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 shutdown_connections 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 1 -- 172.21.15.22:0/1505053403 wait complete. 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f309af25740 20 client.16170 trim_cache size 0 max 16384 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "aba42f34-9526-4506-90df-760d83b78c27", 2024-09-11T22:33:08.993 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 msgr2=0x7f30800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 0x7f30800a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f308c0cce10 tx=0x7f308c00cf50 comp rx=0 tx=0).stop 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 msgr2=0x7f309419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f308c00eaa0 tx=0x7f308c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 shutdown_connections 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f30800a2cf0 0x7f30800a51b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3094106f10 0x7f309419cdc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3094102790 0x7f3094198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 --2- 172.21.15.22:0/1537846132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3094101de0 0x7f30941984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:08.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.988+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 >> 172.21.15.22:0/1537846132 conn(0x7f30940fd8c0 msgr2=0x7f30940feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:08.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.989+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 shutdown_connections 2024-09-11T22:33:08.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:08.989+0000 7f3098b4c640 1 -- 172.21.15.22:0/1537846132 wait complete. 2024-09-11T22:33:09.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:33:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:10 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:33:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.404 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:10 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:33:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: pgmap v127: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:33:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:33:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:33:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:10.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:10 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:33:10.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 -- 172.21.15.22:0/2904662340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c106f10 msgr2=0x7f054c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 --2- 172.21.15.22:0/2904662340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c106f10 0x7f054c10ea90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0544009ca0 tx=0x7f054402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 -- 172.21.15.22:0/2904662340 shutdown_connections 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 --2- 172.21.15.22:0/2904662340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c106f10 0x7f054c10ea90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 --2- 172.21.15.22:0/2904662340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c102790 0x7f054c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 --2- 172.21.15.22:0/2904662340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 0x7f054c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 -- 172.21.15.22:0/2904662340 >> 172.21.15.22:0/2904662340 conn(0x7f054c0fd8c0 msgr2=0x7f054c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 -- 172.21.15.22:0/2904662340 shutdown_connections 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.497+0000 7f055460e640 1 -- 172.21.15.22:0/2904662340 wait complete. 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 Processor -- start 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 -- start start 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 0x7f054c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c106f10 0x7f054c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1120e0 con 0x7f054c102790 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f054c111f60 con 0x7f054c101de0 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f055460e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f054c112260 con 0x7f054c106f10 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33544/0 (socket says 172.21.15.22:33544) 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 -- 172.21.15.22:0/4131505103 learned_addr learned my addr 172.21.15.22:0/4131505103 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f05523aa640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 0x7f054c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 -- 172.21.15.22:0/4131505103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c106f10 msgr2=0x7f054c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c106f10 0x7f054c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 -- 172.21.15.22:0/4131505103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 msgr2=0x7f054c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 0x7f054c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.498+0000 7f0551ba9640 1 -- 172.21.15.22:0/4131505103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c19d3f0 con 0x7f054c102790 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f0551ba9640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c920 tx=0x7f053c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f05437fe640 1 -- 172.21.15.22:0/4131505103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c007c70 con 0x7f054c102790 2024-09-11T22:33:10.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c19d6e0 con 0x7f054c102790 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f05437fe640 1 -- 172.21.15.22:0/4131505103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f053c007e10 con 0x7f054c102790 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f05437fe640 1 -- 172.21.15.22:0/4131505103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c018940 con 0x7f054c102790 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.499+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1a4fc0 con 0x7f054c102790 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.501+0000 7f05437fe640 1 -- 172.21.15.22:0/4131505103 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f053c018b20 con 0x7f054c102790 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.501+0000 7f05569e7740 1 Processor -- start 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 -- start start 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4baf7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb04a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c4ba5d2e0 con 0x558c4baf7dc0 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558c4ba04ce0 con 0x558c4baf74a0 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05569e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4ba592a0 con 0x558c4bb02680 2024-09-11T22:33:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05437fe640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 0x7f05380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33556/0 (socket says 172.21.15.22:33556) 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 -- 172.21.15.22:0/479805482 learned_addr learned my addr 172.21.15.22:0/479805482 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f0552bab640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4baf7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05437fe640 1 -- 172.21.15.22:0/4131505103 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f053c0cf500 con 0x7f054c102790 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f0551ba9640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb04a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f0552bab640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 0x7f05380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 -- 172.21.15.22:0/479805482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 msgr2=0x558c4bb04a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb04a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 -- 172.21.15.22:0/479805482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 msgr2=0x558c4baf7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4baf7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f05523aa640 1 -- 172.21.15.22:0/479805482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4b9e9440 con 0x558c4baf7dc0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.502+0000 7f0551ba9640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb04a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f05523aa640 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f054800bd10 tx=0x7f05480107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35605e3dbe52ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f0540ff9640 1 -- 172.21.15.22:0/479805482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548004030 con 0x558c4baf7dc0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f0540ff9640 1 -- 172.21.15.22:0/479805482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05480041d0 con 0x558c4baf7dc0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f0552bab640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 0x7f05380a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a60 tx=0x7f05440095c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f0540ff9640 1 -- 172.21.15.22:0/479805482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548011980 con 0x558c4baf7dc0 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f05569e7740 1 -- 172.21.15.22:0/479805482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 msgr2=0x558c4bb02140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f05569e7740 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f054800bd10 tx=0x7f05480107a0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.503+0000 7f05569e7740 1 -- 172.21.15.22:0/479805482 shutdown_connections 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb04a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf7dc0 0x558c4bb02140 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- 172.21.15.22:0/479805482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4baf7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- 172.21.15.22:0/479805482 >> 172.21.15.22:0/479805482 conn(0x558c4baf3a30 msgr2=0x558c4baf3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- 172.21.15.22:0/479805482 shutdown_connections 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- 172.21.15.22:0/479805482 wait complete. 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- start start 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 Processor -- start 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf74a0 0x558c4bb02030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4baff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c4bb05250 con 0x558c4bb02680 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558c4ba18050 con 0x558c4baf7dc0 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558c4bb053d0 con 0x558c4baf74a0 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f05569e7740 10 client.0 _ll_register_callbacks cb 0x558c4ba58160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.504+0000 7f0552bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33562/0 (socket says 172.21.15.22:33562) 2024-09-11T22:33:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 -- 172.21.15.22:0/609716322 learned_addr learned my addr 172.21.15.22:0/609716322 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0551ba9640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4baff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f05523aa640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf74a0 0x558c4bb02030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 -- 172.21.15.22:0/609716322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf74a0 msgr2=0x558c4bb02030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf74a0 0x558c4bb02030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 -- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 msgr2=0x558c4baff2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4baff2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 -- 172.21.15.22:0/609716322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4b7ce3c0 con 0x558c4bb02680 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0552bab640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0544035000 tx=0x7f0544005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff974ce44e18ffdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054404c030 con 0x558c4bb02680 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f054402fc50 con 0x558c4bb02680 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05480041d0 con 0x558c4bb02680 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0544055070 con 0x558c4bb02680 2024-09-11T22:33:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f05569e7740 10 client.16182 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.505+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558c4bb10bd0 con 0x558c4bb02680 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05480041d0 con 0x558c4bb02680 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0544031ce0 con 0x558c4bb02680 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 10 client.16182 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 20 client.16182 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb12090 0x558c4bb14510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 4 client.16182 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c4ba6a850 con 0x558c4bb12090 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05523aa640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb12090 0x558c4bb14510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f0535ffb640 10 client.16182 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.506+0000 7f05523aa640 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb12090 0x558c4bb14510 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8a05bb4ad6534e server_cookie=29586add323ea897 in_seq=0 out_seq=0 2024-09-11T22:33:10.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f0535ffb640 1 -- 172.21.15.22:0/609716322 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c4ba6a850 con 0x558c4bb12090 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f0535ffb640 10 client.16182 handle_command_reply: tid=0 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 client.16182 shutdown 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 msgr2=0x558c4baff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0544035000 tx=0x7f0544005ef0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 shutdown_connections 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb12090 0x558c4bb14510 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4baff880 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4baff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f0535ffb640 0 client.16182 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 --2- 172.21.15.22:0/609716322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf74a0 0x558c4bb02030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 >> 172.21.15.22:0/609716322 conn(0x558c4baf3a30 msgr2=0x558c4baf9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 shutdown_connections 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 1 -- 172.21.15.22:0/609716322 wait complete. 2024-09-11T22:33:10.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.507+0000 7f05569e7740 20 client.16182 trim_cache size 0 max 16384 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 Processor -- start 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 -- start start 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4bb0e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 0x558c4baf9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ab890 con 0x558c4bb02680 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ae110 con 0x558c4baf74a0 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05569e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1abf00 con 0x558c4baf7dc0 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f0552bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f0552bab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33564/0 (socket says 172.21.15.22:33564) 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f0552bab640 1 -- 172.21.15.22:0/1332990526 learned_addr learned my addr 172.21.15.22:0/1332990526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f05523aa640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4bb0e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f0551ba9640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 0x558c4baf9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.525+0000 7f0552bab640 1 -- 172.21.15.22:0/1332990526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 msgr2=0x558c4baf9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0552bab640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 0x558c4baf9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0552bab640 1 -- 172.21.15.22:0/1332990526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 msgr2=0x558c4bb0e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0552bab640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4bb0e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0552bab640 1 -- 172.21.15.22:0/1332990526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4baf46c0 con 0x558c4bb02680 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0551ba9640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 0x558c4baf9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f05523aa640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4bb0e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0552bab640 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0544009870 tx=0x7f0544009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32623932d3d3608 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0537fff640 1 -- 172.21.15.22:0/1332990526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054404c030 con 0x558c4bb02680 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0537fff640 1 -- 172.21.15.22:0/1332990526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0544036040 con 0x558c4bb02680 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f0537fff640 1 -- 172.21.15.22:0/1332990526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544042040 con 0x558c4bb02680 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f05569e7740 1 -- 172.21.15.22:0/1332990526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 msgr2=0x558c4bb19e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.526+0000 7f05569e7740 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0544009870 tx=0x7f0544009800 comp rx=0 tx=0).stop 2024-09-11T22:33:10.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- 172.21.15.22:0/1332990526 shutdown_connections 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4bb02680 0x558c4bb19e30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4baf7dc0 0x558c4baf9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- 172.21.15.22:0/1332990526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf74a0 0x558c4bb0e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- 172.21.15.22:0/1332990526 >> 172.21.15.22:0/1332990526 conn(0x558c4baf3a30 msgr2=0x558c4baf8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- 172.21.15.22:0/1332990526 shutdown_connections 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- 172.21.15.22:0/1332990526 wait complete. 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- start start 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 Processor -- start 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4bb05f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb06470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ac5d0 con 0x558c4baf74a0 2024-09-11T22:33:10.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ada40 con 0x558c4baf7dc0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1acca0 con 0x558c4bb02680 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05569e7740 10 client.0 _ll_register_callbacks cb 0x7f0544009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05523aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05523aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33578/0 (socket says 172.21.15.22:33578) 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.527+0000 7f05523aa640 1 -- 172.21.15.22:0/746304018 learned_addr learned my addr 172.21.15.22:0/746304018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0551ba9640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4bb05f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 -- 172.21.15.22:0/746304018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 msgr2=0x558c4bb06470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0552bab640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb06470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb06470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 -- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 msgr2=0x558c4bb05f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4bb05f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 -- 172.21.15.22:0/746304018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4bb06b10 con 0x558c4baf74a0 2024-09-11T22:33:10.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05523aa640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f054800bd10 tx=0x7f0548005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f28576126618ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480037f0 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0548003990 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0544036040 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0548003b90 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05569e7740 10 client.16188 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.528+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558c4bb7cc70 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0544036040 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0548011ba0 con 0x558c4baf74a0 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 10 client.16188 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 20 client.16188 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:10.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb7d280 0x558c4bb7f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 4 client.16188 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c4ba64d60 con 0x558c4bb7d280 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f0551ba9640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb7d280 0x558c4bb7f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f0535ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.529+0000 7f0551ba9640 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb7d280 0x558c4bb7f6a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ee9aebbc4096da server_cookie=f7af628ad8236d61 in_seq=0 out_seq=0 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f0535ffb640 1 -- 172.21.15.22:0/746304018 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c4ba64d60 con 0x558c4bb7d280 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f0535ffb640 10 client.16188 handle_command_reply: tid=0 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 client.16188 shutdown 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 msgr2=0x558c4bb0ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f054800bd10 tx=0x7f0548005d40 comp rx=0 tx=0).stop 2024-09-11T22:33:10.548 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:10.549 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:33:10.549 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:33:10.549 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:10.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 shutdown_connections 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558c4bb7d280 0x558c4bb7f6a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558c4bb02680 0x558c4bb06470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c4baf7dc0 0x558c4bb05f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 --2- 172.21.15.22:0/746304018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4baf74a0 0x558c4bb0ac00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f0535ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 >> 172.21.15.22:0/746304018 conn(0x558c4baf3a30 msgr2=0x558c4baf9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 shutdown_connections 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 1 -- 172.21.15.22:0/746304018 wait complete. 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.530+0000 7f05569e7740 20 client.16188 trim_cache size 0 max 16384 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 msgr2=0x7f05380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 0x7f05380a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a60 tx=0x7f05440095c0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 msgr2=0x7f054c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c920 tx=0x7f053c00cde0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 shutdown_connections 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f05380a2cf0 0x7f05380a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c106f10 0x7f054c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f054c102790 0x7f054c198980 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 --2- 172.21.15.22:0/4131505103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f054c101de0 0x7f054c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 >> 172.21.15.22:0/4131505103 conn(0x7f054c0fd8c0 msgr2=0x7f054c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 shutdown_connections 2024-09-11T22:33:10.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:10.531+0000 7f055460e640 1 -- 172.21.15.22:0/4131505103 wait complete. 2024-09-11T22:33:11.282 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:33:11.282 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:33:11.539 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:12.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 -- 172.21.15.22:0/1660459634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc102570 msgr2=0x7f52cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/1660459634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc102570 0x7f52cc1029b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009900 tx=0x7f52b402a480 comp rx=0 tx=0).stop 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 -- 172.21.15.22:0/1660459634 shutdown_connections 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/1660459634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 0x7f52cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/1660459634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc102570 0x7f52cc1029b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/1660459634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc100e20 0x7f52cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 -- 172.21.15.22:0/1660459634 >> 172.21.15.22:0/1660459634 conn(0x7f52cc0fc7d0 msgr2=0x7f52cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 -- 172.21.15.22:0/1660459634 shutdown_connections 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 -- 172.21.15.22:0/1660459634 wait complete. 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.017+0000 7f52d1c9f640 1 Processor -- start 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 -- start start 2024-09-11T22:33:12.048 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 0x7f52cc199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 0x7f52cc1a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc111070 con 0x7f52cc100e20 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc110ef0 con 0x7f52cc102570 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52d1c9f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1111f0 con 0x7f52cc102ef0 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33598/0 (socket says 172.21.15.22:33598) 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 -- 172.21.15.22:0/347768741 learned_addr learned my addr 172.21.15.22:0/347768741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52caffd640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 0x7f52cc199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cbfff640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 0x7f52cc1a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 -- 172.21.15.22:0/347768741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 msgr2=0x7f52cc1a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:12.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 0x7f52cc1a4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 -- 172.21.15.22:0/347768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 msgr2=0x7f52cc199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 0x7f52cc199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 -- 172.21.15.22:0/347768741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc1a49d0 con 0x7f52cc100e20 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52caffd640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 0x7f52cc199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.018+0000 7f52cb7fe640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00cce0 tx=0x7f52bc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.019+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc004b20 con 0x7f52cc100e20 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.019+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52bc004cc0 con 0x7f52cc100e20 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.019+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00f870 con 0x7f52cc100e20 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.019+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc1a4ba0 con 0x7f52cc100e20 2024-09-11T22:33:12.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.019+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc1a50b0 con 0x7f52cc100e20 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.020+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc101200 con 0x7f52cc100e20 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.021+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f52bc00fa10 con 0x7f52cc100e20 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.022+0000 7f52c8ff9640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 0x7f52b80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.022+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f52bc0cf8e0 con 0x7f52cc100e20 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.022+0000 7f52caffd640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 0x7f52b80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.022+0000 7f52caffd640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 0x7f52b80a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52cc06aac0 tx=0x7f52b4005a20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:12.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.025+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52bc014030 con 0x7f52cc100e20 2024-09-11T22:33:12.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.235+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52cc06a560 con 0x7f52cc100e20 2024-09-11T22:33:12.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:12 smithi022 ceph-mon[30966]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.236+0000 7f52c8ff9640 1 -- 172.21.15.22:0/347768741 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f52cc06a560 con 0x7f52cc100e20 2024-09-11T22:33:12.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:33:12.237 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:33:12.238 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 msgr2=0x7f52b80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 0x7f52b80a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52cc06aac0 tx=0x7f52b4005a20 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 msgr2=0x7f52cc199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00cce0 tx=0x7f52bc00a620 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 shutdown_connections 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52b80a2cf0 0x7f52b80a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102ef0 0x7f52cc1a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52cc102570 0x7f52cc199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 --2- 172.21.15.22:0/347768741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52cc100e20 0x7f52cc199410 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 >> 172.21.15.22:0/347768741 conn(0x7f52cc0fc7d0 msgr2=0x7f52cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 shutdown_connections 2024-09-11T22:33:12.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:12.239+0000 7f52d1c9f640 1 -- 172.21.15.22:0/347768741 wait complete. 2024-09-11T22:33:12.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:12 smithi169 ceph-mon[35628]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:12.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:12 smithi045 ceph-mon[35556]: pgmap v128: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:12.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:33:13.103 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:13 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/347768741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:13 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:13 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:13.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:13 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:13 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:13 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/347768741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:13 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:13 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:13 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:13.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:13 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:33:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:13 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/347768741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:13 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:13 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:13 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:13.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:13 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:33:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 -- 172.21.15.22:0/3688495008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300101de0 msgr2=0x7f43001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 --2- 172.21.15.22:0/3688495008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300101de0 0x7f43001021c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009900 tx=0x7f42fc02a410 comp rx=0 tx=0).stop 2024-09-11T22:33:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 -- 172.21.15.22:0/3688495008 shutdown_connections 2024-09-11T22:33:13.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 --2- 172.21.15.22:0/3688495008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300106f10 0x7f430010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 --2- 172.21.15.22:0/3688495008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300102790 0x7f43001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 --2- 172.21.15.22:0/3688495008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300101de0 0x7f43001021c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 -- 172.21.15.22:0/3688495008 >> 172.21.15.22:0/3688495008 conn(0x7f43000fd8c0 msgr2=0x7f43000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 -- 172.21.15.22:0/3688495008 shutdown_connections 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.631+0000 7f4307685640 1 -- 172.21.15.22:0/3688495008 wait complete. 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 Processor -- start 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 -- start start 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300101de0 0x7f4300198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4300112090 con 0x7f4300106f10 2024-09-11T22:33:13.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4300111f10 con 0x7f4300101de0 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4307685640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4300112210 con 0x7f4300102790 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4305c22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4305c22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33604/0 (socket says 172.21.15.22:33604) 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.632+0000 7f4305c22640 1 -- 172.21.15.22:0/1910764558 learned_addr learned my addr 172.21.15.22:0/1910764558 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305421640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300101de0 0x7f4300198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4304c20640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 -- 172.21.15.22:0/1910764558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 msgr2=0x7f4300198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 -- 172.21.15.22:0/1910764558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300101de0 msgr2=0x7f4300198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300101de0 0x7f4300198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 -- 172.21.15.22:0/1910764558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430019d540 con 0x7f4300106f10 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4305c22640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f42f800cad0 tx=0x7f42f800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f42f27fc640 1 -- 172.21.15.22:0/1910764558 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800ae20 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f42f27fc640 1 -- 172.21.15.22:0/1910764558 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f8004b20 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430019d830 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f42f27fc640 1 -- 172.21.15.22:0/1910764558 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800f780 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.633+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001a5110 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.635+0000 7f42f27fc640 1 -- 172.21.15.22:0/1910764558 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f42f8004cd0 con 0x7f4300106f10 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 Processor -- start 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 -- start start 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 0x55739fbe0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55739fb462f0 con 0x55739fbe1b40 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55739faedcf0 con 0x55739fbe05d0 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4309a5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55739fb422b0 con 0x55739fbeb370 2024-09-11T22:33:13.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f42f27fc640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 0x7f42ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33620/0 (socket says 172.21.15.22:33620) 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.636+0000 7f4304c20640 1 -- 172.21.15.22:0/1490529175 learned_addr learned my addr 172.21.15.22:0/1490529175 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4305c22640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 0x7f42ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4305421640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 0x55739fbe0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f42f27fc640 1 -- 172.21.15.22:0/1910764558 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f42f80cf450 con 0x7f4300106f10 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 -- 172.21.15.22:0/1490529175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 msgr2=0x55739fbed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 -- 172.21.15.22:0/1490529175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 msgr2=0x55739fbe0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 0x55739fbe0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 -- 172.21.15.22:0/1490529175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739fad23a0 con 0x55739fbe1b40 2024-09-11T22:33:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4305421640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 0x55739fbe0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4304c20640 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f42f40058c0 tx=0x7f42f4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f4b037f0e95659 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f4305c22640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 0x7f42ec0a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42f809b8f0 tx=0x7f42f8090df0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f42eb7fe640 1 -- 172.21.15.22:0/1490529175 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40150f0 con 0x55739fbe1b40 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f42eb7fe640 1 -- 172.21.15.22:0/1490529175 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f4005520 con 0x55739fbe1b40 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.637+0000 7f42eb7fe640 1 -- 172.21.15.22:0/1490529175 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40134c0 con 0x55739fbe1b40 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- 172.21.15.22:0/1490529175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 msgr2=0x55739fbe0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f42f40058c0 tx=0x7f42f4009570 comp rx=0 tx=0).stop 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- 172.21.15.22:0/1490529175 shutdown_connections 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe05d0 0x55739fbe0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1490529175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe1b40 0x55739fbe0090 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- 172.21.15.22:0/1490529175 >> 172.21.15.22:0/1490529175 conn(0x55739fba9310 msgr2=0x55739fbdcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- 172.21.15.22:0/1490529175 shutdown_connections 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- 172.21.15.22:0/1490529175 wait complete. 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.638+0000 7f4309a5e740 1 -- start start 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 Processor -- start 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 0x55739fbe7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbeb370 0x55739fbe84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55739fbee010 con 0x55739fbe05d0 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55739fb01060 con 0x55739fbeb370 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55739fbee190 con 0x55739fbe1b40 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4309a5e740 10 client.0 _ll_register_callbacks cb 0x55739f8548c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33628/0 (socket says 172.21.15.22:33628) 2024-09-11T22:33:13.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 -- 172.21.15.22:0/3638058227 learned_addr learned my addr 172.21.15.22:0/3638058227 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4305421640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 0x55739fbe7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbeb370 0x55739fbe84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 -- 172.21.15.22:0/3638058227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 msgr2=0x55739fbe7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 0x55739fbe7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 -- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbeb370 msgr2=0x55739fbe84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbeb370 0x55739fbe84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4304c20640 1 -- 172.21.15.22:0/3638058227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739f8b73c0 con 0x55739fbe05d0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.639+0000 7f4305421640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 0x55739fbe7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4304c20640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005850 tx=0x7f42f40096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc62d34e46b801a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40048d0 con 0x55739fbe05d0 2024-09-11T22:33:13.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f4005520 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f42f4004fa0 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f42f40051a0 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 10 client.16206 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55739fbf9a20 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f4005520 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f42f400c070 con 0x55739fbe05d0 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 10 client.16206 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 20 client.16206 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fbfae30 0x55739fbfd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 4 client.16206 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.640+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55739fb53860 con 0x55739fbfae30 2024-09-11T22:33:13.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.641+0000 7f4305421640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fbfae30 0x55739fbfd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.641+0000 7f4305421640 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fbfae30 0x55739fbfd220 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1da841a8ac3cd5ed server_cookie=e020cac61141a745 in_seq=0 out_seq=0 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.641+0000 7f42e8ff9640 10 client.16206 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f42e8ff9640 1 -- 172.21.15.22:0/3638058227 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55739fb53860 con 0x55739fbfae30 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f42e8ff9640 10 client.16206 handle_command_reply: tid=0 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 client.16206 shutdown 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 msgr2=0x55739fbeacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005850 tx=0x7f42f40096a0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 shutdown_connections 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fbfae30 0x55739fbfd220 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbeb370 0x55739fbe84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbe1b40 0x55739fbe7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f42e8ff9640 0 client.16206 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3638058227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbeacd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 >> 172.21.15.22:0/3638058227 conn(0x55739fba9310 msgr2=0x55739fbe2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 shutdown_connections 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 1 -- 172.21.15.22:0/3638058227 wait complete. 2024-09-11T22:33:13.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.642+0000 7f4309a5e740 20 client.16206 trim_cache size 0 max 16384 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 Processor -- start 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 -- start start 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbe3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbe3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ab900 con 0x55739fbe05d0 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ae180 con 0x55739fbe1b40 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4309a5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43001abf70 con 0x55739fbeb370 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33632/0 (socket says 172.21.15.22:33632) 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 -- 172.21.15.22:0/3242293069 learned_addr learned my addr 172.21.15.22:0/3242293069 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4305421640 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbe3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 -- 172.21.15.22:0/3242293069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 msgr2=0x55739fbe3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbe3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 -- 172.21.15.22:0/3242293069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 msgr2=0x55739fbe3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbe3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 -- 172.21.15.22:0/3242293069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739fbe1750 con 0x55739fbe05d0 2024-09-11T22:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.656+0000 7f4304c20640 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42f40150c0 tx=0x7f42f4005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7197f78199968cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f42eaffd640 1 -- 172.21.15.22:0/3242293069 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4033030 con 0x55739fbe05d0 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f42eaffd640 1 -- 172.21.15.22:0/3242293069 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f40092a0 con 0x55739fbe05d0 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f42eaffd640 1 -- 172.21.15.22:0/3242293069 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4027030 con 0x55739fbe05d0 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 -- 172.21.15.22:0/3242293069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 msgr2=0x55739fbdbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42f40150c0 tx=0x7f42f4005bb0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 -- 172.21.15.22:0/3242293069 shutdown_connections 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbe3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbe3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 --2- 172.21.15.22:0/3242293069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbdbfd0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 -- 172.21.15.22:0/3242293069 >> 172.21.15.22:0/3242293069 conn(0x55739fba9310 msgr2=0x55739fbe6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 -- 172.21.15.22:0/3242293069 shutdown_connections 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.657+0000 7f4309a5e740 1 -- 172.21.15.22:0/3242293069 wait complete. 2024-09-11T22:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 -- start start 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 Processor -- start 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbefa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbeffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ac640 con 0x55739fbe05d0 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43001adab0 con 0x55739fbe1b40 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43001acd10 con 0x55739fbeb370 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4309a5e740 10 client.0 _ll_register_callbacks cb 0x7f42f4015420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4304c20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33648/0 (socket says 172.21.15.22:33648) 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.658+0000 7f4304c20640 1 -- 172.21.15.22:0/1162341535 learned_addr learned my addr 172.21.15.22:0/1162341535 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4305421640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbefa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbeffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 -- 172.21.15.22:0/1162341535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 msgr2=0x55739fbeffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbeffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 -- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 msgr2=0x55739fbefa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbefa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 -- 172.21.15.22:0/1162341535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739fc64a80 con 0x55739fbe05d0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4304c20640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005850 tx=0x7f42f40134c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aac960186a7848a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f42e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4033020 con 0x55739fbe05d0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f42f40048d0 con 0x55739fbe05d0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f40092a0 con 0x55739fbe05d0 2024-09-11T22:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f42f4027070 con 0x55739fbe05d0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4309a5e740 10 client.16212 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55739fc65d80 con 0x55739fbe05d0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.659+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42f40092a0 con 0x55739fbe05d0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f42f400c070 con 0x55739fbe05d0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 10 client.16212 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 20 client.16212 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fc66430 0x55739fc68820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 4 client.16212 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55739fb4dd70 con 0x55739fc66430 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4305421640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fc66430 0x55739fc68820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f4305421640 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fc66430 0x55739fc68820 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9901b91c1c3b803b server_cookie=34df562211a3055c in_seq=0 out_seq=0 2024-09-11T22:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.660+0000 7f42e8ff9640 10 client.16212 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f42e8ff9640 1 -- 172.21.15.22:0/1162341535 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55739fb4dd70 con 0x55739fc66430 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f42e8ff9640 10 client.16212 handle_command_reply: tid=0 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 client.16212 shutdown 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 msgr2=0x55739fbef4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f42f4005850 tx=0x7f42f40134c0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 shutdown_connections 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55739fc66430 0x55739fc68820 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55739fbeb370 0x55739fbeffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55739fbe1b40 0x55739fbefa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 --2- 172.21.15.22:0/1162341535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55739fbe05d0 0x55739fbef4e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 >> 172.21.15.22:0/1162341535 conn(0x55739fba9310 msgr2=0x55739fbe97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f42e8ff9640 0 client.16212 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 shutdown_connections 2024-09-11T22:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 1 -- 172.21.15.22:0/1162341535 wait complete. 2024-09-11T22:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.661+0000 7f4309a5e740 20 client.16212 trim_cache size 0 max 16384 2024-09-11T22:33:13.672 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:33:13.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 msgr2=0x7f42ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 0x7f42ec0a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42f809b8f0 tx=0x7f42f8090df0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 msgr2=0x7f430019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f42f800cad0 tx=0x7f42f800cf90 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 shutdown_connections 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f42ec0a2cf0 0x7f42ec0a51b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4300106f10 0x7f430019ce60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 --2- 172.21.15.22:0/1910764558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4300101de0 0x7f4300198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 >> 172.21.15.22:0/1910764558 conn(0x7f43000fd8c0 msgr2=0x7f43000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 shutdown_connections 2024-09-11T22:33:13.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:13.662+0000 7f4307685640 1 -- 172.21.15.22:0/1910764558 wait complete. 2024-09-11T22:33:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:14 smithi022 ceph-mon[30966]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:14.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:14 smithi169 ceph-mon[35628]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:14.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:14 smithi045 ceph-mon[35556]: pgmap v129: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:33:15.461 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:33:15.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:33:15.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:16.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:16 smithi022 ceph-mon[30966]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 -- 172.21.15.22:0/3926558121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 msgr2=0x7f7838101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 --2- 172.21.15.22:0/3926558121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838101200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7834009900 tx=0x7f783402a480 comp rx=0 tx=0).stop 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 -- 172.21.15.22:0/3926558121 shutdown_connections 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 --2- 172.21.15.22:0/3926558121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102ef0 0x7f783810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 --2- 172.21.15.22:0/3926558121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7838102570 0x7f78381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 --2- 172.21.15.22:0/3926558121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838101200 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 -- 172.21.15.22:0/3926558121 >> 172.21.15.22:0/3926558121 conn(0x7f78380fc7d0 msgr2=0x7f78380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 -- 172.21.15.22:0/3926558121 shutdown_connections 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.233+0000 7f783f684640 1 -- 172.21.15.22:0/3926558121 wait complete. 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 Processor -- start 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 -- start start 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 0x7f7838199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7838102ef0 0x7f78381a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7838111070 con 0x7f7838100e20 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7838110ef0 con 0x7f7838102570 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783f684640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78381111f0 con 0x7f7838102ef0 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37938/0 (socket says 172.21.15.22:37938) 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 -- 172.21.15.22:0/4013460746 learned_addr learned my addr 172.21.15.22:0/4013460746 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783cc1f640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 0x7f7838199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 -- 172.21.15.22:0/4013460746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7838102ef0 msgr2=0x7f78381a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7838102ef0 0x7f78381a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 -- 172.21.15.22:0/4013460746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 msgr2=0x7f7838199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 0x7f7838199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783d420640 1 -- 172.21.15.22:0/4013460746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78381a48e0 con 0x7f7838100e20 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.234+0000 7f783cc1f640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 0x7f7838199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f783d420640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7834006010 tx=0x7f7834004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f782e7fc640 1 -- 172.21.15.22:0/4013460746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783403f030 con 0x7f7838100e20 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78381a4ab0 con 0x7f7838100e20 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f782e7fc640 1 -- 172.21.15.22:0/4013460746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7834005500 con 0x7f7838100e20 2024-09-11T22:33:16.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f782e7fc640 1 -- 172.21.15.22:0/4013460746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834035070 con 0x7f7838100e20 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.235+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78381a4f90 con 0x7f7838100e20 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.237+0000 7f782e7fc640 1 -- 172.21.15.22:0/4013460746 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7834042030 con 0x7f7838100e20 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 Processor -- start 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 -- start start 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5167130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563fc50bf280 con 0x563fc515a480 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563fc5066b10 con 0x563fc5164d40 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f7841a5d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563fc50bb240 con 0x563fc5159b60 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f782e7fc640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 0x7f78240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37944/0 (socket says 172.21.15.22:37944) 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783d420640 1 -- 172.21.15.22:0/871858153 learned_addr learned my addr 172.21.15.22:0/871858153 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783dc21640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 0x7f78240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783cc1f640 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f783dc21640 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.238+0000 7f782e7fc640 1 -- 172.21.15.22:0/4013460746 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78340efb50 con 0x7f7838100e20 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 -- 172.21.15.22:0/871858153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 msgr2=0x563fc5159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 -- 172.21.15.22:0/871858153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 msgr2=0x563fc5167130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5167130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 -- 172.21.15.22:0/871858153 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc50731f0 con 0x563fc515a480 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783dc21640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 0x7f78240a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7830013990 tx=0x7f78300097f0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f783d420640 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7834005ec0 tx=0x7f7834031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a66fc2814ce1ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f78237fe640 1 -- 172.21.15.22:0/871858153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834049030 con 0x563fc515a480 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f78237fe640 1 -- 172.21.15.22:0/871858153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78340bc060 con 0x563fc515a480 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.239+0000 7f78237fe640 1 -- 172.21.15.22:0/871858153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340b86d0 con 0x563fc515a480 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- 172.21.15.22:0/871858153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 msgr2=0x563fc5164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7834005ec0 tx=0x7f7834031400 comp rx=0 tx=0).stop 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- 172.21.15.22:0/871858153 shutdown_connections 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc5164800 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 --2- 172.21.15.22:0/871858153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- 172.21.15.22:0/871858153 >> 172.21.15.22:0/871858153 conn(0x563fc51560f0 msgr2=0x563fc51564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- 172.21.15.22:0/871858153 shutdown_connections 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- 172.21.15.22:0/871858153 wait complete. 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 -- start start 2024-09-11T22:33:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.240+0000 7f7841a5d740 1 Processor -- start 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc51625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563fc51676d0 con 0x563fc515a480 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563fc5079f10 con 0x563fc5164d40 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563fc5167850 con 0x563fc5159b60 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7841a5d740 10 client.0 _ll_register_callbacks cb 0x563fc5042a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37950/0 (socket says 172.21.15.22:37950) 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 -- 172.21.15.22:0/2302745956 learned_addr learned my addr 172.21.15.22:0/2302745956 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783d420640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783dc21640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc51625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 -- 172.21.15.22:0/2302745956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 msgr2=0x563fc5161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 -- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 msgr2=0x563fc51625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc51625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 -- 172.21.15.22:0/2302745956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc4e306a0 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f783cc1f640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7828011800 tx=0x7f7828011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d05491c37f12792 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.241+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782800f9a0 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f782800fb40 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fc50cc7f0 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f782800fd80 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 10 client.16224 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563fc51731f0 con 0x563fc515a480 2024-09-11T22:33:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x563fc50cc7f0 con 0x563fc515a480 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7828018030 con 0x563fc515a480 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 10 client.16224 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 20 client.16224 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc5174650 0x563fc5176a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 4 client.16224 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fc50c6d00 con 0x563fc5174650 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.242+0000 7f783d420640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc5174650 0x563fc5176a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.243+0000 7f7820ff9640 10 client.16224 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.243+0000 7f783d420640 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc5174650 0x563fc5176a90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44ef91d504e173e1 server_cookie=7a27e6f4bab9e75e in_seq=0 out_seq=0 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.243+0000 7f7820ff9640 1 -- 172.21.15.22:0/2302745956 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fc50c6d00 con 0x563fc5174650 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7820ff9640 10 client.16224 handle_command_reply: tid=0 2024-09-11T22:33:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 client.16224 shutdown 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 msgr2=0x563fc51620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7828011800 tx=0x7f7828011cc0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 shutdown_connections 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc5174650 0x563fc5176a90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc51625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc51620b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 --2- 172.21.15.22:0/2302745956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7820ff9640 0 client.16224 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 >> 172.21.15.22:0/2302745956 conn(0x563fc51560f0 msgr2=0x563fc515bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 shutdown_connections 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 1 -- 172.21.15.22:0/2302745956 wait complete. 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.244+0000 7f7841a5d740 20 client.16224 trim_cache size 0 max 16384 2024-09-11T22:33:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.261+0000 7f7841a5d740 1 Processor -- start 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.261+0000 7f7841a5d740 1 -- start start 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc517c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78381ab7b0 con 0x563fc515a480 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78381ae030 con 0x563fc5164d40 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f7841a5d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78381abe20 con 0x563fc5159b60 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37956/0 (socket says 172.21.15.22:37956) 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 -- 172.21.15.22:0/989209549 learned_addr learned my addr 172.21.15.22:0/989209549 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783dc21640 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc517c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 -- 172.21.15.22:0/989209549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 msgr2=0x563fc5160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 -- 172.21.15.22:0/989209549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 msgr2=0x563fc517c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc517c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 -- 172.21.15.22:0/989209549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc5155f20 con 0x563fc515a480 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783dc21640 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc517c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.262+0000 7f783cc1f640 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7828004da0 tx=0x7f7828008840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ed61d22db06d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7822ffd640 1 -- 172.21.15.22:0/989209549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828028040 con 0x563fc515a480 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7822ffd640 1 -- 172.21.15.22:0/989209549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f782800fba0 con 0x563fc515a480 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7822ffd640 1 -- 172.21.15.22:0/989209549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828004320 con 0x563fc515a480 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 -- 172.21.15.22:0/989209549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 msgr2=0x563fc515c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7828004da0 tx=0x7f7828008840 comp rx=0 tx=0).stop 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 -- 172.21.15.22:0/989209549 shutdown_connections 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc517c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc515a480 0x563fc515c5c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 --2- 172.21.15.22:0/989209549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc5159b60 0x563fc5160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 -- 172.21.15.22:0/989209549 >> 172.21.15.22:0/989209549 conn(0x563fc51560f0 msgr2=0x563fc5163ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 -- 172.21.15.22:0/989209549 shutdown_connections 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.263+0000 7f7841a5d740 1 -- 172.21.15.22:0/989209549 wait complete. 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 -- start start 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 Processor -- start 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 0x563fc516ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5169900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78381ac4f0 con 0x563fc5159b60 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78381ad960 con 0x563fc5164d40 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78381acbc0 con 0x563fc515a480 2024-09-11T22:33:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f7841a5d740 10 client.0 _ll_register_callbacks cb 0x7f7828011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f783d420640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37966/0 (socket says 172.21.15.22:37966) 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.264+0000 7f783d420640 1 -- 172.21.15.22:0/1409755752 learned_addr learned my addr 172.21.15.22:0/1409755752 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783dc21640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783cc1f640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 0x563fc516ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 -- 172.21.15.22:0/1409755752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 msgr2=0x563fc516ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 0x563fc516ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 -- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 msgr2=0x563fc5169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 -- 172.21.15.22:0/1409755752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc5169ef0 con 0x563fc5159b60 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783cc1f640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 0x563fc516ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f783d420640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f78340bbff0 tx=0x7f78340035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7d1ee6f8fe9567 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834049040 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7834004370 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f782800fba0 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f78340e1050 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7841a5d740 10 client.16230 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563fc51dfc60 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.265+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f782800fba0 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f78340b86d0 con 0x563fc5159b60 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 10 client.16230 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 20 client.16230 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc51e0240 0x563fc51e2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 4 client.16230 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:33:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563fc5043110 con 0x563fc51e0240 2024-09-11T22:33:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f783cc1f640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc51e0240 0x563fc51e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f7820ff9640 10 client.16230 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.266+0000 7f783cc1f640 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc51e0240 0x563fc51e2630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ea8b5aa71dea84 server_cookie=a23ac90179dc9288 in_seq=0 out_seq=0 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.267+0000 7f7820ff9640 1 -- 172.21.15.22:0/1409755752 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563fc5043110 con 0x563fc51e0240 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.267+0000 7f7820ff9640 10 client.16230 handle_command_reply: tid=0 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.267+0000 7f7841a5d740 1 client.16230 shutdown 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.267+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 msgr2=0x563fc516c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.267+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f78340bbff0 tx=0x7f78340035f0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 shutdown_connections 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563fc51e0240 0x563fc51e2630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fc5164d40 0x563fc5169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7820ff9640 0 client.16230 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563fc515a480 0x563fc516ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 --2- 172.21.15.22:0/1409755752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563fc5159b60 0x563fc516c930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 >> 172.21.15.22:0/1409755752 conn(0x563fc51560f0 msgr2=0x563fc5162f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 shutdown_connections 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 1 -- 172.21.15.22:0/1409755752 wait complete. 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f7841a5d740 20 client.16230 trim_cache size 0 max 16384 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "2e107000-8c61-450d-955c-1ef4a5119e66", 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:33:16.284 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 msgr2=0x7f78240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 0x7f78240a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7830013990 tx=0x7f78300097f0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 msgr2=0x7f7838199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.268+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7834006010 tx=0x7f7834004c00 comp rx=0 tx=0).stop 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 shutdown_connections 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78240a2cf0 0x7f78240a51b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7838102ef0 0x7f78381a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7838102570 0x7f7838199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 --2- 172.21.15.22:0/4013460746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7838100e20 0x7f7838199320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 >> 172.21.15.22:0/4013460746 conn(0x7f78380fc7d0 msgr2=0x7f7838105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 shutdown_connections 2024-09-11T22:33:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:16.269+0000 7f783f684640 1 -- 172.21.15.22:0/4013460746 wait complete. 2024-09-11T22:33:16.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:16 smithi169 ceph-mon[35628]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:33:16.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:16 smithi045 ceph-mon[35556]: pgmap v130: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:33:17.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:33:17.356 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:17.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- 172.21.15.22:0/239008589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc4102d40 msgr2=0x7f3bc4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/239008589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc4102d40 0x7f3bc4103120 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009900 tx=0x7f3bc002a480 comp rx=0 tx=0).stop 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- 172.21.15.22:0/239008589 shutdown_connections 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/239008589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc410c170 0x7f3bc410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/239008589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4103660 0x7f3bc410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/239008589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc4102d40 0x7f3bc4103120 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- 172.21.15.22:0/239008589 >> 172.21.15.22:0/239008589 conn(0x7f3bc40fc7a0 msgr2=0x7f3bc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- 172.21.15.22:0/239008589 shutdown_connections 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- 172.21.15.22:0/239008589 wait complete. 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 Processor -- start 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.863+0000 7f3bcbefd640 1 -- start start 2024-09-11T22:33:17.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 0x7f3bc4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc4103660 0x7f3bc4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41120f0 con 0x7f3bc410c170 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4111f70 con 0x7f3bc4102d40 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4112270 con 0x7f3bc4103660 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37990/0 (socket says 172.21.15.22:37990) 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 -- 172.21.15.22:0/784031994 learned_addr learned my addr 172.21.15.22:0/784031994 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bc9498640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc4103660 0x7f3bc4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 0x7f3bc4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 -- 172.21.15.22:0/784031994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc4103660 msgr2=0x7f3bc4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc4103660 0x7f3bc4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 -- 172.21.15.22:0/784031994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 msgr2=0x7f3bc4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 0x7f3bc4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 -- 172.21.15.22:0/784031994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc419d520 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 0x7f3bc4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bca49a640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00b970 tx=0x7f3bbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bbaffd640 1 -- 172.21.15.22:0/784031994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc019070 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bbaffd640 1 -- 172.21.15.22:0/784031994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bbc00cb40 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc419d810 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bbaffd640 1 -- 172.21.15.22:0/784031994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc007700 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.864+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc41a50f0 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.867+0000 7f3bbaffd640 1 -- 172.21.15.22:0/784031994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3bbc01c070 con 0x7f3bc410c170 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.867+0000 7f3bce2d6740 1 Processor -- start 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.867+0000 7f3bce2d6740 1 -- start start 2024-09-11T22:33:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c77140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee73bd22e0 con 0x55ee73c77680 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee73b79ce0 con 0x55ee73c6c4a0 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee73bce2a0 con 0x55ee73c6cdc0 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37996/0 (socket says 172.21.15.22:37996) 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 -- 172.21.15.22:0/139380749 learned_addr learned my addr 172.21.15.22:0/139380749 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bbaffd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 0x7f3bb00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c77140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bca49a640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 0x7f3bb00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 -- 172.21.15.22:0/139380749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 msgr2=0x55ee73c77140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c77140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 -- 172.21.15.22:0/139380749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 msgr2=0x55ee73c6c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c6c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bc9498640 1 -- 172.21.15.22:0/139380749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee73b5e440 con 0x55ee73c77680 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.868+0000 7f3bbaffd640 1 -- 172.21.15.22:0/784031994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3bbc0ce8c0 con 0x7f3bc410c170 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.869+0000 7f3bc9498640 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40117c0 tx=0x7f3bb400a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532c81a1d137ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.869+0000 7f3bca49a640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 0x7f3bb00a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0973f0 tx=0x7f3bbc00e040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.869+0000 7f3baffff640 1 -- 172.21.15.22:0/139380749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4005020 con 0x55ee73c77680 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.869+0000 7f3baffff640 1 -- 172.21.15.22:0/139380749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb40047a0 con 0x55ee73c77680 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.869+0000 7f3baffff640 1 -- 172.21.15.22:0/139380749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400fab0 con 0x55ee73c77680 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- 172.21.15.22:0/139380749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 msgr2=0x55ee73c79a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40117c0 tx=0x7f3bb400a740 comp rx=0 tx=0).stop 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- 172.21.15.22:0/139380749 shutdown_connections 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c79a70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c77140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/139380749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- 172.21.15.22:0/139380749 >> 172.21.15.22:0/139380749 conn(0x55ee73c68a30 msgr2=0x55ee73c68e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- 172.21.15.22:0/139380749 shutdown_connections 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- 172.21.15.22:0/139380749 wait complete. 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 -- start start 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 Processor -- start 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.870+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c74330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee73c7a250 con 0x55ee73c77680 2024-09-11T22:33:17.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ee73b8d050 con 0x55ee73c6c4a0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ee73c7a3d0 con 0x55ee73c6cdc0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 10 client.0 _ll_register_callbacks cb 0x55ee73bcd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38008/0 (socket says 172.21.15.22:38008) 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 -- 172.21.15.22:0/2717633255 learned_addr learned my addr 172.21.15.22:0/2717633255 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c74330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 -- 172.21.15.22:0/2717633255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 msgr2=0x55ee73c74330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c74330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 -- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 msgr2=0x55ee73c77080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c77080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 -- 172.21.15.22:0/2717633255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee739433c0 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bc9498640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a500 tx=0x7f3bb4013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595211c6d0d6f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4005210 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb40047a0 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.871+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3bb40053b0 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3bb4030030 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 10 client.16242 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ee73c85c90 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb40047a0 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb401e8e0 con 0x55ee73c77680 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 10 client.16242 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:17.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 20 client.16242 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73c86fe0 0x55ee73c893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 4 client.16242 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee73bdf850 con 0x55ee73c86fe0 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.872+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73c86fe0 0x55ee73c893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.873+0000 7f3bad7fa640 10 client.16242 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.873+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73c86fe0 0x55ee73c893d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199593766fb29fa6 server_cookie=67798b911bc6e4 in_seq=0 out_seq=0 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bad7fa640 1 -- 172.21.15.22:0/2717633255 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee73bdf850 con 0x55ee73c86fe0 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bad7fa640 10 client.16242 handle_command_reply: tid=0 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 client.16242 shutdown 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 msgr2=0x55ee73c74920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a500 tx=0x7f3bb4013040 comp rx=0 tx=0).stop 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 shutdown_connections 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73c86fe0 0x55ee73c893d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c77680 0x55ee73c74920 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c74330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/2717633255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6c4a0 0x55ee73c77080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bad7fa640 0 client.16242 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 >> 172.21.15.22:0/2717633255 conn(0x55ee73c68a30 msgr2=0x55ee73c6e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 shutdown_connections 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 1 -- 172.21.15.22:0/2717633255 wait complete. 2024-09-11T22:33:17.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.874+0000 7f3bce2d6740 20 client.16242 trim_cache size 0 max 16384 2024-09-11T22:33:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.891+0000 7f3bce2d6740 1 Processor -- start 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 -- start start 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c7fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c77680 0x55ee73c7ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41ab8d0 con 0x55ee73c6c4a0 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41ae150 con 0x55ee73c77680 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41abf40 con 0x55ee73c6cdc0 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38016/0 (socket says 172.21.15.22:38016) 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 -- 172.21.15.22:0/1971673590 learned_addr learned my addr 172.21.15.22:0/1971673590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c7fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c77680 0x55ee73c7ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 -- 172.21.15.22:0/1971673590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 msgr2=0x55ee73c7fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c7fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 -- 172.21.15.22:0/1971673590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c77680 msgr2=0x55ee73c7ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c77680 0x55ee73c7ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 -- 172.21.15.22:0/1971673590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee73c72880 con 0x55ee73c6c4a0 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.892+0000 7f3bc9498640 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a370 tx=0x7f3bb400a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dc0f40eb6b5900 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3baf7fe640 1 -- 172.21.15.22:0/1971673590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4004e10 con 0x55ee73c6c4a0 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3baf7fe640 1 -- 172.21.15.22:0/1971673590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb4039070 con 0x55ee73c6c4a0 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3baf7fe640 1 -- 172.21.15.22:0/1971673590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4005390 con 0x55ee73c6c4a0 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 -- 172.21.15.22:0/1971673590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 msgr2=0x55ee73c834b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a370 tx=0x7f3bb400a2e0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 -- 172.21.15.22:0/1971673590 shutdown_connections 2024-09-11T22:33:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c77680 0x55ee73c7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c6cdc0 0x55ee73c7fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/1971673590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c834b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 -- 172.21.15.22:0/1971673590 >> 172.21.15.22:0/1971673590 conn(0x55ee73c68a30 msgr2=0x55ee73c73420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 -- 172.21.15.22:0/1971673590 shutdown_connections 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.893+0000 7f3bce2d6740 1 -- 172.21.15.22:0/1971673590 wait complete. 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 -- start start 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 Processor -- start 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 0x55ee73c8ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c77680 0x55ee73cecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41ac610 con 0x55ee73c6c4a0 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41ada80 con 0x55ee73c6cdc0 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41acce0 con 0x55ee73c77680 2024-09-11T22:33:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bce2d6740 10 client.0 _ll_register_callbacks cb 0x7f3bb400ae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bc9498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38030/0 (socket says 172.21.15.22:38030) 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bc9498640 1 -- 172.21.15.22:0/4227475928 learned_addr learned my addr 172.21.15.22:0/4227475928 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.894+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 0x55ee73c8ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 -- 172.21.15.22:0/4227475928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c77680 msgr2=0x55ee73cecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c77680 0x55ee73cecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 -- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 msgr2=0x55ee73c8ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 0x55ee73c8ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 -- 172.21.15.22:0/4227475928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee73ced440 con 0x55ee73c6c4a0 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 0x55ee73c8ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bc9498640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3bb401ece0 tx=0x7f3bb4005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a76c9ae4fb7c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4004e10 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f3bb4005210 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb4039070 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3bb4005410 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bce2d6740 10 client.16248 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ee73cf5990 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.895+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb4039070 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb400fa90 con 0x55ee73c6c4a0 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 10 client.16248 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 20 client.16248 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73cf5dc0 0x55ee73cf81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 4 client.16248 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee73bd9d60 con 0x55ee73cf5dc0 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73cf5dc0 0x55ee73cf81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bc9c99640 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73cf5dc0 0x55ee73cf81b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc43d8d743961529 server_cookie=c0c2474a22a6cf9a in_seq=0 out_seq=0 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bad7fa640 10 client.16248 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.896+0000 7f3bad7fa640 1 -- 172.21.15.22:0/4227475928 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ee73bd9d60 con 0x55ee73cf5dc0 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bad7fa640 10 client.16248 handle_command_reply: tid=0 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 client.16248 shutdown 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 msgr2=0x55ee73c8e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3bb401ece0 tx=0x7f3bb4005e40 comp rx=0 tx=0).stop 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 shutdown_connections 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ee73cf5dc0 0x55ee73cf81b0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ee73c77680 0x55ee73cecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bad7fa640 0 client.16248 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee73c6cdc0 0x55ee73c8ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 --2- 172.21.15.22:0/4227475928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee73c6c4a0 0x55ee73c8e6a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 >> 172.21.15.22:0/4227475928 conn(0x55ee73c68a30 msgr2=0x55ee73c67350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 shutdown_connections 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 1 -- 172.21.15.22:0/4227475928 wait complete. 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bce2d6740 20 client.16248 trim_cache size 0 max 16384 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:33:17.909 INFO:teuthology.orchestra.run.smithi022.stdout: "2e107000-8c61-450d-955c-1ef4a5119e66": { 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "2e107000-8c61-450d-955c-1ef4a5119e66", 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:17.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 msgr2=0x7f3bb00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 0x7f3bb00a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0973f0 tx=0x7f3bbc00e040 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 msgr2=0x7f3bc419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.897+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00b970 tx=0x7f3bbc00be30 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 shutdown_connections 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3bb00a2cf0 0x7f3bb00a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc410c170 0x7f3bc419ce40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc4103660 0x7f3bc4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 --2- 172.21.15.22:0/784031994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc4102d40 0x7f3bc4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 >> 172.21.15.22:0/784031994 conn(0x7f3bc40fc7a0 msgr2=0x7f3bc40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 shutdown_connections 2024-09-11T22:33:17.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:17.898+0000 7f3bcbefd640 1 -- 172.21.15.22:0/784031994 wait complete. 2024-09-11T22:33:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:18 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:33:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:18 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:18 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:33:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:18 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:18 smithi022 ceph-mon[30966]: pgmap v131: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:33:18.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:18 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:33:18.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:18 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:18 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:33:18.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:18 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:18 smithi169 ceph-mon[35628]: pgmap v131: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:33:18.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:18 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:33:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:18 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:18 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:33:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:18 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:18.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:18 smithi045 ceph-mon[35556]: pgmap v131: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:33:18.629 INFO:tasks.cephfs.filesystem:scrub status for tag:2e107000-8c61-450d-955c-1ef4a5119e66 - {'path': '/', 'tag': '2e107000-8c61-450d-955c-1ef4a5119e66', 'options': 'recursive,force'} 2024-09-11T22:33:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:20 smithi022 ceph-mon[30966]: pgmap v132: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-11T22:33:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:20 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:33:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:20 smithi169 ceph-mon[35628]: pgmap v132: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-11T22:33:20.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:20 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:33:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:20 smithi045 ceph-mon[35556]: pgmap v132: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-11T22:33:20.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:20 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:33:22.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:22 smithi022 ceph-mon[30966]: pgmap v133: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:22.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:22 smithi169 ceph-mon[35628]: pgmap v133: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:22.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:22 smithi045 ceph-mon[35556]: pgmap v133: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:24.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:24 smithi022 ceph-mon[30966]: pgmap v134: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:24.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:24 smithi169 ceph-mon[35628]: pgmap v134: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:24.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:24 smithi045 ceph-mon[35556]: pgmap v134: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-11T22:33:26.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:26 smithi022 ceph-mon[30966]: pgmap v135: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:33:26.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:26 smithi169 ceph-mon[35628]: pgmap v135: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:33:26.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:26 smithi045 ceph-mon[35556]: pgmap v135: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:33:28.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:28 smithi022 ceph-mon[30966]: pgmap v136: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:33:28.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:28 smithi169 ceph-mon[35628]: pgmap v136: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:33:28.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:28 smithi045 ceph-mon[35556]: pgmap v136: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:33:30.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:30 smithi022 ceph-mon[30966]: pgmap v137: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:33:30.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:30 smithi169 ceph-mon[35628]: pgmap v137: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:33:30.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:30 smithi045 ceph-mon[35556]: pgmap v137: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:33:32.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:32 smithi022 ceph-mon[30966]: pgmap v138: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:33:32.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:32 smithi169 ceph-mon[35628]: pgmap v138: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:33:32.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:32 smithi045 ceph-mon[35556]: pgmap v138: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:33:34.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:34 smithi022 ceph-mon[30966]: pgmap v139: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:34.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:34 smithi169 ceph-mon[35628]: pgmap v139: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:34.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:34 smithi045 ceph-mon[35556]: pgmap v139: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:36.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:36 smithi022 ceph-mon[30966]: pgmap v140: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:36.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:36 smithi169 ceph-mon[35628]: pgmap v140: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:36.412 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:36 smithi045 ceph-mon[35556]: pgmap v140: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:38.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:38 smithi022 ceph-mon[30966]: pgmap v141: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:38.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:38 smithi169 ceph-mon[35628]: pgmap v141: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:38.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:38 smithi045 ceph-mon[35556]: pgmap v141: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:40.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:40 smithi022 ceph-mon[30966]: pgmap v142: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:40.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:40 smithi169 ceph-mon[35628]: pgmap v142: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:40.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:40 smithi045 ceph-mon[35556]: pgmap v142: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:42.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:42 smithi022 ceph-mon[30966]: pgmap v143: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:42.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:42 smithi169 ceph-mon[35628]: pgmap v143: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:42.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:42 smithi045 ceph-mon[35556]: pgmap v143: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:44.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:44 smithi022 ceph-mon[30966]: pgmap v144: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:44.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:44 smithi169 ceph-mon[35628]: pgmap v144: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:44.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:44 smithi045 ceph-mon[35556]: pgmap v144: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:46.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:46 smithi022 ceph-mon[30966]: pgmap v145: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:46.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:46 smithi169 ceph-mon[35628]: pgmap v145: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:46.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:46 smithi045 ceph-mon[35556]: pgmap v145: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:48.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:48 smithi022 ceph-mon[30966]: pgmap v146: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:48.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:48 smithi169 ceph-mon[35628]: pgmap v146: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:48.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:48 smithi045 ceph-mon[35556]: pgmap v146: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:48.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:33:48.909 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 -- 172.21.15.22:0/424299539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102570 msgr2=0x7effa01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 --2- 172.21.15.22:0/424299539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102570 0x7effa01029b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff8802a480 comp rx=0 tx=0).stop 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 -- 172.21.15.22:0/424299539 shutdown_connections 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 --2- 172.21.15.22:0/424299539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0102ef0 0x7effa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 --2- 172.21.15.22:0/424299539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102570 0x7effa01029b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 --2- 172.21.15.22:0/424299539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0100e20 0x7effa0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 -- 172.21.15.22:0/424299539 >> 172.21.15.22:0/424299539 conn(0x7effa00fc7d0 msgr2=0x7effa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 -- 172.21.15.22:0/424299539 shutdown_connections 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.407+0000 7effa674b640 1 -- 172.21.15.22:0/424299539 wait complete. 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 Processor -- start 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 -- start start 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0100e20 0x7effa0198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0102570 0x7effa0198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7effa0111160 con 0x7effa0102ef0 2024-09-11T22:33:49.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effa0110fe0 con 0x7effa0100e20 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa674b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7effa01112e0 con 0x7effa0102570 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa4ce8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa4ce8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48962/0 (socket says 172.21.15.22:48962) 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7effa4ce8640 1 -- 172.21.15.22:0/729429615 learned_addr learned my addr 172.21.15.22:0/729429615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7eff9ffff640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0100e20 0x7effa0198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.408+0000 7eff97fff640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0102570 0x7effa0198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 -- 172.21.15.22:0/729429615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0102570 msgr2=0x7effa0198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0102570 0x7effa0198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 -- 172.21.15.22:0/729429615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0100e20 msgr2=0x7effa0198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0100e20 0x7effa0198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 -- 172.21.15.22:0/729429615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa019d6b0 con 0x7effa0102ef0 2024-09-11T22:33:49.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa4ce8640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7eff9800b970 tx=0x7eff9800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7eff9dffb640 1 -- 172.21.15.22:0/729429615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98019070 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7eff9dffb640 1 -- 172.21.15.22:0/729429615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff98014440 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa019d9a0 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7eff9dffb640 1 -- 172.21.15.22:0/729429615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff980075d0 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.409+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa01a5280 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.412+0000 7eff9dffb640 1 -- 172.21.15.22:0/729429615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7eff9801c070 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.412+0000 7eff9dffb640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 0x7eff8c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff9ffff640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 0x7eff8c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff9dffb640 1 -- 172.21.15.22:0/729429615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7eff980ce7f0 con 0x7effa0102ef0 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 Processor -- start 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 -- start start 2024-09-11T22:33:49.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff9ffff640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 0x7eff8c0a5230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff90009990 tx=0x7eff90009110 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5380 0x557c532e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557c5324b2e0 con 0x557c532e5ca0 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557c531f2ce0 con 0x557c532e5380 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7effa8b24740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557c532472a0 con 0x557c532f4a90 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48966/0 (socket says 172.21.15.22:48966) 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.413+0000 7eff97fff640 1 -- 172.21.15.22:0/3126849949 learned_addr learned my addr 172.21.15.22:0/3126849949 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff9ffff640 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5380 0x557c532e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7effa4ce8640 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 -- 172.21.15.22:0/3126849949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 msgr2=0x557c532f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 -- 172.21.15.22:0/3126849949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5380 msgr2=0x557c532e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5380 0x557c532e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 -- 172.21.15.22:0/3126849949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c531d7440 con 0x557c532e5ca0 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff97fff640 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff88031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be74f4b0e7081eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff967fc640 1 -- 172.21.15.22:0/3126849949 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88035030 con 0x557c532e5ca0 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff967fc640 1 -- 172.21.15.22:0/3126849949 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff88040070 con 0x557c532e5ca0 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.414+0000 7eff967fc640 1 -- 172.21.15.22:0/3126849949 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88005260 con 0x557c532e5ca0 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 -- 172.21.15.22:0/3126849949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 msgr2=0x557c532f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff88031710 comp rx=0 tx=0).stop 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 -- 172.21.15.22:0/3126849949 shutdown_connections 2024-09-11T22:33:49.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c532f4550 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 --2- 172.21.15.22:0/3126849949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5380 0x557c532e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 -- 172.21.15.22:0/3126849949 >> 172.21.15.22:0/3126849949 conn(0x557c532e1a30 msgr2=0x557c532e1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 -- 172.21.15.22:0/3126849949 shutdown_connections 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.415+0000 7effa8b24740 1 -- 172.21.15.22:0/3126849949 wait complete. 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 -- start start 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 Processor -- start 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5ca0 0x557c532f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557c532f7660 con 0x557c532e5380 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557c53206050 con 0x557c532e5ca0 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557c532f77e0 con 0x557c532f4a90 2024-09-11T22:33:49.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7effa8b24740 10 client.0 _ll_register_callbacks cb 0x557c53246160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48968/0 (socket says 172.21.15.22:48968) 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.416+0000 7eff9ffff640 1 -- 172.21.15.22:0/1938860444 learned_addr learned my addr 172.21.15.22:0/1938860444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff97fff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5ca0 0x557c532f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7effa4ce8640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 -- 172.21.15.22:0/1938860444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 msgr2=0x557c532f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 -- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5ca0 msgr2=0x557c532f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5ca0 0x557c532f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 -- 172.21.15.22:0/1938860444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c52fbc3c0 con 0x557c532e5380 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff90015710 tx=0x7eff900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cb70b8317d57de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90025020 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7eff90013690 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff88040070 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7eff90030050 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7effa8b24740 10 client.16260 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.417+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557c53303110 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff88040070 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7eff90021c40 con 0x557c532e5380 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 10 client.16260 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 20 client.16260 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c533045d0 0x557c53306a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 4 client.16260 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:49.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c53258850 con 0x557c533045d0 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.418+0000 7eff97fff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c533045d0 0x557c53306a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.419+0000 7eff7f7fe640 10 client.16260 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.419+0000 7eff97fff640 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c533045d0 0x557c53306a20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b317ef6b06ded4 server_cookie=97b6d57c6a1ad2a7 in_seq=0 out_seq=0 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.419+0000 7eff7f7fe640 1 -- 172.21.15.22:0/1938860444 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c53258850 con 0x557c533045d0 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.419+0000 7eff7f7fe640 10 client.16260 handle_command_reply: tid=0 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 client.16260 shutdown 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 msgr2=0x557c532f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff90015710 tx=0x7eff900047d0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 shutdown_connections 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c533045d0 0x557c53306a20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532f4a90 0x557c532f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532e5ca0 0x557c532f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 --2- 172.21.15.22:0/1938860444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f4440 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 >> 172.21.15.22:0/1938860444 conn(0x557c532e1a30 msgr2=0x557c532e7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7eff7f7fe640 0 client.16260 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 shutdown_connections 2024-09-11T22:33:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 1 -- 172.21.15.22:0/1938860444 wait complete. 2024-09-11T22:33:49.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.420+0000 7effa8b24740 20 client.16260 trim_cache size 0 max 16384 2024-09-11T22:33:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.437+0000 7effa8b24740 1 Processor -- start 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.437+0000 7effa8b24740 1 -- start start 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5380 0x557c53300900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5330c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7effa01a96e0 con 0x557c532e5ca0 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effa01abf40 con 0x557c532f4a90 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa8b24740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7effa01a9d30 con 0x557c532e5380 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48972/0 (socket says 172.21.15.22:48972) 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 -- 172.21.15.22:0/4179418181 learned_addr learned my addr 172.21.15.22:0/4179418181 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7effa4ce8640 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5330c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff9ffff640 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5380 0x557c53300900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 -- 172.21.15.22:0/4179418181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5380 msgr2=0x557c53300900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5380 0x557c53300900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 -- 172.21.15.22:0/4179418181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 msgr2=0x557c5330c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5330c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 -- 172.21.15.22:0/4179418181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c532e5ad0 con 0x557c532e5ca0 2024-09-11T22:33:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.438+0000 7eff97fff640 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff88047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47888048071b3cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7eff95ffb640 1 -- 172.21.15.22:0/4179418181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88055070 con 0x557c532e5ca0 2024-09-11T22:33:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7eff95ffb640 1 -- 172.21.15.22:0/4179418181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff88040040 con 0x557c532e5ca0 2024-09-11T22:33:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7eff95ffb640 1 -- 172.21.15.22:0/4179418181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88035040 con 0x557c532e5ca0 2024-09-11T22:33:49.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 -- 172.21.15.22:0/4179418181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 msgr2=0x557c5330c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7eff88009900 tx=0x7eff88047040 comp rx=0 tx=0).stop 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 -- 172.21.15.22:0/4179418181 shutdown_connections 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5330c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5ca0 0x557c5330c340 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 --2- 172.21.15.22:0/4179418181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5380 0x557c53300900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.439+0000 7effa8b24740 1 -- 172.21.15.22:0/4179418181 >> 172.21.15.22:0/4179418181 conn(0x557c532e1a30 msgr2=0x557c532ecd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 -- 172.21.15.22:0/4179418181 shutdown_connections 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 -- 172.21.15.22:0/4179418181 wait complete. 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 -- start start 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 Processor -- start 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.440+0000 7effa8b24740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 0x557c532f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa8b24740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5336e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa8b24740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7effa01aa400 con 0x557c532e5380 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa8b24740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effa01ab870 con 0x557c532f4a90 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa8b24740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7effa01aaad0 con 0x557c532e5ca0 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa8b24740 10 client.0 _ll_register_callbacks cb 0x7eff90009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48984/0 (socket says 172.21.15.22:48984) 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 -- 172.21.15.22:0/2770371744 learned_addr learned my addr 172.21.15.22:0/2770371744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff97fff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 0x557c532f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7effa4ce8640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5336e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 -- 172.21.15.22:0/2770371744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 msgr2=0x557c532f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 0x557c532f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 -- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 msgr2=0x557c5336e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5336e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 -- 172.21.15.22:0/2770371744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c532f2000 con 0x557c532e5380 2024-09-11T22:33:49.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff97fff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 0x557c532f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff9ffff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7eff90000c00 tx=0x7eff900138c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324153ae74b532ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.441+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90038020 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7eff90014600 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff88040040 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7eff90025050 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 10 client.16266 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x557c5336f7a0 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff88040040 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7eff90021850 con 0x557c532e5380 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 10 client.16266 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:49.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 20 client.16266 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c5336ff10 0x557c53372350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 4 client.16266 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c53252d60 con 0x557c5336ff10 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.442+0000 7eff97fff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c5336ff10 0x557c53372350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7eff97fff640 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c5336ff10 0x557c53372350 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d97cabe7ad2574 server_cookie=28fcde4d3edb5d4 in_seq=0 out_seq=0 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7eff7f7fe640 10 client.16266 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7eff7f7fe640 1 -- 172.21.15.22:0/2770371744 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557c53252d60 con 0x557c5336ff10 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7eff7f7fe640 10 client.16266 handle_command_reply: tid=0 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 client.16266 shutdown 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 msgr2=0x557c532f8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7eff90000c00 tx=0x7eff900138c0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 shutdown_connections 2024-09-11T22:33:49.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x557c5336ff10 0x557c53372350 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c532f4a90 0x557c5336e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557c532e5ca0 0x557c532f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 --2- 172.21.15.22:0/2770371744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c532e5380 0x557c532f8b40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 >> 172.21.15.22:0/2770371744 conn(0x557c532e1a30 msgr2=0x557c532e0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.443+0000 7eff7f7fe640 0 client.16266 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 shutdown_connections 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa8b24740 1 -- 172.21.15.22:0/2770371744 wait complete. 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa8b24740 20 client.16266 trim_cache size 0 max 16384 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:49.449 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 msgr2=0x7eff8c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 0x7eff8c0a5230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff90009990 tx=0x7eff90009110 comp rx=0 tx=0).stop 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 msgr2=0x7effa019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7eff9800b970 tx=0x7eff9800bd70 comp rx=0 tx=0).stop 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 shutdown_connections 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7eff8c0a2d70 0x7eff8c0a5230 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa0102ef0 0x7effa019cfd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7effa0102570 0x7effa0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 --2- 172.21.15.22:0/729429615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa0100e20 0x7effa0198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 >> 172.21.15.22:0/729429615 conn(0x7effa00fc7d0 msgr2=0x7effa0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 shutdown_connections 2024-09-11T22:33:49.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:49.444+0000 7effa674b640 1 -- 172.21.15.22:0/729429615 wait complete. 2024-09-11T22:33:50.262 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:33:50.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:33:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:50 smithi022 ceph-mon[30966]: pgmap v147: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:50.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:50 smithi169 ceph-mon[35628]: pgmap v147: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:50.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:50 smithi045 ceph-mon[35556]: pgmap v147: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:50.525 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:50.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 -- 172.21.15.22:0/282559427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878100a80 msgr2=0x7f8878100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:50.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 --2- 172.21.15.22:0/282559427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878100a80 0x7f8878100ee0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f886c009930 tx=0x7f886c02a420 comp rx=0 tx=0).stop 2024-09-11T22:33:50.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 -- 172.21.15.22:0/282559427 shutdown_connections 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 --2- 172.21.15.22:0/282559427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878101420 0x7f887810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 --2- 172.21.15.22:0/282559427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878100a80 0x7f8878100ee0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 --2- 172.21.15.22:0/282559427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f8878106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 -- 172.21.15.22:0/282559427 >> 172.21.15.22:0/282559427 conn(0x7f88780fc7a0 msgr2=0x7f88780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 -- 172.21.15.22:0/282559427 shutdown_connections 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.993+0000 7f887cc61640 1 -- 172.21.15.22:0/282559427 wait complete. 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.994+0000 7f887cc61640 1 Processor -- start 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.994+0000 7f887cc61640 1 -- start start 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.994+0000 7f887cc61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878100a80 0x7f8878199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.994+0000 7f887cc61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887cc61640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f88781a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887cc61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8878110fa0 con 0x7f8878101420 2024-09-11T22:33:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887cc61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8878110e20 con 0x7f8878100a80 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887cc61640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8878111120 con 0x7f8878106a80 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49000/0 (socket says 172.21.15.22:49000) 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 -- 172.21.15.22:0/2313121375 learned_addr learned my addr 172.21.15.22:0/2313121375 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887659c640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878100a80 0x7f8878199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8876d9d640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f88781a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 -- 172.21.15.22:0/2313121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 msgr2=0x7f88781a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f88781a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 -- 172.21.15.22:0/2313121375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878100a80 msgr2=0x7f8878199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878100a80 0x7f8878199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 -- 172.21.15.22:0/2313121375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88781a4910 con 0x7f8878101420 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8876d9d640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f88781a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:50.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f8875d9b640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f886c009a50 tx=0x7f886c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c03f030 con 0x7f8878101420 2024-09-11T22:33:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f886c003af0 con 0x7f8878101420 2024-09-11T22:33:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88781a4ae0 con 0x7f8878101420 2024-09-11T22:33:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.995+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c035070 con 0x7f8878101420 2024-09-11T22:33:50.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.996+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88781a4f90 con 0x7f8878101420 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.997+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878100ee0 con 0x7f8878101420 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.998+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f886c042030 con 0x7f8878101420 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.998+0000 7f88677fe640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 0x7f88600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.998+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f886c0efc50 con 0x7f8878101420 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.998+0000 7f887659c640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 0x7f88600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:51.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:50.999+0000 7f887659c640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 0x7f88600a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f88680058c0 tx=0x7f886800a250 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:51.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.003+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f886c0f5020 con 0x7f8878101420 2024-09-11T22:33:51.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.213+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88781a51c0 con 0x7f8878101420 2024-09-11T22:33:51.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.214+0000 7f88677fe640 1 -- 172.21.15.22:0/2313121375 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f886c0bc8c0 con 0x7f8878101420 2024-09-11T22:33:51.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:33:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:33:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 msgr2=0x7f88600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 0x7f88600a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f88680058c0 tx=0x7f886800a250 comp rx=0 tx=0).stop 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 msgr2=0x7f8878199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f886c009a50 tx=0x7f886c004270 comp rx=0 tx=0).stop 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 shutdown_connections 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f88600a2d70 0x7f88600a5230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8878106a80 0x7f88781a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8878101420 0x7f8878199890 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 --2- 172.21.15.22:0/2313121375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8878100a80 0x7f8878199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 >> 172.21.15.22:0/2313121375 conn(0x7f88780fc7a0 msgr2=0x7f88780fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 shutdown_connections 2024-09-11T22:33:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:51.216+0000 7f887cc61640 1 -- 172.21.15.22:0/2313121375 wait complete. 2024-09-11T22:33:52.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:33:52.337 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:52 smithi022 ceph-mon[30966]: pgmap v148: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:52 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2313121375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:52.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:52 smithi169 ceph-mon[35628]: pgmap v148: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:52.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:52 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2313121375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:52 smithi045 ceph-mon[35556]: pgmap v148: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:52.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:52 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2313121375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- 172.21.15.22:0/2469015607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c102790 msgr2=0x7faa3c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 --2- 172.21.15.22:0/2469015607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c102790 0x7faa3c1067e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7faa30009900 tx=0x7faa3002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- 172.21.15.22:0/2469015607 shutdown_connections 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 --2- 172.21.15.22:0/2469015607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 0x7faa3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 --2- 172.21.15.22:0/2469015607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c102790 0x7faa3c1067e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 --2- 172.21.15.22:0/2469015607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c101de0 0x7faa3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- 172.21.15.22:0/2469015607 >> 172.21.15.22:0/2469015607 conn(0x7faa3c0fd8c0 msgr2=0x7faa3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- 172.21.15.22:0/2469015607 shutdown_connections 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- 172.21.15.22:0/2469015607 wait complete. 2024-09-11T22:33:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 Processor -- start 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.776+0000 7faa43e99640 1 -- start start 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c102790 0x7faa3c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 0x7faa3c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112090 con 0x7faa3c101de0 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c111f10 con 0x7faa3c106f10 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa43e99640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112210 con 0x7faa3c102790 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49020/0 (socket says 172.21.15.22:49020) 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 -- 172.21.15.22:0/1451156312 learned_addr learned my addr 172.21.15.22:0/1451156312 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41434640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c102790 0x7faa3c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa42436640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 0x7faa3c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 -- 172.21.15.22:0/1451156312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c102790 msgr2=0x7faa3c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c102790 0x7faa3c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 -- 172.21.15.22:0/1451156312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 msgr2=0x7faa3c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 0x7faa3c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 -- 172.21.15.22:0/1451156312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c19d440 con 0x7faa3c101de0 2024-09-11T22:33:52.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.777+0000 7faa41c35640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d770 tx=0x7faa3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.778+0000 7faa2effd640 1 -- 172.21.15.22:0/1451156312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38017070 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.778+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c19d730 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.778+0000 7faa2effd640 1 -- 172.21.15.22:0/1451156312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa38005520 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.778+0000 7faa2effd640 1 -- 172.21.15.22:0/1451156312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38010460 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.778+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1a5010 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.780+0000 7faa2effd640 1 -- 172.21.15.22:0/1451156312 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7faa38004ea0 con 0x7faa3c101de0 2024-09-11T22:33:52.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.780+0000 7faa46272740 1 Processor -- start 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 -- start start 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa2effd640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 0x7faa280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x55802707aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x55802708bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558026fe02f0 con 0x55802707bb40 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558026f87cf0 con 0x558027089780 2024-09-11T22:33:52.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa46272740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558026fdc2b0 con 0x55802707a5d0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa42436640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 0x7faa280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa2effd640 1 -- 172.21.15.22:0/1451156312 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faa380cefe0 con 0x7faa3c101de0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49026/0 (socket says 172.21.15.22:49026) 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 -- 172.21.15.22:0/4101539273 learned_addr learned my addr 172.21.15.22:0/4101539273 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41434640 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x55802707aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 -- 172.21.15.22:0/4101539273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 msgr2=0x55802707aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa42436640 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x55802708bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x55802707aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 -- 172.21.15.22:0/4101539273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 msgr2=0x55802708bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x55802708bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.781+0000 7faa41c35640 1 -- 172.21.15.22:0/4101539273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558026f6c3a0 con 0x55802707bb40 2024-09-11T22:33:52.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.782+0000 7faa42436640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 0x7faa280a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa3400acf0 tx=0x7faa3400e720 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.782+0000 7faa41c35640 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faa380a3c30 tx=0x7faa38097790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adb6e128cc3b33c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.782+0000 7faa27fff640 1 -- 172.21.15.22:0/4101539273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38020040 con 0x55802707bb40 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.782+0000 7faa27fff640 1 -- 172.21.15.22:0/4101539273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa3809bbf0 con 0x55802707bb40 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.782+0000 7faa27fff640 1 -- 172.21.15.22:0/4101539273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38097b60 con 0x55802707bb40 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- 172.21.15.22:0/4101539273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 msgr2=0x55802707a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faa380a3c30 tx=0x7faa38097790 comp rx=0 tx=0).stop 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- 172.21.15.22:0/4101539273 shutdown_connections 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x55802708bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x55802707aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 --2- 172.21.15.22:0/4101539273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707bb40 0x55802707a090 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- 172.21.15.22:0/4101539273 >> 172.21.15.22:0/4101539273 conn(0x558027043310 msgr2=0x558027076c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- 172.21.15.22:0/4101539273 shutdown_connections 2024-09-11T22:33:52.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- 172.21.15.22:0/4101539273 wait complete. 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 -- start start 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.783+0000 7faa46272740 1 Processor -- start 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 0x558027086430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x558027086a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55802708c420 con 0x55802707a5d0 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558026f9b060 con 0x558027089780 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55802708c5a0 con 0x55802707bb40 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 10 client.0 _ll_register_callbacks cb 0x558026cee8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49042/0 (socket says 172.21.15.22:49042) 2024-09-11T22:33:52.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 -- 172.21.15.22:0/1677318295 learned_addr learned my addr 172.21.15.22:0/1677318295 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa42436640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x558027086a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41434640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 0x558027086430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 -- 172.21.15.22:0/1677318295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 msgr2=0x558027086430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 0x558027086430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 -- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 msgr2=0x558027086a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x558027086a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 -- 172.21.15.22:0/1677318295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558026d513c0 con 0x55802707a5d0 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41434640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 0x558027086430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa41c35640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faa38009610 tx=0x7faa380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636486722bdce126 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa257fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:52.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38065030 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faa38005190 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.784+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3809bbf0 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faa38020070 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 10 client.16284 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558027097ec0 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa3809bbf0 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7faa3809a940 con 0x55802707a5d0 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 10 client.16284 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 20 client.16284 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027099210 0x55802709b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 4 client.16284 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:52.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558026fed860 con 0x558027099210 2024-09-11T22:33:52.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.785+0000 7faa41434640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027099210 0x55802709b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.786+0000 7faa41434640 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027099210 0x55802709b600 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72793f23229ab41 server_cookie=daddea8fd330ee9e in_seq=0 out_seq=0 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.786+0000 7faa257fa640 10 client.16284 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa257fa640 1 -- 172.21.15.22:0/1677318295 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558026fed860 con 0x558027099210 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa257fa640 10 client.16284 handle_command_reply: tid=0 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 client.16284 shutdown 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 msgr2=0x558027089180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faa38009610 tx=0x7faa380046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 shutdown_connections 2024-09-11T22:33:52.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027099210 0x55802709b600 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558027089780 0x558027086a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707bb40 0x558027086430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 --2- 172.21.15.22:0/1677318295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027089180 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 >> 172.21.15.22:0/1677318295 conn(0x558027043310 msgr2=0x55802707c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa257fa640 0 client.16284 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 shutdown_connections 2024-09-11T22:33:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 1 -- 172.21.15.22:0/1677318295 wait complete. 2024-09-11T22:33:52.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.787+0000 7faa46272740 20 client.16284 trim_cache size 0 max 16384 2024-09-11T22:33:52.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 Processor -- start 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 -- start start 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x5580270956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558027089780 0x558027071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1a94b0 con 0x55802707a5d0 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1abd30 con 0x55802707bb40 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa46272740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1a9b20 con 0x558027089780 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa41c35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49044/0 (socket says 172.21.15.22:49044) 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.800+0000 7faa41c35640 1 -- 172.21.15.22:0/3018159952 learned_addr learned my addr 172.21.15.22:0/3018159952 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41434640 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x5580270956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 -- 172.21.15.22:0/3018159952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558027089780 msgr2=0x558027071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558027089780 0x558027071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 -- 172.21.15.22:0/3018159952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 msgr2=0x5580270956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x5580270956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 -- 172.21.15.22:0/3018159952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558027087020 con 0x55802707a5d0 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41434640 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x5580270956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa41c35640 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faa3809b1f0 tx=0x7faa38097790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5a0819242c7724 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa277fe640 1 -- 172.21.15.22:0/3018159952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38065040 con 0x55802707a5d0 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa277fe640 1 -- 172.21.15.22:0/3018159952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa38097030 con 0x55802707a5d0 2024-09-11T22:33:52.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa277fe640 1 -- 172.21.15.22:0/3018159952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38097b60 con 0x55802707a5d0 2024-09-11T22:33:52.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa46272740 1 -- 172.21.15.22:0/3018159952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 msgr2=0x558027086400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.801+0000 7faa46272740 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faa3809b1f0 tx=0x7faa38097790 comp rx=0 tx=0).stop 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 -- 172.21.15.22:0/3018159952 shutdown_connections 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558027089780 0x558027071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x5580270956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 --2- 172.21.15.22:0/3018159952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55802707a5d0 0x558027086400 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 -- 172.21.15.22:0/3018159952 >> 172.21.15.22:0/3018159952 conn(0x558027043310 msgr2=0x558027085cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 -- 172.21.15.22:0/3018159952 shutdown_connections 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 -- 172.21.15.22:0/3018159952 wait complete. 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 -- start start 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.802+0000 7faa46272740 1 Processor -- start 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x558027091ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x55802708d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aa1f0 con 0x558027089780 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1ab660 con 0x55802707bb40 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aa8c0 con 0x55802707a5d0 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 10 client.0 _ll_register_callbacks cb 0x7faa380056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49048/0 (socket says 172.21.15.22:49048) 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 -- 172.21.15.22:0/3603195741 learned_addr learned my addr 172.21.15.22:0/3603195741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa41434640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x55802708d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa41c35640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x558027091ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 -- 172.21.15.22:0/3603195741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 msgr2=0x558027091ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x558027091ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 -- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 msgr2=0x55802708d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x55802708d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 -- 172.21.15.22:0/3603195741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802708df10 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa42436640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7faa3400a310 tx=0x7faa34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be29ed4dec9052cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa257fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34010e40 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa38097030 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.803+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7faa3401f450 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faa3401f650 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 10 client.16290 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558027103af0 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa38097030 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7faa3401c040 con 0x558027089780 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 10 client.16290 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 10 client.16290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 20 client.16290 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:52.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027104220 0x558027106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 4 client.16290 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558026fe7d70 con 0x558027104220 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.804+0000 7faa41c35640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027104220 0x558027106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa257fa640 10 client.16290 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa41c35640 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027104220 0x558027106640 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6971b96bacc456a server_cookie=559b750dcbd75e75 in_seq=0 out_seq=0 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa257fa640 1 -- 172.21.15.22:0/3603195741 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558026fe7d70 con 0x558027104220 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa257fa640 10 client.16290 handle_command_reply: tid=0 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 client.16290 shutdown 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 msgr2=0x55802708d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7faa3400a310 tx=0x7faa34004a40 comp rx=0 tx=0).stop 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 shutdown_connections 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558027104220 0x558027106640 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558027089780 0x55802708d730 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55802707bb40 0x55802708d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa257fa640 0 client.16290 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 --2- 172.21.15.22:0/3603195741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55802707a5d0 0x558027091ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 >> 172.21.15.22:0/3603195741 conn(0x558027043310 msgr2=0x558027087c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 shutdown_connections 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 1 -- 172.21.15.22:0/3603195741 wait complete. 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.805+0000 7faa46272740 20 client.16290 trim_cache size 0 max 16384 2024-09-11T22:33:52.811 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 msgr2=0x7faa280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 0x7faa280a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa3400acf0 tx=0x7faa3400e720 comp rx=0 tx=0).stop 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 msgr2=0x7faa3c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7faa3800d770 tx=0x7faa3800dc30 comp rx=0 tx=0).stop 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 shutdown_connections 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7faa280a2cf0 0x7faa280a51b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa3c106f10 0x7faa3c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa3c102790 0x7faa3c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 --2- 172.21.15.22:0/1451156312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa3c101de0 0x7faa3c198490 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:52.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 >> 172.21.15.22:0/1451156312 conn(0x7faa3c0fd8c0 msgr2=0x7faa3c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:52.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 shutdown_connections 2024-09-11T22:33:52.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:52.806+0000 7faa43e99640 1 -- 172.21.15.22:0/1451156312 wait complete. 2024-09-11T22:33:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:54 smithi022 ceph-mon[30966]: pgmap v149: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:54.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:54 smithi169 ceph-mon[35628]: pgmap v149: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:54.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:54 smithi045 ceph-mon[35556]: pgmap v149: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:54.615 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:33:54.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:33:54.889 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.337+0000 7ffa49658640 1 -- 172.21.15.22:0/1723363403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa441000d0 msgr2=0x7ffa44100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.337+0000 7ffa49658640 1 --2- 172.21.15.22:0/1723363403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa441000d0 0x7ffa44100530 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009900 tx=0x7ffa2c02a410 comp rx=0 tx=0).stop 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 -- 172.21.15.22:0/1723363403 shutdown_connections 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 --2- 172.21.15.22:0/1723363403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44100a70 0x7ffa4410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 --2- 172.21.15.22:0/1723363403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa441000d0 0x7ffa44100530 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 --2- 172.21.15.22:0/1723363403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa44106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 -- 172.21.15.22:0/1723363403 >> 172.21.15.22:0/1723363403 conn(0x7ffa44077210 msgr2=0x7ffa440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 -- 172.21.15.22:0/1723363403 shutdown_connections 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 -- 172.21.15.22:0/1723363403 wait complete. 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.338+0000 7ffa49658640 1 Processor -- start 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 -- start start 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 0x7ffa44198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa4419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441121f0 con 0x7ffa44100a70 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44112070 con 0x7ffa44106ba0 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa49658640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44112370 con 0x7ffa441000d0 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58794/0 (socket says 172.21.15.22:58794) 2024-09-11T22:33:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 -- 172.21.15.22:0/2300567773 learned_addr learned my addr 172.21.15.22:0/2300567773 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa437fe640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa4419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 -- 172.21.15.22:0/2300567773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 msgr2=0x7ffa44198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 0x7ffa44198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 0x7ffa44198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 -- 172.21.15.22:0/2300567773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 msgr2=0x7ffa4419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa4419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa427fc640 1 -- 172.21.15.22:0/2300567773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4419d5e0 con 0x7ffa44100a70 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa437fe640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa4419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.339+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 0x7ffa44198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa427fc640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006010 tx=0x7ffa2c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa3bfff640 1 -- 172.21.15.22:0/2300567773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c03f030 con 0x7ffa44100a70 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4419d870 con 0x7ffa44100a70 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa3bfff640 1 -- 172.21.15.22:0/2300567773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa2c005500 con 0x7ffa44100a70 2024-09-11T22:33:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa3bfff640 1 -- 172.21.15.22:0/2300567773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c035070 con 0x7ffa44100a70 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.340+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa441a51b0 con 0x7ffa44100a70 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.342+0000 7ffa4ba31740 1 Processor -- start 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.342+0000 7ffa3bfff640 1 -- 172.21.15.22:0/2300567773 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ffa2c042030 con 0x7ffa44100a70 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.342+0000 7ffa4ba31740 1 -- start start 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5d8480 0x559b8a5e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 0x559b8a5e5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b8a53d280 con 0x559b8a5d7b60 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559b8a4e4b10 con 0x559b8a5e2d40 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b8a539240 con 0x559b8a5d8480 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58804/0 (socket says 172.21.15.22:58804) 2024-09-11T22:33:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 -- 172.21.15.22:0/545365408 learned_addr learned my addr 172.21.15.22:0/545365408 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5d8480 0x559b8a5e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa427fc640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 0x559b8a5e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 -- 172.21.15.22:0/545365408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5d8480 msgr2=0x559b8a5e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5d8480 0x559b8a5e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 -- 172.21.15.22:0/545365408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 msgr2=0x559b8a5e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 0x559b8a5e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa437fe640 1 -- 172.21.15.22:0/545365408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8a4f11f0 con 0x559b8a5d7b60 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa427fc640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 0x559b8a5e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.343+0000 7ffa3bfff640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 0x7ffa300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa437fe640 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400af40 tx=0x7ffa3400e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4c94cb7c4a387 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 0x7ffa300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa3bfff640 1 -- 172.21.15.22:0/2300567773 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffa2c0efb30 con 0x7ffa44100a70 2024-09-11T22:33:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa397fa640 1 -- 172.21.15.22:0/545365408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34003b70 con 0x559b8a5d7b60 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa397fa640 1 -- 172.21.15.22:0/545365408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa34003d10 con 0x559b8a5d7b60 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa397fa640 1 -- 172.21.15.22:0/545365408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34010ca0 con 0x559b8a5d7b60 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa4ba31740 1 -- 172.21.15.22:0/545365408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 msgr2=0x559b8a5d7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400af40 tx=0x7ffa3400e7e0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.344+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 0x7ffa300a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559b8a5d4f50 tx=0x7ffa3c008040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- 172.21.15.22:0/545365408 shutdown_connections 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5e2d40 0x559b8a5e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5d8480 0x559b8a5e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/545365408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5d7f40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- 172.21.15.22:0/545365408 >> 172.21.15.22:0/545365408 conn(0x559b8a5d40f0 msgr2=0x559b8a5d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- 172.21.15.22:0/545365408 shutdown_connections 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- 172.21.15.22:0/545365408 wait complete. 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- start start 2024-09-11T22:33:55.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 Processor -- start 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5e0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b8a5e5910 con 0x559b8a5d7b60 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559b8a4f7f10 con 0x559b8a5d8480 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b8a5e5a90 con 0x559b8a5e2d40 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa4ba31740 10 client.0 _ll_register_callbacks cb 0x559b8a4c0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58818/0 (socket says 172.21.15.22:58818) 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.345+0000 7ffa42ffd640 1 -- 172.21.15.22:0/627567361 learned_addr learned my addr 172.21.15.22:0/627567361 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa427fc640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa437fe640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 -- 172.21.15.22:0/627567361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 msgr2=0x559b8a5e0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 -- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 msgr2=0x559b8a5e0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5e0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 -- 172.21.15.22:0/627567361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8a2ae6a0 con 0x559b8a5d7b60 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa427fc640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0157d0 tx=0x7ffa3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d58f8dea3127da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c023070 con 0x559b8a5d7b60 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffa3c013b20 con 0x559b8a5d7b60 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa34003d10 con 0x559b8a5d7b60 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ffa3c02f050 con 0x559b8a5d7b60 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa4ba31740 10 client.16302 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559b8a5f1570 con 0x559b8a5d7b60 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.346+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa34003d10 con 0x559b8a5d7b60 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ffa3c01e070 con 0x559b8a5d7b60 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 10 client.16302 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 20 client.16302 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a5f2980 0x559b8a5f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 4 client.16302 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b8a54a7f0 con 0x559b8a5f2980 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa427fc640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a5f2980 0x559b8a5f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa427fc640 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a5f2980 0x559b8a5f4e20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836c13a94b4f7c33 server_cookie=af4bb8896b54753f in_seq=0 out_seq=0 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.347+0000 7ffa2a7fc640 10 client.16302 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/627567361 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b8a54a7f0 con 0x559b8a5f2980 2024-09-11T22:33:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa2a7fc640 10 client.16302 handle_command_reply: tid=0 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 client.16302 shutdown 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 msgr2=0x559b8a5dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0157d0 tx=0x7ffa3c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 shutdown_connections 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a5f2980 0x559b8a5f4e20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa2a7fc640 0 client.16302 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/627567361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5dfc10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 >> 172.21.15.22:0/627567361 conn(0x559b8a5d40f0 msgr2=0x559b8a5d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 shutdown_connections 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.348+0000 7ffa4ba31740 1 -- 172.21.15.22:0/627567361 wait complete. 2024-09-11T22:33:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.349+0000 7ffa4ba31740 20 client.16302 trim_cache size 0 max 16384 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 Processor -- start 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 -- start start 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ab810 con 0x559b8a5d7b60 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ae090 con 0x559b8a5d8480 2024-09-11T22:33:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.366+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441abe80 con 0x559b8a5e2d40 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58828/0 (socket says 172.21.15.22:58828) 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 -- 172.21.15.22:0/2616723752 learned_addr learned my addr 172.21.15.22:0/2616723752 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa427fc640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 -- 172.21.15.22:0/2616723752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 msgr2=0x559b8a5fa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa437fe640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5fa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 -- 172.21.15.22:0/2616723752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 msgr2=0x559b8a5da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5da5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 -- 172.21.15.22:0/2616723752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8a5de160 con 0x559b8a5d7b60 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa427fc640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa437fe640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5fa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:55.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c008010 tx=0x7ffa3c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b72c1a62866237 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa38ff9640 1 -- 172.21.15.22:0/2616723752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c038070 con 0x559b8a5d7b60 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa38ff9640 1 -- 172.21.15.22:0/2616723752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa3c019070 con 0x559b8a5d7b60 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.367+0000 7ffa38ff9640 1 -- 172.21.15.22:0/2616723752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c023040 con 0x559b8a5d7b60 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 -- 172.21.15.22:0/2616723752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 msgr2=0x559b8a5e1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c008010 tx=0x7ffa3c00f690 comp rx=0 tx=0).stop 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 -- 172.21.15.22:0/2616723752 shutdown_connections 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5fa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d8480 0x559b8a5da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/2616723752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d7b60 0x559b8a5e1e30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 -- 172.21.15.22:0/2616723752 >> 172.21.15.22:0/2616723752 conn(0x559b8a5d40f0 msgr2=0x559b8a5debd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 -- 172.21.15.22:0/2616723752 shutdown_connections 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.368+0000 7ffa4ba31740 1 -- 172.21.15.22:0/2616723752 wait complete. 2024-09-11T22:33:55.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 -- start start 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 Processor -- start 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d7b60 0x559b8a5e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ac550 con 0x559b8a5d8480 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441ad9c0 con 0x559b8a5d7b60 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441acc20 con 0x559b8a5e2d40 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa4ba31740 10 client.0 _ll_register_callbacks cb 0x7ffa3c015450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58844/0 (socket says 172.21.15.22:58844) 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 -- 172.21.15.22:0/1413242586 learned_addr learned my addr 172.21.15.22:0/1413242586 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d7b60 0x559b8a5e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa437fe640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 -- 172.21.15.22:0/1413242586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 msgr2=0x559b8a5e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 -- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d7b60 msgr2=0x559b8a5e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d7b60 0x559b8a5e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.369+0000 7ffa427fc640 1 -- 172.21.15.22:0/1413242586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8a660df0 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa427fc640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0bbda0 tx=0x7ffa2c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a601f1befb4755af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c049040 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ffa2c004370 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa3c019070 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0bc0a0 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 10 client.16308 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559b8a662100 con 0x559b8a5d8480 2024-09-11T22:33:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa3c019070 con 0x559b8a5d8480 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ffa2c0d7080 con 0x559b8a5d8480 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 10 client.16308 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 20 client.16308 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a6627d0 0x559b8a664bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 4 client.16308 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.370+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b8a544d00 con 0x559b8a6627d0 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.371+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a6627d0 0x559b8a664bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.371+0000 7ffa2a7fc640 10 client.16308 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.371+0000 7ffa42ffd640 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a6627d0 0x559b8a664bc0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a3d0ceb737b164 server_cookie=b8c9574ff1e3f7dc in_seq=0 out_seq=0 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa2a7fc640 1 -- 172.21.15.22:0/1413242586 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b8a544d00 con 0x559b8a6627d0 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa2a7fc640 10 client.16308 handle_command_reply: tid=0 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 client.16308 shutdown 2024-09-11T22:33:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 msgr2=0x559b8a5e7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0bbda0 tx=0x7ffa2c02a410 comp rx=0 tx=0).stop 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 shutdown_connections 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559b8a6627d0 0x559b8a664bc0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b8a5e2d40 0x559b8a5e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b8a5d8480 0x559b8a5e7310 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 --2- 172.21.15.22:0/1413242586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559b8a5d7b60 0x559b8a5e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 >> 172.21.15.22:0/1413242586 conn(0x559b8a5d40f0 msgr2=0x559b8a5de3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.372+0000 7ffa2a7fc640 0 client.16308 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 shutdown_connections 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa4ba31740 1 -- 172.21.15.22:0/1413242586 wait complete. 2024-09-11T22:33:55.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa4ba31740 20 client.16308 trim_cache size 0 max 16384 2024-09-11T22:33:55.382 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:55.382 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:33:55.382 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "92121ef4-7aa8-40aa-aff6-39dfa068bbba", 2024-09-11T22:33:55.382 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:33:55.382 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 msgr2=0x7ffa300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 0x7ffa300a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559b8a5d4f50 tx=0x7ffa3c008040 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 msgr2=0x7ffa44198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006010 tx=0x7ffa2c004c00 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 shutdown_connections 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ffa300a2cf0 0x7ffa300a51b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa44106ba0 0x7ffa4419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa44100a70 0x7ffa44198b70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 --2- 172.21.15.22:0/2300567773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa441000d0 0x7ffa44198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 >> 172.21.15.22:0/2300567773 conn(0x7ffa44077210 msgr2=0x7ffa44104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.373+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 shutdown_connections 2024-09-11T22:33:55.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:55.374+0000 7ffa49658640 1 -- 172.21.15.22:0/2300567773 wait complete. 2024-09-11T22:33:56.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:33:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:56 smithi022 ceph-mon[30966]: pgmap v150: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:56.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:56 smithi169 ceph-mon[35628]: pgmap v150: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:56.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:56 smithi045 ceph-mon[35556]: pgmap v150: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:33:56.448 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:33:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 -- 172.21.15.22:0/1252388227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7870100480 msgr2=0x7f7870100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 --2- 172.21.15.22:0/1252388227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7870100480 0x7f7870100860 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f786c009900 tx=0x7f786c02a410 comp rx=0 tx=0).stop 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 -- 172.21.15.22:0/1252388227 shutdown_connections 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 --2- 172.21.15.22:0/1252388227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78701055b0 0x7f787010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 --2- 172.21.15.22:0/1252388227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 0x7f7870104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 --2- 172.21.15.22:0/1252388227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7870100480 0x7f7870100860 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 -- 172.21.15.22:0/1252388227 >> 172.21.15.22:0/1252388227 conn(0x7f7870077210 msgr2=0x7f78700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 -- 172.21.15.22:0/1252388227 shutdown_connections 2024-09-11T22:33:56.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.892+0000 7f7877ec8640 1 -- 172.21.15.22:0/1252388227 wait complete. 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.893+0000 7f7877ec8640 1 Processor -- start 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.893+0000 7f7877ec8640 1 -- start start 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7870100480 0x7f7870199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 0x7f78701999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7870110770 con 0x7f78701055b0 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78701105f0 con 0x7f7870100e30 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7877ec8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78701108f0 con 0x7f7870100480 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58858/0 (socket says 172.21.15.22:58858) 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 -- 172.21.15.22:0/996309734 learned_addr learned my addr 172.21.15.22:0/996309734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7875463640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 0x7f78701999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7875c64640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7870100480 0x7f7870199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 -- 172.21.15.22:0/996309734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7870100480 msgr2=0x7f7870199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7870100480 0x7f7870199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 -- 172.21.15.22:0/996309734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 msgr2=0x7f78701999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 0x7f78701999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 -- 172.21.15.22:0/996309734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78701a4a20 con 0x7f78701055b0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.894+0000 7f7876465640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f786800cad0 tx=0x7f786800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.895+0000 7f7866ffd640 1 -- 172.21.15.22:0/996309734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786800ad60 con 0x7f78701055b0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.895+0000 7f7866ffd640 1 -- 172.21.15.22:0/996309734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7868004b20 con 0x7f78701055b0 2024-09-11T22:33:56.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.895+0000 7f7866ffd640 1 -- 172.21.15.22:0/996309734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786800f6f0 con 0x7f78701055b0 2024-09-11T22:33:56.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.895+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78701a4bf0 con 0x7f78701055b0 2024-09-11T22:33:56.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.895+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a5100 con 0x7f78701055b0 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.897+0000 7f7866ffd640 1 -- 172.21.15.22:0/996309734 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7868004cd0 con 0x7f78701055b0 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.897+0000 7f787a2a1740 1 Processor -- start 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 -- start start 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d53251a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251aca0 0x55d532529550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d5324802e0 con 0x55d532529a90 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d532427ce0 con 0x55d53251aca0 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f787a2a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d53247c2a0 con 0x55d53251a380 2024-09-11T22:33:56.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7875463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7866ffd640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 0x7f785c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7875463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58862/0 (socket says 172.21.15.22:58862) 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7875463640 1 -- 172.21.15.22:0/1846404867 learned_addr learned my addr 172.21.15.22:0/1846404867 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7875c64640 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251aca0 0x55d532529550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7876465640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 0x7f785c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.898+0000 7f7875463640 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d53251a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7866ffd640 1 -- 172.21.15.22:0/996309734 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78680cf3d0 con 0x7f78701055b0 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 -- 172.21.15.22:0/1846404867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 msgr2=0x55d53251a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d53251a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 -- 172.21.15.22:0/1846404867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251aca0 msgr2=0x55d532529550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251aca0 0x55d532529550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 -- 172.21.15.22:0/1846404867 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53240c440 con 0x55d532529a90 2024-09-11T22:33:56.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7875463640 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7860009f50 tx=0x7f78600095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d2bf96e6f66128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f7876465640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 0x7f785c0a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f786809b5e0 tx=0x7f786800af90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f785bfff640 1 -- 172.21.15.22:0/1846404867 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860017470 con 0x55d532529a90 2024-09-11T22:33:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f785bfff640 1 -- 172.21.15.22:0/1846404867 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f786001c070 con 0x55d532529a90 2024-09-11T22:33:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.899+0000 7f785bfff640 1 -- 172.21.15.22:0/1846404867 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860015a70 con 0x55d532529a90 2024-09-11T22:33:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- 172.21.15.22:0/1846404867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 msgr2=0x55d53252be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7860009f50 tx=0x7f78600095c0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- 172.21.15.22:0/1846404867 shutdown_connections 2024-09-11T22:33:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d532529a90 0x55d53252be80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251aca0 0x55d532529550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 --2- 172.21.15.22:0/1846404867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d53251a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- 172.21.15.22:0/1846404867 >> 172.21.15.22:0/1846404867 conn(0x55d532516a30 msgr2=0x55d532516e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- 172.21.15.22:0/1846404867 shutdown_connections 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- 172.21.15.22:0/1846404867 wait complete. 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.900+0000 7f787a2a1740 1 -- start start 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 Processor -- start 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251aca0 0x55d5325266a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532526c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d53252c660 con 0x55d53251a380 2024-09-11T22:33:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d53243b050 con 0x55d532529a90 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d53252c7e0 con 0x55d53251aca0 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f787a2a1740 10 client.0 _ll_register_callbacks cb 0x55d53247b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58874/0 (socket says 172.21.15.22:58874) 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 -- 172.21.15.22:0/3600056955 learned_addr learned my addr 172.21.15.22:0/3600056955 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 -- 172.21.15.22:0/3600056955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251aca0 msgr2=0x55d5325266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251aca0 0x55d5325266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 -- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 msgr2=0x55d532526c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532526c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.901+0000 7f7875463640 1 -- 172.21.15.22:0/3600056955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5321f13c0 con 0x55d53251a380 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f7875463640 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f78600092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad261a840c97f4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860017670 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f7860017810 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786001c070 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7860015440 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 10 client.16320 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55d5325380a0 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f786001c070 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f78600203f0 con 0x55d53251a380 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 10 client.16320 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 20 client.16320 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d532539450 0x55d53253b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 4 client.16320 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.902+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d53248d850 con 0x55d532539450 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.903+0000 7f7875c64640 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d532539450 0x55d53253b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.903+0000 7f7875c64640 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d532539450 0x55d53253b840 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d745a580ddfd423 server_cookie=e203a10fb07b36f3 in_seq=0 out_seq=0 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.903+0000 7f78597fa640 10 client.16320 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f78597fa640 1 -- 172.21.15.22:0/3600056955 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d53248d850 con 0x55d532539450 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f78597fa640 10 client.16320 handle_command_reply: tid=0 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 client.16320 shutdown 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 msgr2=0x55d5325293a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7860001eb0 tx=0x7f78600092a0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 shutdown_connections 2024-09-11T22:33:56.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d532539450 0x55d53253b840 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532526c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251aca0 0x55d5325266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 --2- 172.21.15.22:0/3600056955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251a380 0x55d5325293a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f78597fa640 0 client.16320 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 >> 172.21.15.22:0/3600056955 conn(0x55d532516a30 msgr2=0x55d53251c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 shutdown_connections 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 1 -- 172.21.15.22:0/3600056955 wait complete. 2024-09-11T22:33:56.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.904+0000 7f787a2a1740 20 client.16320 trim_cache size 0 max 16384 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.921+0000 7f787a2a1740 1 Processor -- start 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.921+0000 7f787a2a1740 1 -- start start 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d532535930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532515a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78701a9770 con 0x55d53251aca0 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78701abff0 con 0x55d532529a90 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f787a2a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78701a9de0 con 0x55d53251a380 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58890/0 (socket says 172.21.15.22:58890) 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 -- 172.21.15.22:0/196680936 learned_addr learned my addr 172.21.15.22:0/196680936 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 -- 172.21.15.22:0/196680936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 msgr2=0x55d532535930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d532535930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 -- 172.21.15.22:0/196680936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 msgr2=0x55d532515a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875463640 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532515a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532515a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 -- 172.21.15.22:0/196680936 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d532524bf0 con 0x55d53251aca0 2024-09-11T22:33:56.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875463640 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532515a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:56.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f7875c64640 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f786c009900 tx=0x7f786c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cece6f756c7dde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f785b7fe640 1 -- 172.21.15.22:0/196680936 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c035040 con 0x55d53251aca0 2024-09-11T22:33:56.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f785b7fe640 1 -- 172.21.15.22:0/196680936 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f786c005020 con 0x55d53251aca0 2024-09-11T22:33:56.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.922+0000 7f785b7fe640 1 -- 172.21.15.22:0/196680936 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c004b00 con 0x55d53251aca0 2024-09-11T22:33:56.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- 172.21.15.22:0/196680936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 msgr2=0x55d532525f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f786c009900 tx=0x7f786c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- 172.21.15.22:0/196680936 shutdown_connections 2024-09-11T22:33:56.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d532529a90 0x55d532515a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d532525f80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 --2- 172.21.15.22:0/196680936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d53251a380 0x55d532535930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- 172.21.15.22:0/196680936 >> 172.21.15.22:0/196680936 conn(0x55d532516a30 msgr2=0x55d532515350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- 172.21.15.22:0/196680936 shutdown_connections 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- 172.21.15.22:0/196680936 wait complete. 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.923+0000 7f787a2a1740 1 -- start start 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 Processor -- start 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 0x55d53252d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d532529a90 0x55d5325a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78701aa4b0 con 0x55d53251aca0 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78701ab920 con 0x55d53251a380 2024-09-11T22:33:56.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78701aab80 con 0x55d532529a90 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f787a2a1740 10 client.0 _ll_register_callbacks cb 0x7f786c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58894/0 (socket says 172.21.15.22:58894) 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 -- 172.21.15.22:0/414532050 learned_addr learned my addr 172.21.15.22:0/414532050 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875463640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 0x55d53252d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875463640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d532529a90 0x55d5325a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 -- 172.21.15.22:0/414532050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d532529a90 msgr2=0x55d5325a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d532529a90 0x55d5325a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 -- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 msgr2=0x55d53252d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 0x55d53252d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875c64640 1 -- 172.21.15.22:0/414532050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5325a2340 con 0x55d53251aca0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.924+0000 7f7875463640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 0x55d53252d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f7875c64640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f786c048000 tx=0x7f786c0047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc22b2796366227 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:56.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c035070 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f786c004e10 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786c005020 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f786c0051d0 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 10 client.16326 fetch_fsmap learned FSMap version 22 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55d5325a35c0 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f786c005020 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f786c003bb0 con 0x55d53251aca0 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 10 client.16326 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 20 client.16326 populate_metadata read hostname 'smithi022' 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d5325a3de0 0x55d5325a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 4 client.16326 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:33:56.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.925+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d532487d60 con 0x55d5325a3de0 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f7875463640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d5325a3de0 0x55d5325a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f7875463640 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d5325a3de0 0x55d5325a61d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92ce772c16e2f80 server_cookie=f617b1fac2f0b21f in_seq=0 out_seq=0 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f78597fa640 10 client.16326 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f78597fa640 1 -- 172.21.15.22:0/414532050 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d532487d60 con 0x55d5325a3de0 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f78597fa640 10 client.16326 handle_command_reply: tid=0 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f787a2a1740 1 client.16326 shutdown 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 msgr2=0x55d53252d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.926+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f786c048000 tx=0x7f786c0047a0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 shutdown_connections 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d5325a3de0 0x55d5325a61d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d532529a90 0x55d5325a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d53251aca0 0x55d53252d540 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 --2- 172.21.15.22:0/414532050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d53251a380 0x55d53252d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f78597fa640 0 client.16326 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 >> 172.21.15.22:0/414532050 conn(0x55d532516a30 msgr2=0x55d532515b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 shutdown_connections 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 1 -- 172.21.15.22:0/414532050 wait complete. 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f787a2a1740 20 client.16326 trim_cache size 0 max 16384 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stdout: "92121ef4-7aa8-40aa-aff6-39dfa068bbba": { 2024-09-11T22:33:56.933 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "92121ef4-7aa8-40aa-aff6-39dfa068bbba", 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 msgr2=0x7f785c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 0x7f785c0a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f786809b5e0 tx=0x7f786800af90 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 msgr2=0x7f78701a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f786800cad0 tx=0x7f786800ced0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 shutdown_connections 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f785c0a2d70 0x7f785c0a5230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78701055b0 0x7f78701a44e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7870100e30 0x7f78701999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 --2- 172.21.15.22:0/996309734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7870100480 0x7f7870199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 >> 172.21.15.22:0/996309734 conn(0x7f7870077210 msgr2=0x7f78700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 shutdown_connections 2024-09-11T22:33:56.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:33:56.927+0000 7f7877ec8640 1 -- 172.21.15.22:0/996309734 wait complete. 2024-09-11T22:33:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:57 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:33:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:57 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:57 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:33:57.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:57 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:57 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:33:57.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:57 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:57 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:33:57.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:57 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:57 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:33:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:57 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:57 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:33:57.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:57 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:33:57.627 INFO:tasks.cephfs.filesystem:scrub status for tag:92121ef4-7aa8-40aa-aff6-39dfa068bbba - {'path': '/', 'tag': '92121ef4-7aa8-40aa-aff6-39dfa068bbba', 'options': 'recursive,force'} 2024-09-11T22:33:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:58 smithi022 ceph-mon[30966]: pgmap v151: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:58.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:58 smithi169 ceph-mon[35628]: pgmap v151: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:58.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:58 smithi045 ceph-mon[35556]: pgmap v151: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:33:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:33:59 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:33:59.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:33:59 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:33:59.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:33:59 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:34:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:00 smithi022 ceph-mon[30966]: pgmap v152: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:00.402 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:00 smithi169 ceph-mon[35628]: pgmap v152: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:00.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:00 smithi045 ceph-mon[35556]: pgmap v152: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:02.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:02 smithi022 ceph-mon[30966]: pgmap v153: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:02.403 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:02 smithi169 ceph-mon[35628]: pgmap v153: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:02.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:02 smithi045 ceph-mon[35556]: pgmap v153: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:04.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:04 smithi045 ceph-mon[35556]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:04.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:04 smithi022 ceph-mon[30966]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:04.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:04 smithi169 ceph-mon[35628]: pgmap v154: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:06.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:06 smithi045 ceph-mon[35556]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:06 smithi022 ceph-mon[30966]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:06.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:06 smithi169 ceph-mon[35628]: pgmap v155: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:08.411 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:08 smithi045 ceph-mon[35556]: pgmap v156: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:08.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:08 smithi022 ceph-mon[30966]: pgmap v156: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:08.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:08 smithi169 ceph-mon[35628]: pgmap v156: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:10 smithi022 ceph-mon[30966]: pgmap v157: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:10.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:10 smithi169 ceph-mon[35628]: pgmap v157: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:10.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:10 smithi045 ceph-mon[35556]: pgmap v157: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:34:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:12 smithi022 ceph-mon[30966]: pgmap v158: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:12.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:12 smithi169 ceph-mon[35628]: pgmap v158: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:12.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:12 smithi045 ceph-mon[35556]: pgmap v158: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:13 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:13.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:13 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:13.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:13 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:14.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:14 smithi022 ceph-mon[30966]: pgmap v159: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:14.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:14.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:14.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:34:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:14 smithi169 ceph-mon[35628]: pgmap v159: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:14.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:34:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:14 smithi045 ceph-mon[35556]: pgmap v159: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:34:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:14.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:14.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:34:16.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:16 smithi022 ceph-mon[30966]: pgmap v160: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:16.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:16 smithi169 ceph-mon[35628]: pgmap v160: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:16.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:16 smithi045 ceph-mon[35556]: pgmap v160: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:34:18.464 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:18 smithi045 ceph-mon[35556]: pgmap v161: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T22:34:18.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:18 smithi022 ceph-mon[30966]: pgmap v161: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T22:34:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:18 smithi169 ceph-mon[35628]: pgmap v161: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-11T22:34:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:20 smithi022 ceph-mon[30966]: pgmap v162: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:34:20.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:20 smithi169 ceph-mon[35628]: pgmap v162: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:34:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:20 smithi045 ceph-mon[35556]: pgmap v162: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:34:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:22 smithi022 ceph-mon[30966]: pgmap v163: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:22.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:22 smithi169 ceph-mon[35628]: pgmap v163: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:22 smithi045 ceph-mon[35556]: pgmap v163: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:24.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:24 smithi022 ceph-mon[30966]: pgmap v164: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:24.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:24 smithi169 ceph-mon[35628]: pgmap v164: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:24.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:24 smithi045 ceph-mon[35556]: pgmap v164: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T22:34:26.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:26 smithi022 ceph-mon[30966]: pgmap v165: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:34:26.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:26 smithi169 ceph-mon[35628]: pgmap v165: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:34:26.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:26 smithi045 ceph-mon[35556]: pgmap v165: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:34:27.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:34:27.904 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:34:28.282 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:28 smithi022 ceph-mon[30966]: pgmap v166: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 -- 172.21.15.22:0/715486517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 msgr2=0x7f105410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 --2- 172.21.15.22:0/715486517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f105410e610 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ca0 tx=0x7f104c02a950 comp rx=0 tx=0).stop 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 -- 172.21.15.22:0/715486517 shutdown_connections 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 --2- 172.21.15.22:0/715486517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f105410e610 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 --2- 172.21.15.22:0/715486517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054103660 0x7f105410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 --2- 172.21.15.22:0/715486517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054102d40 0x7f1054103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 -- 172.21.15.22:0/715486517 >> 172.21.15.22:0/715486517 conn(0x7f10540fc7a0 msgr2=0x7f10540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 -- 172.21.15.22:0/715486517 shutdown_connections 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.367+0000 7f1058cb3640 1 -- 172.21.15.22:0/715486517 wait complete. 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.368+0000 7f1058cb3640 1 Processor -- start 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.368+0000 7f1058cb3640 1 -- start start 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.368+0000 7f1058cb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 0x7f10541009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.368+0000 7f1058cb3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054103660 0x7f1054100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.368+0000 7f1058cb3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1058cb3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1054112090 con 0x7f105410c170 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1058cb3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1054111f10 con 0x7f1054102d40 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1058cb3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1054112210 con 0x7f1054103660 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f105259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 0x7f10541009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50414/0 (socket says 172.21.15.22:50414) 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 -- 172.21.15.22:0/3110376237 learned_addr learned my addr 172.21.15.22:0/3110376237 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1051d9b640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054103660 0x7f1054100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 -- 172.21.15.22:0/3110376237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054103660 msgr2=0x7f1054100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054103660 0x7f1054100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 -- 172.21.15.22:0/3110376237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 msgr2=0x7f10541009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 0x7f10541009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 -- 172.21.15.22:0/3110376237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541aae60 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f105259c640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 0x7f10541009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1052d9d640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f104c005cc0 tx=0x7f104c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f10437fe640 1 -- 172.21.15.22:0/3110376237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c034040 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541ab030 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f10437fe640 1 -- 172.21.15.22:0/3110376237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f104c030940 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.369+0000 7f10437fe640 1 -- 172.21.15.22:0/3110376237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0456e0 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.370+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541ab5c0 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f10437fe640 1 -- 172.21.15.22:0/3110376237 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f104c037020 con 0x7f105410c170 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 Processor -- start 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 -- start start 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 0x55ceef919140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef91ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.372+0000 7f105b08c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ceef8742e0 con 0x55ceef90e4a0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f105b08c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ceef81bce0 con 0x55ceef919680 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f105b08c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ceef8702a0 con 0x55ceef90edc0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50420/0 (socket says 172.21.15.22:50420) 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 -- 172.21.15.22:0/2941061842 learned_addr learned my addr 172.21.15.22:0/2941061842 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f10437fe640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 0x7f103c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f105259c640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 0x55ceef919140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef91ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1052d9d640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 0x7f103c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 -- 172.21.15.22:0/2941061842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 msgr2=0x55ceef919140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 0x55ceef919140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 -- 172.21.15.22:0/2941061842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 msgr2=0x55ceef91ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f10437fe640 1 -- 172.21.15.22:0/3110376237 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f104c0f02a0 con 0x7f105410c170 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef91ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 -- 172.21.15.22:0/2941061842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceef800440 con 0x55ceef90e4a0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f105259c640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 0x55ceef919140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f104800bfd0 tx=0x7f104800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674ab747176401b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.373+0000 7f1040ff9640 1 -- 172.21.15.22:0/2941061842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800f5f0 con 0x55ceef90e4a0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f1052d9d640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 0x7f103c0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f104c0bc620 tx=0x7f104c0b1db0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f1040ff9640 1 -- 172.21.15.22:0/2941061842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f104800fc90 con 0x55ceef90e4a0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f1040ff9640 1 -- 172.21.15.22:0/2941061842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800ecc0 con 0x55ceef90e4a0 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 -- 172.21.15.22:0/2941061842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 msgr2=0x55ceef90e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f104800bfd0 tx=0x7f104800b7d0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 -- 172.21.15.22:0/2941061842 shutdown_connections 2024-09-11T22:34:28.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef91ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90edc0 0x55ceef919140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 --2- 172.21.15.22:0/2941061842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef90e880 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 -- 172.21.15.22:0/2941061842 >> 172.21.15.22:0/2941061842 conn(0x55ceef90aa30 msgr2=0x55ceef90ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 -- 172.21.15.22:0/2941061842 shutdown_connections 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.374+0000 7f105b08c740 1 -- 172.21.15.22:0/2941061842 wait complete. 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 -- start start 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 Processor -- start 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef9162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ceef91c250 con 0x55ceef919680 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ceef82f050 con 0x55ceef90edc0 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ceef91c3d0 con 0x55ceef90e4a0 2024-09-11T22:34:28.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105b08c740 10 client.0 _ll_register_callbacks cb 0x55ceef86f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50434/0 (socket says 172.21.15.22:50434) 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f1051d9b640 1 -- 172.21.15.22:0/924901140 learned_addr learned my addr 172.21.15.22:0/924901140 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f105259c640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef9162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.375+0000 7f1051d9b640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 -- 172.21.15.22:0/924901140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 msgr2=0x55ceef918ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 -- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 msgr2=0x55ceef9162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef9162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 -- 172.21.15.22:0/924901140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceef5e53c0 con 0x55ceef919680 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1051d9b640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f104800b3c0 tx=0x7f104800e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecaa889dad72d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800ea60 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104800fc90 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f104800ec00 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1048004020 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f105b08c740 10 client.16338 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ceef927c20 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.376+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f104800fc90 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f104800f650 con 0x55ceef919680 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 10 client.16338 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 20 client.16338 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef928fd0 0x55ceef92b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 4 client.16338 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceef881850 con 0x55ceef928fd0 2024-09-11T22:34:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.377+0000 7f105259c640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef928fd0 0x55ceef92b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.378+0000 7f1039ffb640 10 client.16338 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.378+0000 7f105259c640 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef928fd0 0x55ceef92b3c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8465bc9c552b732 server_cookie=9f7b6c2f420c035d in_seq=0 out_seq=0 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.378+0000 7f1039ffb640 1 -- 172.21.15.22:0/924901140 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ceef881850 con 0x55ceef928fd0 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.378+0000 7f1039ffb640 10 client.16338 handle_command_reply: tid=0 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 client.16338 shutdown 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 msgr2=0x55ceef916800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f104800b3c0 tx=0x7f104800e860 comp rx=0 tx=0).stop 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 shutdown_connections 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef928fd0 0x55ceef92b3c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef919680 0x55ceef916800 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef9162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f1039ffb640 0 client.16338 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 --2- 172.21.15.22:0/924901140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 >> 172.21.15.22:0/924901140 conn(0x55ceef90aa30 msgr2=0x55ceef910710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 shutdown_connections 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 1 -- 172.21.15.22:0/924901140 wait complete. 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.379+0000 7f105b08c740 20 client.16338 trim_cache size 0 max 16384 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 Processor -- start 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 -- start start 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef931070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b1e40 con 0x55ceef90edc0 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b46c0 con 0x55ceef919680 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105b08c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b24b0 con 0x55ceef90e4a0 2024-09-11T22:34:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50446/0 (socket says 172.21.15.22:50446) 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.396+0000 7f105259c640 1 -- 172.21.15.22:0/2860878389 learned_addr learned my addr 172.21.15.22:0/2860878389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef931070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 -- 172.21.15.22:0/2860878389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 msgr2=0x55ceef918210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 -- 172.21.15.22:0/2860878389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 msgr2=0x55ceef931070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef931070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 -- 172.21.15.22:0/2860878389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceef916b70 con 0x55ceef90edc0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f1051d9b640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef931070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f105259c640 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55ceef915b30 tx=0x7f1044012d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70601cd6aa8bd504 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f103bfff640 1 -- 172.21.15.22:0/2860878389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044023030 con 0x55ceef90edc0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f103bfff640 1 -- 172.21.15.22:0/2860878389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1044010960 con 0x55ceef90edc0 2024-09-11T22:34:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.397+0000 7f103bfff640 1 -- 172.21.15.22:0/2860878389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044005620 con 0x55ceef90edc0 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 -- 172.21.15.22:0/2860878389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 msgr2=0x55ceef930b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55ceef915b30 tx=0x7f1044012d40 comp rx=0 tx=0).stop 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 -- 172.21.15.22:0/2860878389 shutdown_connections 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef919680 0x55ceef931070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90edc0 0x55ceef930b30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 --2- 172.21.15.22:0/2860878389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef90e4a0 0x55ceef918210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 -- 172.21.15.22:0/2860878389 >> 172.21.15.22:0/2860878389 conn(0x55ceef90aa30 msgr2=0x55ceef917b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.398+0000 7f105b08c740 1 -- 172.21.15.22:0/2860878389 shutdown_connections 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 -- 172.21.15.22:0/2860878389 wait complete. 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 -- start start 2024-09-11T22:34:28.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 Processor -- start 2024-09-11T22:34:28.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef91f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef919680 0x55ceef91f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b2b80 con 0x55ceef90e4a0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b3ff0 con 0x55ceef90edc0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10541b3250 con 0x55ceef919680 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105b08c740 10 client.0 _ll_register_callbacks cb 0x7f104800bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f1051d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50458/0 (socket says 172.21.15.22:50458) 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f1051d9b640 1 -- 172.21.15.22:0/3991595116 learned_addr learned my addr 172.21.15.22:0/3991595116 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.399+0000 7f105259c640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef91f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef919680 0x55ceef91f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 -- 172.21.15.22:0/3991595116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef919680 msgr2=0x55ceef91f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef919680 0x55ceef91f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 -- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 msgr2=0x55ceef91f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef91f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 -- 172.21.15.22:0/3991595116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceef91fe10 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f105259c640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef91f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1051d9b640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f104800bfd0 tx=0x7f104800e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff04dcf3347c509c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800fbf0 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f104800e8d0 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1044010960 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f104803f050 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f105b08c740 10 client.16344 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.400+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ceef993a80 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1044010960 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f1048003710 con 0x55ceef90e4a0 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 10 client.16344 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 20 client.16344 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:28.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef9940f0 0x55ceef9964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 4 client.16344 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ceef87bd60 con 0x55ceef9940f0 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.401+0000 7f105259c640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef9940f0 0x55ceef9964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105259c640 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef9940f0 0x55ceef9964e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5585e6503dcb595 server_cookie=4d4766305fefb163 in_seq=0 out_seq=0 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f1039ffb640 10 client.16344 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f1039ffb640 1 -- 172.21.15.22:0/3991595116 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ceef87bd60 con 0x55ceef9940f0 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f1039ffb640 10 client.16344 handle_command_reply: tid=0 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 client.16344 shutdown 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 msgr2=0x55ceef921d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f104800bfd0 tx=0x7f104800e860 comp rx=0 tx=0).stop 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 shutdown_connections 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ceef9940f0 0x55ceef9964e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f1039ffb640 0 client.16344 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:28.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ceef919680 0x55ceef91f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ceef90edc0 0x55ceef91f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 --2- 172.21.15.22:0/3991595116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ceef90e4a0 0x55ceef921d50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 >> 172.21.15.22:0/3991595116 conn(0x55ceef90aa30 msgr2=0x55ceef918320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 shutdown_connections 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 1 -- 172.21.15.22:0/3991595116 wait complete. 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.402+0000 7f105b08c740 20 client.16344 trim_cache size 0 max 16384 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:34:28.418 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 msgr2=0x7f103c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 0x7f103c0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f104c0bc620 tx=0x7f104c0b1db0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 msgr2=0x7f1054101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f104c005cc0 tx=0x7f104c02f790 comp rx=0 tx=0).stop 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 shutdown_connections 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f103c0a2cf0 0x7f103c0a51b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f105410c170 0x7f1054101420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1054103660 0x7f1054100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 --2- 172.21.15.22:0/3110376237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054102d40 0x7f10541009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:28.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 >> 172.21.15.22:0/3110376237 conn(0x7f10540fc7a0 msgr2=0x7f10540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:28.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 shutdown_connections 2024-09-11T22:34:28.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:28.403+0000 7f1058cb3640 1 -- 172.21.15.22:0/3110376237 wait complete. 2024-09-11T22:34:28.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:28 smithi169 ceph-mon[35628]: pgmap v166: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:28.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:28 smithi045 ceph-mon[35556]: pgmap v166: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:29.215 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:34:29.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:34:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 -- 172.21.15.22:0/3795751823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 msgr2=0x7f33d81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 --2- 172.21.15.22:0/3795751823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d81067e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009900 tx=0x7f33cc02a410 comp rx=0 tx=0).stop 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 -- 172.21.15.22:0/3795751823 shutdown_connections 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 --2- 172.21.15.22:0/3795751823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8106f10 0x7f33d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 --2- 172.21.15.22:0/3795751823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d81067e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 --2- 172.21.15.22:0/3795751823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8101de0 0x7f33d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.938+0000 7f33de62e640 1 -- 172.21.15.22:0/3795751823 >> 172.21.15.22:0/3795751823 conn(0x7f33d80fd8c0 msgr2=0x7f33d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.939+0000 7f33de62e640 1 -- 172.21.15.22:0/3795751823 shutdown_connections 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.939+0000 7f33de62e640 1 -- 172.21.15.22:0/3795751823 wait complete. 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.939+0000 7f33de62e640 1 Processor -- start 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.939+0000 7f33de62e640 1 -- start start 2024-09-11T22:34:29.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8101de0 0x7f33d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 0x7f33d8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33d81120d0 con 0x7f33d8102790 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f33d8111f50 con 0x7f33d8101de0 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33de62e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f33d8112250 con 0x7f33d8106f10 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50474/0 (socket says 172.21.15.22:50474) 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 -- 172.21.15.22:0/312366865 learned_addr learned my addr 172.21.15.22:0/312366865 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d7fff640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8101de0 0x7f33d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33dcbcb640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 0x7f33d8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:29.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 -- 172.21.15.22:0/312366865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 msgr2=0x7f33d8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 0x7f33d8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 -- 172.21.15.22:0/312366865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8101de0 msgr2=0x7f33d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8101de0 0x7f33d80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33d77fe640 1 -- 172.21.15.22:0/312366865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d81a6ac0 con 0x7f33d8102790 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.940+0000 7f33dcbcb640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 0x7f33d8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33d77fe640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f33cc006010 tx=0x7f33cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc03f030 con 0x7f33d8102790 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d81a6d50 con 0x7f33d8102790 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33cc003d00 con 0x7f33d8102790 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc035070 con 0x7f33d8102790 2024-09-11T22:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.941+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81a7220 con 0x7f33d8102790 2024-09-11T22:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.942+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d81021c0 con 0x7f33d8102790 2024-09-11T22:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.943+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f33cc042030 con 0x7f33d8102790 2024-09-11T22:34:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.944+0000 7f33d57fa640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 0x7f33c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.944+0000 7f33d7fff640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 0x7f33c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.944+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f33cc0efd00 con 0x7f33d8102790 2024-09-11T22:34:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.944+0000 7f33d7fff640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 0x7f33c00a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009990 tx=0x7f33c8009110 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:29.948+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33cc0bc910 con 0x7f33d8102790 2024-09-11T22:34:30.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.158+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33d810a0f0 con 0x7f33d8102790 2024-09-11T22:34:30.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.158+0000 7f33d57fa640 1 -- 172.21.15.22:0/312366865 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f33cc0bc210 con 0x7f33d8102790 2024-09-11T22:34:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:34:30.160 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:34:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:34:30.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.160+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 msgr2=0x7f33c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.160+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 0x7f33c00a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009990 tx=0x7f33c8009110 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.160+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 msgr2=0x7f33d8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.160+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f33cc006010 tx=0x7f33cc0042f0 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 shutdown_connections 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f33c00a2cf0 0x7f33c00a51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f33d8106f10 0x7f33d8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33d8102790 0x7f33d8074a30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 --2- 172.21.15.22:0/312366865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d8101de0 0x7f33d80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 >> 172.21.15.22:0/312366865 conn(0x7f33d80fd8c0 msgr2=0x7f33d80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 shutdown_connections 2024-09-11T22:34:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:30.161+0000 7f33de62e640 1 -- 172.21.15.22:0/312366865 wait complete. 2024-09-11T22:34:30.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:30 smithi022 ceph-mon[30966]: pgmap v167: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:30.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:30 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/312366865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:34:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:30 smithi169 ceph-mon[35628]: pgmap v167: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:30.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:30 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/312366865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:34:30.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:30 smithi045 ceph-mon[35556]: pgmap v167: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:30.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:30 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/312366865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:34:30.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:34:31.118 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3621440634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4102790 msgr2=0x7f8fb41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3621440634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4102790 0x7f8fb41067e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa402a410 comp rx=0 tx=0).stop 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3621440634 shutdown_connections 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3621440634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 0x7f8fb410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3621440634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4102790 0x7f8fb41067e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3621440634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4101de0 0x7f8fb41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3621440634 >> 172.21.15.22:0/3621440634 conn(0x7f8fb40fd8c0 msgr2=0x7f8fb40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3621440634 shutdown_connections 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3621440634 wait complete. 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.573+0000 7f8fbbb6a640 1 Processor -- start 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 -- start start 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 0x7f8fb4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 0x7f8fb419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4112090 con 0x7f8fb4101de0 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4111f10 con 0x7f8fb4102790 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fbbb6a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4112210 con 0x7f8fb4106f10 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50494/0 (socket says 172.21.15.22:50494) 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 -- 172.21.15.22:0/3762599361 learned_addr learned my addr 172.21.15.22:0/3762599361 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9105640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 0x7f8fb4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fba107640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 0x7f8fb419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 -- 172.21.15.22:0/3762599361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 msgr2=0x7f8fb419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 0x7f8fb419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 -- 172.21.15.22:0/3762599361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 msgr2=0x7f8fb4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 0x7f8fb4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 -- 172.21.15.22:0/3762599361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb419d480 con 0x7f8fb4101de0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9105640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 0x7f8fb4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.574+0000 7f8fb9906640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000d950 tx=0x7f8fb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.575+0000 7f8faaffd640 1 -- 172.21.15.22:0/3762599361 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0017030 con 0x7f8fb4101de0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.575+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb419d770 con 0x7f8fb4101de0 2024-09-11T22:34:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.575+0000 7f8faaffd640 1 -- 172.21.15.22:0/3762599361 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fb0004020 con 0x7f8fb4101de0 2024-09-11T22:34:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.575+0000 7f8faaffd640 1 -- 172.21.15.22:0/3762599361 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0004a00 con 0x7f8fb4101de0 2024-09-11T22:34:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.575+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a5050 con 0x7f8fb4101de0 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.577+0000 7f8faaffd640 1 -- 172.21.15.22:0/3762599361 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8fb00041d0 con 0x7f8fb4101de0 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.577+0000 7f8fbdf43740 1 Processor -- start 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 -- start start 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f68370c2f0 con 0x55f6837b1370 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f6836b3cf0 con 0x55f6837a7b40 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f6837082b0 con 0x55f6837a65d0 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8faaffd640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 0x7f8fa00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fb9105640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fba107640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 0x7f8fa00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fb9105640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50496/0 (socket says 172.21.15.22:50496) 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fb9105640 1 -- 172.21.15.22:0/914172455 learned_addr learned my addr 172.21.15.22:0/914172455 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fba107640 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8fb9906640 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.578+0000 7f8faaffd640 1 -- 172.21.15.22:0/3762599361 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8fb00cee60 con 0x7f8fb4101de0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 -- 172.21.15.22:0/914172455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 msgr2=0x55f6837a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 -- 172.21.15.22:0/914172455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 msgr2=0x55f6837a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 -- 172.21.15.22:0/914172455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6836983a0 con 0x55f6837b1370 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fb9105640 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa4032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88d85b664586876 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8fba107640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 0x7f8fa00a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0092f0 tx=0x7f8fac009c30 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8f9ffff640 1 -- 172.21.15.22:0/914172455 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4035070 con 0x55f6837b1370 2024-09-11T22:34:31.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8f9ffff640 1 -- 172.21.15.22:0/914172455 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fa4031840 con 0x55f6837b1370 2024-09-11T22:34:31.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.579+0000 7f8f9ffff640 1 -- 172.21.15.22:0/914172455 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa403e7d0 con 0x55f6837b1370 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- 172.21.15.22:0/914172455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 msgr2=0x55f6837b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa4032c80 comp rx=0 tx=0).stop 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- 172.21.15.22:0/914172455 shutdown_connections 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b3760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/914172455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- 172.21.15.22:0/914172455 >> 172.21.15.22:0/914172455 conn(0x55f68376f310 msgr2=0x55f6837a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- 172.21.15.22:0/914172455 shutdown_connections 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- 172.21.15.22:0/914172455 wait complete. 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 -- start start 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.580+0000 7f8fbdf43740 1 Processor -- start 2024-09-11T22:34:31.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a7b40 0x55f6837adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f6837b4010 con 0x55f6837b1370 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f6836c7060 con 0x55f6837a65d0 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f6837b4190 con 0x55f6837a7b40 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fbdf43740 10 client.0 _ll_register_callbacks cb 0x55f68341a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50500/0 (socket says 172.21.15.22:50500) 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 -- 172.21.15.22:0/1340186356 learned_addr learned my addr 172.21.15.22:0/1340186356 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fb9105640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a7b40 0x55f6837adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 -- 172.21.15.22:0/1340186356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a7b40 msgr2=0x55f6837adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a7b40 0x55f6837adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 -- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 msgr2=0x55f6837b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 -- 172.21.15.22:0/1340186356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f68347d3c0 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8fba107640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8fac014310 tx=0x7f8fac01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92acaf02c3b2a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.581+0000 7f8f9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac025030 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8fac012b00 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa4031840 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8fac02e020 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 10 client.16362 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f6837bfa70 con 0x55f6837b1370 2024-09-11T22:34:31.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fa4031840 con 0x55f6837b1370 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f8fac00f050 con 0x55f6837b1370 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 10 client.16362 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 20 client.16362 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6837c0e80 0x55f6837c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 4 client.16362 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.582+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f683719860 con 0x55f6837c0e80 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.583+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6837c0e80 0x55f6837c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.583+0000 7f8f9d7fa640 10 client.16362 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.583+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6837c0e80 0x55f6837c32f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587f6726469de601 server_cookie=72ad7fe06e989645 in_seq=0 out_seq=0 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.584+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1340186356 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f683719860 con 0x55f6837c0e80 2024-09-11T22:34:31.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.584+0000 7f8f9d7fa640 10 client.16362 handle_command_reply: tid=0 2024-09-11T22:34:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.584+0000 7f8fbdf43740 1 client.16362 shutdown 2024-09-11T22:34:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.584+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 msgr2=0x55f6837ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.584+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8fac014310 tx=0x7f8fac01b000 comp rx=0 tx=0).stop 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 shutdown_connections 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f6837c0e80 0x55f6837c32f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837ae5d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a7b40 0x55f6837adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1340186356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8f9d7fa640 0 client.16362 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 >> 172.21.15.22:0/1340186356 conn(0x55f68376f310 msgr2=0x55f6837a8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 shutdown_connections 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1340186356 wait complete. 2024-09-11T22:34:31.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.585+0000 7f8fbdf43740 20 client.16362 trim_cache size 0 max 16384 2024-09-11T22:34:31.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 Processor -- start 2024-09-11T22:34:31.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 -- start start 2024-09-11T22:34:31.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41a95a0 con 0x55f6837b1370 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41abe20 con 0x55f6837a7b40 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41a9c10 con 0x55f6837a65d0 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50508/0 (socket says 172.21.15.22:50508) 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 -- 172.21.15.22:0/3898878669 learned_addr learned my addr 172.21.15.22:0/3898878669 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fb9906640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 -- 172.21.15.22:0/3898878669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 msgr2=0x55f6837bd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837bd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fb9105640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 -- 172.21.15.22:0/3898878669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 msgr2=0x55f6837b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fba107640 1 -- 172.21.15.22:0/3898878669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6837a3960 con 0x55f6837b1370 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fb9906640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837bd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.598+0000 7f8fb9105640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fba107640 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0097c0 tx=0x7f8fac014410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5919c5edf1e45d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8f9f7fe640 1 -- 172.21.15.22:0/3898878669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac025070 con 0x55f6837b1370 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8f9f7fe640 1 -- 172.21.15.22:0/3898878669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fac038070 con 0x55f6837b1370 2024-09-11T22:34:31.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8f9f7fe640 1 -- 172.21.15.22:0/3898878669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac003bd0 con 0x55f6837b1370 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 -- 172.21.15.22:0/3898878669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 msgr2=0x55f6837b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0097c0 tx=0x7f8fac014410 comp rx=0 tx=0).stop 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 -- 172.21.15.22:0/3898878669 shutdown_connections 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837b1370 0x55f6837b2ca0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a7b40 0x55f6837b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/3898878669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837a65d0 0x55f6837bd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 -- 172.21.15.22:0/3898878669 >> 172.21.15.22:0/3898878669 conn(0x55f68376f310 msgr2=0x55f6837ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 -- 172.21.15.22:0/3898878669 shutdown_connections 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.599+0000 7f8fbdf43740 1 -- 172.21.15.22:0/3898878669 wait complete. 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 -- start start 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 Processor -- start 2024-09-11T22:34:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837b1370 0x55f6837b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41aa2e0 con 0x55f6837a7b40 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41ab750 con 0x55f6837a65d0 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41aa9b0 con 0x55f6837b1370 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fbdf43740 10 client.0 _ll_register_callbacks cb 0x7f8fac0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fb9105640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fb9105640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50516/0 (socket says 172.21.15.22:50516) 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fb9105640 1 -- 172.21.15.22:0/1288168180 learned_addr learned my addr 172.21.15.22:0/1288168180 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.600+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fba107640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837b1370 0x55f6837b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 -- 172.21.15.22:0/1288168180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837b1370 msgr2=0x55f6837b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837b1370 0x55f6837b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 -- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 msgr2=0x55f6837c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 -- 172.21.15.22:0/1288168180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6837b8960 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fb9105640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa40055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f54fece8d0b3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8f9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4035070 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f8fa4004040 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fac038070 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8fa4031a50 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fbdf43740 10 client.16368 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.601+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f6837b9b60 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fac038070 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f8fa40035f0 con 0x55f6837a7b40 2024-09-11T22:34:31.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 10 client.16368 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 20 client.16368 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f68382bbe0 0x55f68382dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 4 client.16368 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f683713d70 con 0x55f68382bbe0 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f68382bbe0 0x55f68382dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8f9d7fa640 10 client.16368 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.602+0000 7f8fb9906640 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f68382bbe0 0x55f68382dfd0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67573ad282526a98 server_cookie=e8e99a36dd7479f2 in_seq=0 out_seq=0 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8f9d7fa640 1 -- 172.21.15.22:0/1288168180 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f683713d70 con 0x55f68382bbe0 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8f9d7fa640 10 client.16368 handle_command_reply: tid=0 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 client.16368 shutdown 2024-09-11T22:34:31.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 msgr2=0x55f6837c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa40055f0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 shutdown_connections 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f68382bbe0 0x55f68382dfd0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f6837b1370 0x55f6837b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f6837a7b40 0x55f6837c8320 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8f9d7fa640 0 client.16368 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 --2- 172.21.15.22:0/1288168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6837a65d0 0x55f6837c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 >> 172.21.15.22:0/1288168180 conn(0x55f68376f310 msgr2=0x55f6837b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 shutdown_connections 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 1 -- 172.21.15.22:0/1288168180 wait complete. 2024-09-11T22:34:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.603+0000 7f8fbdf43740 20 client.16368 trim_cache size 0 max 16384 2024-09-11T22:34:31.610 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:34:31.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 msgr2=0x7f8fa00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 0x7f8fa00a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0092f0 tx=0x7f8fac009c30 comp rx=0 tx=0).stop 2024-09-11T22:34:31.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 msgr2=0x7f8fb41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000d950 tx=0x7f8fb000de10 comp rx=0 tx=0).stop 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 shutdown_connections 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8fa00a2d70 0x7f8fa00a5230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fb4106f10 0x7f8fb419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb4102790 0x7f8fb4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 --2- 172.21.15.22:0/3762599361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fb4101de0 0x7f8fb41984d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 >> 172.21.15.22:0/3762599361 conn(0x7f8fb40fd8c0 msgr2=0x7f8fb40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 shutdown_connections 2024-09-11T22:34:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:31.604+0000 7f8fbbb6a640 1 -- 172.21.15.22:0/3762599361 wait complete. 2024-09-11T22:34:32.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:32 smithi022 ceph-mon[30966]: pgmap v168: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:32.457 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:32 smithi169 ceph-mon[35628]: pgmap v168: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:32.665 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:32 smithi045 ceph-mon[35556]: pgmap v168: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:33.401 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:34:33.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:34:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 -- 172.21.15.22:0/1964016478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102ef0 msgr2=0x7f780410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 --2- 172.21.15.22:0/1964016478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102ef0 0x7f780410da40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009ca0 tx=0x7f77fc02a950 comp rx=0 tx=0).stop 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 -- 172.21.15.22:0/1964016478 shutdown_connections 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 --2- 172.21.15.22:0/1964016478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102ef0 0x7f780410da40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 --2- 172.21.15.22:0/1964016478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804102570 0x7f78041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 --2- 172.21.15.22:0/1964016478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804100e20 0x7f7804101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 -- 172.21.15.22:0/1964016478 >> 172.21.15.22:0/1964016478 conn(0x7f78040fc7d0 msgr2=0x7f78040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 -- 172.21.15.22:0/1964016478 shutdown_connections 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 -- 172.21.15.22:0/1964016478 wait complete. 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.300+0000 7f780b595640 1 Processor -- start 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 -- start start 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 0x7f78041985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804102ef0 0x7f780419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78041121e0 con 0x7f7804102570 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7804112060 con 0x7f7804102ef0 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f780b595640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7804112360 con 0x7f7804100e20 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34274/0 (socket says 172.21.15.22:34274) 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 -- 172.21.15.22:0/2457438008 learned_addr learned my addr 172.21.15.22:0/2457438008 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7809331640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 0x7f78041985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7809b32640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804102ef0 0x7f780419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 -- 172.21.15.22:0/2457438008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 msgr2=0x7f78041985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 0x7f78041985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 -- 172.21.15.22:0/2457438008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804102ef0 msgr2=0x7f780419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804102ef0 0x7f780419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 -- 172.21.15.22:0/2457438008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780419d570 con 0x7f7804102570 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7809331640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 0x7f78041985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f7808b30640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c890 tx=0x7f77f400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.301+0000 7f77fa7fc640 1 -- 172.21.15.22:0/2457438008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004220 con 0x7f7804102570 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.302+0000 7f77fa7fc640 1 -- 172.21.15.22:0/2457438008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77f40043c0 con 0x7f7804102570 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.302+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780419d860 con 0x7f7804102570 2024-09-11T22:34:34.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.302+0000 7f77fa7fc640 1 -- 172.21.15.22:0/2457438008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004b10 con 0x7f7804102570 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.302+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78041a5140 con 0x7f7804102570 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.304+0000 7f77fa7fc640 1 -- 172.21.15.22:0/2457438008 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f77f40051b0 con 0x7f7804102570 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.304+0000 7f780d96e740 1 Processor -- start 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.304+0000 7f780d96e740 1 -- start start 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af4433bb60 0x55af4433bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f77fa7fc640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 0x7f77f00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 0x55af44349130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55af442a1280 con 0x55af4433c480 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55af44248b10 con 0x55af44346d40 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f780d96e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af4429d240 con 0x55af4433bb60 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34290/0 (socket says 172.21.15.22:34290) 2024-09-11T22:34:34.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 -- 172.21.15.22:0/2492542773 learned_addr learned my addr 172.21.15.22:0/2492542773 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f77fa7fc640 1 -- 172.21.15.22:0/2457438008 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f77f40cf530 con 0x7f7804102570 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809b32640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af4433bb60 0x55af4433bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7808b30640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 0x7f77f00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809b32640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 0x55af44349130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 -- 172.21.15.22:0/2492542773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af4433bb60 msgr2=0x55af4433bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af4433bb60 0x55af4433bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 -- 172.21.15.22:0/2492542773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 msgr2=0x55af44349130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 0x55af44349130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 -- 172.21.15.22:0/2492542773 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af442551f0 con 0x55af4433c480 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809b32640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 0x55af44349130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.305+0000 7f7809331640 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7800007850 tx=0x7f7800007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699cccf7c4379a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f7808b30640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 0x7f77f00a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77f40cccd0 tx=0x7f77f40057c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f77ef7fe640 1 -- 172.21.15.22:0/2492542773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780000d950 con 0x55af4433c480 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f77ef7fe640 1 -- 172.21.15.22:0/2492542773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7800018070 con 0x55af4433c480 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f77ef7fe640 1 -- 172.21.15.22:0/2492542773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78000123e0 con 0x55af4433c480 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 -- 172.21.15.22:0/2492542773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 msgr2=0x55af44346800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7800007850 tx=0x7f7800007d10 comp rx=0 tx=0).stop 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 -- 172.21.15.22:0/2492542773 shutdown_connections 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af44346d40 0x55af44349130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44346800 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 --2- 172.21.15.22:0/2492542773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af4433bb60 0x55af4433bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 -- 172.21.15.22:0/2492542773 >> 172.21.15.22:0/2492542773 conn(0x55af443380f0 msgr2=0x55af443384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.306+0000 7f780d96e740 1 -- 172.21.15.22:0/2492542773 shutdown_connections 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 -- 172.21.15.22:0/2492542773 wait complete. 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 -- start start 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 Processor -- start 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 0x55af443440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44344600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.307+0000 7f780d96e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55af44349910 con 0x55af4433bb60 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f780d96e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55af4425bf10 con 0x55af4433c480 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f780d96e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af44349a90 con 0x55af44346d40 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f780d96e740 10 client.0 _ll_register_callbacks cb 0x55af44224a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:34.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34302/0 (socket says 172.21.15.22:34302) 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 -- 172.21.15.22:0/2657174162 learned_addr learned my addr 172.21.15.22:0/2657174162 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809331640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 0x55af443440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44344600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 -- 172.21.15.22:0/2657174162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 msgr2=0x55af44344600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44344600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 -- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 msgr2=0x55af443440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 0x55af443440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 -- 172.21.15.22:0/2657174162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af440126a0 con 0x55af4433bb60 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809331640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 0x55af443440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f7809b32640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009ca0 tx=0x7f77fc02ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0caaed972297d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f77ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:34.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc034040 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f77fc003db0 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.308+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7800018070 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f77fc004040 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 10 client.16380 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55af44355480 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7800018070 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f77fc0539c0 con 0x55af4433bb60 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 10 client.16380 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 20 client.16380 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af44358ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 4 client.16380 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:34:34.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af442ae7f0 con 0x55af44356890 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.309+0000 7f7809331640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af44358ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.310+0000 7f7809331640 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af44358ca0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4451f423afd7af3 server_cookie=2e14f7620ca9eb7 in_seq=0 out_seq=0 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.310+0000 7f77ecff9640 10 client.16380 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.310+0000 7f77ecff9640 1 -- 172.21.15.22:0/2657174162 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af442ae7f0 con 0x55af44356890 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.310+0000 7f77ecff9640 10 client.16380 handle_command_reply: tid=0 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.310+0000 7f780d96e740 1 client.16380 shutdown 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 msgr2=0x55af44343b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009ca0 tx=0x7f77fc02ffa0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 shutdown_connections 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af44358ca0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44344600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433c480 0x55af443440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f77ecff9640 0 client.16380 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 --2- 172.21.15.22:0/2657174162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433bb60 0x55af44343b80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 >> 172.21.15.22:0/2657174162 conn(0x55af443380f0 msgr2=0x55af44337270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 shutdown_connections 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 1 -- 172.21.15.22:0/2657174162 wait complete. 2024-09-11T22:34:34.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.311+0000 7f780d96e740 20 client.16380 trim_cache size 0 max 16384 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.328+0000 7f780d96e740 1 Processor -- start 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 -- start start 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af443459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af4434f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ab8b0 con 0x55af4433c480 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ae130 con 0x55af4433bb60 2024-09-11T22:34:34.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f780d96e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78041abf20 con 0x55af44346d40 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34314/0 (socket says 172.21.15.22:34314) 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 -- 172.21.15.22:0/3257926322 learned_addr learned my addr 172.21.15.22:0/3257926322 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809b32640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af443459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809b32640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af4434f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 -- 172.21.15.22:0/3257926322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 msgr2=0x55af4434f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af4434f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 -- 172.21.15.22:0/3257926322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 msgr2=0x55af443459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af443459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 -- 172.21.15.22:0/3257926322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af44337f20 con 0x55af4433c480 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809b32640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af4434f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:34.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.329+0000 7f7809331640 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78000135c0 tx=0x7f780000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abe51b11ed1cee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f77eeffd640 1 -- 172.21.15.22:0/3257926322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780002b020 con 0x55af4433c480 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f77eeffd640 1 -- 172.21.15.22:0/3257926322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7800018040 con 0x55af4433c480 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f77eeffd640 1 -- 172.21.15.22:0/3257926322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800027a30 con 0x55af4433c480 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 -- 172.21.15.22:0/3257926322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 msgr2=0x55af4434f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78000135c0 tx=0x7f780000f040 comp rx=0 tx=0).stop 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 -- 172.21.15.22:0/3257926322 shutdown_connections 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af4434f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af4434f0c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 --2- 172.21.15.22:0/3257926322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af443459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 -- 172.21.15.22:0/3257926322 >> 172.21.15.22:0/3257926322 conn(0x55af443380f0 msgr2=0x55af443452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 -- 172.21.15.22:0/3257926322 shutdown_connections 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.330+0000 7f780d96e740 1 -- 172.21.15.22:0/3257926322 wait complete. 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 -- start start 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 Processor -- start 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af44347120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44347ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ac5f0 con 0x55af4433c480 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ada60 con 0x55af4433bb60 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78041accc0 con 0x55af44346d40 2024-09-11T22:34:34.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f780d96e740 10 client.0 _ll_register_callbacks cb 0x7f77fc02fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.331+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34324/0 (socket says 172.21.15.22:34324) 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 -- 172.21.15.22:0/4103478392 learned_addr learned my addr 172.21.15.22:0/4103478392 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809b32640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af44347120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809b32640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44347ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 -- 172.21.15.22:0/4103478392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 msgr2=0x55af44347ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44347ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 -- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 msgr2=0x55af44347120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af44347120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 -- 172.21.15.22:0/4103478392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af443484b0 con 0x55af4433c480 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809b32640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44347ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:34.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f7809331640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7800006e10 tx=0x7f7800007400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec160a0d0587530f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f77ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800034070 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78000272d0 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7800018040 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7800040050 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f780d96e740 10 client.16386 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.332+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55af443c5bf0 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7800018040 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f78000395d0 con 0x55af4433c480 2024-09-11T22:34:34.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 10 client.16386 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 20 client.16386 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af443c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 4 client.16386 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55af442a8d00 con 0x55af44356890 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.333+0000 7f7809b32640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af443c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.334+0000 7f7809b32640 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af443c80c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=759ad97d3c0fd7a8 server_cookie=5242970bda8c2872 in_seq=0 out_seq=0 2024-09-11T22:34:34.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.334+0000 7f77ecff9640 10 client.16386 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:34.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f77ecff9640 1 -- 172.21.15.22:0/4103478392 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55af442a8d00 con 0x55af44356890 2024-09-11T22:34:34.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f77ecff9640 10 client.16386 handle_command_reply: tid=0 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 client.16386 shutdown 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 msgr2=0x55af44347660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7800006e10 tx=0x7f7800007400 comp rx=0 tx=0).stop 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 shutdown_connections 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55af44356890 0x55af443c80c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af44346d40 0x55af44347ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f77ecff9640 0 client.16386 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af4433c480 0x55af44347660 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 --2- 172.21.15.22:0/4103478392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af4433bb60 0x55af44347120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 >> 172.21.15.22:0/4103478392 conn(0x55af443380f0 msgr2=0x55af44337270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 shutdown_connections 2024-09-11T22:34:34.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 1 -- 172.21.15.22:0/4103478392 wait complete. 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.335+0000 7f780d96e740 20 client.16386 trim_cache size 0 max 16384 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "f3ed8df6-cb00-4214-aec8-779c7ef9634a", 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:34:34.342 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 msgr2=0x7f77f00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 0x7f77f00a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77f40cccd0 tx=0x7f77f40057c0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 msgr2=0x7f7804198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c890 tx=0x7f77f400cd50 comp rx=0 tx=0).stop 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 shutdown_connections 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77f00a2d70 0x7f77f00a5230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7804102ef0 0x7f780419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7804102570 0x7f7804198b00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 --2- 172.21.15.22:0/2457438008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7804100e20 0x7f78041985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:34.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 >> 172.21.15.22:0/2457438008 conn(0x7f78040fc7d0 msgr2=0x7f78041067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:34.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 shutdown_connections 2024-09-11T22:34:34.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:34.336+0000 7f780b595640 1 -- 172.21.15.22:0/2457438008 wait complete. 2024-09-11T22:34:34.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:34 smithi022 ceph-mon[30966]: pgmap v169: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:34.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:34 smithi169 ceph-mon[35628]: pgmap v169: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:34 smithi045 ceph-mon[35556]: pgmap v169: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:35.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:34:35.363 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:34:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:35 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:34:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:35 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:35 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:34:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:35 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:35 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:34:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:35 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:35 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:34:35.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:35 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:35 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:34:35.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:35 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:35 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:34:35.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:35 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:34:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/457589789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 msgr2=0x7f0f6810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/457589789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f6810d930 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009cd0 tx=0x7f0f6002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/457589789 shutdown_connections 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/457589789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f6810d930 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/457589789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 0x7f0f68100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/457589789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 0x7f0f68106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/457589789 >> 172.21.15.22:0/457589789 conn(0x7f0f680fc780 msgr2=0x7f0f680feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/457589789 shutdown_connections 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.832+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/457589789 wait complete. 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 Processor -- start 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 -- start start 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 0x7f0f681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 0x7f0f6819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68110f80 con 0x7f0f68101400 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68110e00 con 0x7f0f68100a60 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f6d5a3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68111100 con 0x7f0f68106a60 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34340/0 (socket says 172.21.15.22:34340) 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f667fc640 1 -- 172.21.15.22:0/1328759174 learned_addr learned my addr 172.21.15.22:0/1328759174 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 0x7f0f681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.833+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 0x7f0f6819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 -- 172.21.15.22:0/1328759174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 msgr2=0x7f0f6819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 0x7f0f6819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 -- 172.21.15.22:0/1328759174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 msgr2=0x7f0f681984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 0x7f0f681984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 -- 172.21.15.22:0/1328759174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6819d4a0 con 0x7f0f68101400 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9f0 tx=0x7f0f5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f4ffff640 1 -- 172.21.15.22:0/1328759174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00cd80 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6819d790 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f4ffff640 1 -- 172.21.15.22:0/1328759174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f5c010930 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f4ffff640 1 -- 172.21.15.22:0/1328759174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c018b00 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.834+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681a5070 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.836+0000 7f0f4ffff640 1 -- 172.21.15.22:0/1328759174 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0f5c018ca0 con 0x7f0f68101400 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 Processor -- start 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 -- start start 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b17b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 0x56388b17da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56388b0d62e0 con 0x56388b1704a0 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56388b07dce0 con 0x56388b170dc0 2024-09-11T22:34:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56388b0d22a0 con 0x56388b17b680 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34348/0 (socket says 172.21.15.22:34348) 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f677fe640 1 -- 172.21.15.22:0/1558998851 learned_addr learned my addr 172.21.15.22:0/1558998851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f4ffff640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 0x7f0f500a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b17b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 0x56388b17da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 0x7f0f500a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.837+0000 7f0f4ffff640 1 -- 172.21.15.22:0/1328759174 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0f5c0cf7b0 con 0x7f0f68101400 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 -- 172.21.15.22:0/1558998851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 msgr2=0x56388b17da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 0x56388b17da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 -- 172.21.15.22:0/1558998851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 msgr2=0x56388b170880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 -- 172.21.15.22:0/1558998851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b062440 con 0x56388b170dc0 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 0x56388b17da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b17b140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009c00 tx=0x7f0f58011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04aa4a5c7d79e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 0x7f0f500a5230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002ae00 tx=0x7f0f6002a8e0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f4d7fa640 1 -- 172.21.15.22:0/1558998851 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58004050 con 0x56388b170dc0 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f4d7fa640 1 -- 172.21.15.22:0/1558998851 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f58005520 con 0x56388b170dc0 2024-09-11T22:34:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.838+0000 7f0f4d7fa640 1 -- 172.21.15.22:0/1558998851 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580035f0 con 0x56388b170dc0 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1558998851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 msgr2=0x56388b17b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b17b140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009c00 tx=0x7f0f58011810 comp rx=0 tx=0).stop 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1558998851 shutdown_connections 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b17b680 0x56388b17da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b17b140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1558998851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b1704a0 0x56388b170880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1558998851 >> 172.21.15.22:0/1558998851 conn(0x56388b16ca30 msgr2=0x56388b16ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1558998851 shutdown_connections 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1558998851 wait complete. 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.839+0000 7f0f6f97c740 1 -- start start 2024-09-11T22:34:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 Processor -- start 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b17aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56388b17e250 con 0x56388b170dc0 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56388b091050 con 0x56388b17b680 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56388b17e3d0 con 0x56388b1704a0 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f6f97c740 10 client.0 _ll_register_callbacks cb 0x56388b0d1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34364/0 (socket says 172.21.15.22:34364) 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 -- 172.21.15.22:0/1765885141 learned_addr learned my addr 172.21.15.22:0/1765885141 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b17aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 -- 172.21.15.22:0/1765885141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 msgr2=0x56388b17aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b17aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 -- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 msgr2=0x56388b1786b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1786b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f667fc640 1 -- 172.21.15.22:0/1765885141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388ae473c0 con 0x56388b170dc0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.840+0000 7f0f677fe640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1786b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f667fc640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0981d0 tx=0x7f0f5c06bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6dfa76b4f5a930 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0cd380 con 0x56388b170dc0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0f5c0cfba0 con 0x56388b170dc0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f58005520 con 0x56388b170dc0 2024-09-11T22:34:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c010ce0 con 0x56388b170dc0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 10 client.16398 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56388b189b70 con 0x56388b170dc0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f58005520 con 0x56388b170dc0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0f5c097ac0 con 0x56388b170dc0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 10 client.16398 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 20 client.16398 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b18b030 0x56388b18d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 4 client.16398 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.841+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388b0e3850 con 0x56388b18b030 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.842+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b18b030 0x56388b18d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.842+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b18b030 0x56388b18d440 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe81ad63ed6578b server_cookie=a31de945f506f4be in_seq=0 out_seq=0 2024-09-11T22:34:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.842+0000 7f0f4aff5640 10 client.16398 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f4aff5640 1 -- 172.21.15.22:0/1765885141 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56388b0e3850 con 0x56388b18b030 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f4aff5640 10 client.16398 handle_command_reply: tid=0 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 client.16398 shutdown 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 msgr2=0x56388b178170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0981d0 tx=0x7f0f5c06bc90 comp rx=0 tx=0).stop 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 shutdown_connections 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b18b030 0x56388b18d440 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1786b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b178170 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/1765885141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b17aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 >> 172.21.15.22:0/1765885141 conn(0x56388b16ca30 msgr2=0x56388b172760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f4aff5640 0 client.16398 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 shutdown_connections 2024-09-11T22:34:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 1 -- 172.21.15.22:0/1765885141 wait complete. 2024-09-11T22:34:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.843+0000 7f0f6f97c740 20 client.16398 trim_cache size 0 max 16384 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.860+0000 7f0f6f97c740 1 Processor -- start 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.860+0000 7f0f6f97c740 1 -- start start 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.860+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b16ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.860+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b1737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.860+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ab870 con 0x56388b17b680 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ae0f0 con 0x56388b170dc0 2024-09-11T22:34:35.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681abee0 con 0x56388b1704a0 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34374/0 (socket says 172.21.15.22:34374) 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 -- 172.21.15.22:0/2939203876 learned_addr learned my addr 172.21.15.22:0/2939203876 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f667fc640 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b1737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b16ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 -- 172.21.15.22:0/2939203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 msgr2=0x56388b16ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b16ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 -- 172.21.15.22:0/2939203876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 msgr2=0x56388b1737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b1737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 -- 172.21.15.22:0/2939203876 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b177120 con 0x56388b17b680 2024-09-11T22:34:35.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f677fe640 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0f60031a70 tx=0x7f0f600093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffcdf106541c4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f4cff9640 1 -- 172.21.15.22:0/2939203876 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004300 con 0x56388b17b680 2024-09-11T22:34:35.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f4cff9640 1 -- 172.21.15.22:0/2939203876 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f60036050 con 0x56388b17b680 2024-09-11T22:34:35.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.861+0000 7f0f4cff9640 1 -- 172.21.15.22:0/2939203876 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f600556e0 con 0x56388b17b680 2024-09-11T22:34:35.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 -- 172.21.15.22:0/2939203876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 msgr2=0x56388b183a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0f60031a70 tx=0x7f0f600093d0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 -- 172.21.15.22:0/2939203876 shutdown_connections 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b17b680 0x56388b183a00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b170dc0 0x56388b1737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/2939203876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b16ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 -- 172.21.15.22:0/2939203876 >> 172.21.15.22:0/2939203876 conn(0x56388b16ca30 msgr2=0x56388b1730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 -- 172.21.15.22:0/2939203876 shutdown_connections 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.862+0000 7f0f6f97c740 1 -- 172.21.15.22:0/2939203876 wait complete. 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 -- start start 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 Processor -- start 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b1edca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ac5b0 con 0x56388b170dc0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681ada20 con 0x56388b17b680 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f681acc80 con 0x56388b1704a0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f6f97c740 10 client.0 _ll_register_callbacks cb 0x7f0f5c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34382/0 (socket says 172.21.15.22:34382) 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 -- 172.21.15.22:0/3076556456 learned_addr learned my addr 172.21.15.22:0/3076556456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f677fe640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b1edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 -- 172.21.15.22:0/3076556456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 msgr2=0x56388b1edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b1edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.863+0000 7f0f667fc640 1 -- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 msgr2=0x56388b1f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:35.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f667fc640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f667fc640 1 -- 172.21.15.22:0/3076556456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388b1f9260 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f677fe640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f667fc640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c09ba70 tx=0x7f0f5c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d4fef64e0b3565 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0cd380 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f0f5c09b1c0 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f60036050 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c0b8020 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 10 client.16404 fetch_fsmap learned FSMap version 22 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56388b1fa3e0 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f60036050 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0f5c0a1200 con 0x56388b170dc0 2024-09-11T22:34:35.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 10 client.16404 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 20 client.16404 populate_metadata read hostname 'smithi022' 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b1fab00 0x56388b1fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.864+0000 7f0f6f97c740 4 client.16404 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56388b0ddd60 con 0x56388b1fab00 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b1fab00 0x56388b1fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f66ffd640 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b1fab00 0x56388b1fcf20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff8298e7b01ba33 server_cookie=5c3ef7b7e2f82868 in_seq=0 out_seq=0 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f4aff5640 10 client.16404 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f4aff5640 1 -- 172.21.15.22:0/3076556456 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56388b0ddd60 con 0x56388b1fab00 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f4aff5640 10 client.16404 handle_command_reply: tid=0 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 client.16404 shutdown 2024-09-11T22:34:35.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 msgr2=0x56388b1ee1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c09ba70 tx=0x7f0f5c00c7d0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 shutdown_connections 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56388b1fab00 0x56388b1fcf20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56388b17b680 0x56388b1f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56388b170dc0 0x56388b1ee1e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f4aff5640 0 client.16404 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 --2- 172.21.15.22:0/3076556456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388b1704a0 0x56388b1edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.865+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 >> 172.21.15.22:0/3076556456 conn(0x56388b16ca30 msgr2=0x56388b17a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 shutdown_connections 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6f97c740 1 -- 172.21.15.22:0/3076556456 wait complete. 2024-09-11T22:34:35.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6f97c740 20 client.16404 trim_cache size 0 max 16384 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "f3ed8df6-cb00-4214-aec8-779c7ef9634a": { 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "f3ed8df6-cb00-4214-aec8-779c7ef9634a", 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:34:35.873 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 msgr2=0x7f0f500a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 0x7f0f500a5230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002ae00 tx=0x7f0f6002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 msgr2=0x7f0f68198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9f0 tx=0x7f0f5c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 shutdown_connections 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0f500a2d70 0x7f0f500a5230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f68106a60 0x7f0f6819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f68101400 0x7f0f68198a30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 --2- 172.21.15.22:0/1328759174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f68100a60 0x7f0f681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 >> 172.21.15.22:0/1328759174 conn(0x7f0f680fc780 msgr2=0x7f0f6806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.866+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 shutdown_connections 2024-09-11T22:34:35.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:34:35.867+0000 7f0f6d5a3640 1 -- 172.21.15.22:0/1328759174 wait complete. 2024-09-11T22:34:36.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:36 smithi022 ceph-mon[30966]: pgmap v170: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:36.565 INFO:tasks.cephfs.filesystem:scrub status for tag:f3ed8df6-cb00-4214-aec8-779c7ef9634a - {'path': '/', 'tag': 'f3ed8df6-cb00-4214-aec8-779c7ef9634a', 'options': 'recursive,force'} 2024-09-11T22:34:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:36 smithi169 ceph-mon[35628]: pgmap v170: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:36 smithi045 ceph-mon[35556]: pgmap v170: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:38.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:38 smithi022 ceph-mon[30966]: pgmap v171: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:38 smithi169 ceph-mon[35628]: pgmap v171: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:38 smithi045 ceph-mon[35556]: pgmap v171: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:39.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:39 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:34:39.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:39 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:34:39.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:39 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:34:40.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:40 smithi022 ceph-mon[30966]: pgmap v172: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:40.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:40 smithi169 ceph-mon[35628]: pgmap v172: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:40 smithi045 ceph-mon[35556]: pgmap v172: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-11T22:34:42.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:42 smithi022 ceph-mon[30966]: pgmap v173: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:42.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:42 smithi169 ceph-mon[35628]: pgmap v173: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:42 smithi045 ceph-mon[35556]: pgmap v173: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:44 smithi022 ceph-mon[30966]: pgmap v174: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:44.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:44 smithi169 ceph-mon[35628]: pgmap v174: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:44.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:44 smithi045 ceph-mon[35556]: pgmap v174: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:46 smithi022 ceph-mon[30966]: pgmap v175: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:46.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:46 smithi169 ceph-mon[35628]: pgmap v175: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:46 smithi045 ceph-mon[35556]: pgmap v175: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:48.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:48 smithi022 ceph-mon[30966]: pgmap v176: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:48 smithi169 ceph-mon[35628]: pgmap v176: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:48 smithi045 ceph-mon[35556]: pgmap v176: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:34:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:50 smithi022 ceph-mon[30966]: pgmap v177: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:50.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:50 smithi169 ceph-mon[35628]: pgmap v177: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:50 smithi045 ceph-mon[35556]: pgmap v177: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:34:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:52 smithi022 ceph-mon[30966]: pgmap v178: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:34:52.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:52 smithi169 ceph-mon[35628]: pgmap v178: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:34:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:52 smithi045 ceph-mon[35556]: pgmap v178: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T22:34:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:54 smithi022 ceph-mon[30966]: pgmap v179: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:54.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:54 smithi169 ceph-mon[35628]: pgmap v179: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:54.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:54 smithi045 ceph-mon[35556]: pgmap v179: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:55.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:55 smithi022 ceph-mon[30966]: pgmap v180: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:55.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:55 smithi169 ceph-mon[35628]: pgmap v180: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:55.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:55 smithi045 ceph-mon[35556]: pgmap v180: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:57 smithi022 ceph-mon[30966]: pgmap v181: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:57 smithi169 ceph-mon[35628]: pgmap v181: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:57 smithi045 ceph-mon[35556]: pgmap v181: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:34:59.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:34:59 smithi022 ceph-mon[30966]: pgmap v182: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:59.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:34:59 smithi169 ceph-mon[35628]: pgmap v182: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:34:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:34:59 smithi045 ceph-mon[35556]: pgmap v182: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:01 smithi022 ceph-mon[30966]: pgmap v183: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:01.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:01 smithi169 ceph-mon[35628]: pgmap v183: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:01 smithi045 ceph-mon[35556]: pgmap v183: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:03.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:03 smithi022 ceph-mon[30966]: pgmap v184: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:03.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:03 smithi169 ceph-mon[35628]: pgmap v184: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:03 smithi045 ceph-mon[35556]: pgmap v184: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:05.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:05 smithi022 ceph-mon[30966]: pgmap v185: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:05 smithi169 ceph-mon[35628]: pgmap v185: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:05 smithi045 ceph-mon[35556]: pgmap v185: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:06.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:35:06.843 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:07.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 -- 172.21.15.22:0/2449860994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 msgr2=0x7fef30101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 --2- 172.21.15.22:0/2449860994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef30101200 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fef20009900 tx=0x7fef2002a480 comp rx=0 tx=0).stop 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 -- 172.21.15.22:0/2449860994 shutdown_connections 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 --2- 172.21.15.22:0/2449860994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 0x7fef3010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 --2- 172.21.15.22:0/2449860994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 0x7fef301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 --2- 172.21.15.22:0/2449860994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef30101200 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 -- 172.21.15.22:0/2449860994 >> 172.21.15.22:0/2449860994 conn(0x7fef300fc7d0 msgr2=0x7fef300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 -- 172.21.15.22:0/2449860994 shutdown_connections 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.305+0000 7fef365fd640 1 -- 172.21.15.22:0/2449860994 wait complete. 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 Processor -- start 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 -- start start 2024-09-11T22:35:07.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 0x7fef30198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 0x7fef3019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef301110a0 con 0x7fef30100e20 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef30110f20 con 0x7fef30102570 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef365fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef30111220 con 0x7fef30102ef0 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42004/0 (socket says 172.21.15.22:42004) 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 -- 172.21.15.22:0/1368270288 learned_addr learned my addr 172.21.15.22:0/1368270288 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef27fff640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 0x7fef30198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef34b9a640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 0x7fef3019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 -- 172.21.15.22:0/1368270288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 msgr2=0x7fef3019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 0x7fef3019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 -- 172.21.15.22:0/1368270288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 msgr2=0x7fef30198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 0x7fef30198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.306+0000 7fef2ffff640 1 -- 172.21.15.22:0/1368270288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3019d590 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fef20006010 tx=0x7fef20004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef2dffb640 1 -- 172.21.15.22:0/1368270288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2003f030 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef2dffb640 1 -- 172.21.15.22:0/1368270288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef20005500 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3019d820 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef2dffb640 1 -- 172.21.15.22:0/1368270288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20035070 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.307+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301a5160 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.309+0000 7fef2dffb640 1 -- 172.21.15.22:0/1368270288 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fef20042030 con 0x7fef30100e20 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.309+0000 7fef389d6740 1 Processor -- start 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.309+0000 7fef389d6740 1 -- start start 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb84a0 0x56138fcb8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56138fc1e2e0 con 0x56138fcc3680 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56138fbc5ce0 con 0x56138fcb8dc0 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef389d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56138fc1a2a0 con 0x56138fcb84a0 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42016/0 (socket says 172.21.15.22:42016) 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 -- 172.21.15.22:0/2252984043 learned_addr learned my addr 172.21.15.22:0/2252984043 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef34b9a640 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb84a0 0x56138fcb8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 -- 172.21.15.22:0/2252984043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb84a0 msgr2=0x56138fcb8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb84a0 0x56138fcb8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 -- 172.21.15.22:0/2252984043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 msgr2=0x56138fcc3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef2dffb640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 0x7fef1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef27fff640 1 -- 172.21.15.22:0/2252984043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138fbaa440 con 0x56138fcc3680 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.310+0000 7fef34b9a640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 0x7fef1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef27fff640 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fef1800bcb0 tx=0x7fef180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf3625a95b2d2db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef2dffb640 1 -- 172.21.15.22:0/1368270288 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fef200ef8a0 con 0x7fef30100e20 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef267fc640 1 -- 172.21.15.22:0/2252984043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18004030 con 0x56138fcc3680 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef267fc640 1 -- 172.21.15.22:0/2252984043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef180041d0 con 0x56138fcc3680 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef267fc640 1 -- 172.21.15.22:0/2252984043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef180118b0 con 0x56138fcc3680 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef389d6740 1 -- 172.21.15.22:0/2252984043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 msgr2=0x56138fcc5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef389d6740 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fef1800bcb0 tx=0x7fef180107a0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef34b9a640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 0x7fef1c0a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef28005fd0 tx=0x7fef28009600 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.311+0000 7fef389d6740 1 -- 172.21.15.22:0/2252984043 shutdown_connections 2024-09-11T22:35:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcc3680 0x56138fcc5a70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- 172.21.15.22:0/2252984043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb84a0 0x56138fcb8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- 172.21.15.22:0/2252984043 >> 172.21.15.22:0/2252984043 conn(0x56138fcb4a30 msgr2=0x56138fcb4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- 172.21.15.22:0/2252984043 shutdown_connections 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- 172.21.15.22:0/2252984043 wait complete. 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- start start 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 Processor -- start 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb8dc0 0x56138fcc0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 0x56138fcc07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56138fcc6250 con 0x56138fcb84a0 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56138fbd9050 con 0x56138fcc3680 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.312+0000 7fef389d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56138fcc63d0 con 0x56138fcb8dc0 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef389d6740 10 client.0 _ll_register_callbacks cb 0x56138fc19160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42018/0 (socket says 172.21.15.22:42018) 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 -- 172.21.15.22:0/2432688994 learned_addr learned my addr 172.21.15.22:0/2432688994 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef27fff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb8dc0 0x56138fcc0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef34b9a640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 0x56138fcc07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 -- 172.21.15.22:0/2432688994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb8dc0 msgr2=0x56138fcc0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb8dc0 0x56138fcc0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 -- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 msgr2=0x56138fcc07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 0x56138fcc07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 -- 172.21.15.22:0/2432688994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138f98f3c0 con 0x56138fcb84a0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef34b9a640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 0x56138fcc07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fef200b82c0 tx=0x7fef20009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c327c6bb44347bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20049070 con 0x56138fcb84a0 2024-09-11T22:35:07.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fef200b84d0 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef180041d0 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fef200bb9a0 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef389d6740 10 client.16416 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.313+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56138fcc6250 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef180041d0 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fef200bc0c0 con 0x56138fcb84a0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 10 client.16416 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 20 client.16416 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fcd3040 0x56138fcd5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 4 client.16416 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56138fc2b850 con 0x56138fcd3040 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.314+0000 7fef27fff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fcd3040 0x56138fcd5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.315+0000 7fef27fff640 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fcd3040 0x56138fcd5470 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e320b639e4b7d43b server_cookie=9b7a8d08279a88fc in_seq=0 out_seq=0 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.315+0000 7fef0f7fe640 10 client.16416 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.315+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2432688994 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56138fc2b850 con 0x56138fcd3040 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.315+0000 7fef0f7fe640 10 client.16416 handle_command_reply: tid=0 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.315+0000 7fef389d6740 1 client.16416 shutdown 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 msgr2=0x56138fcc2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fef200b82c0 tx=0x7fef20009560 comp rx=0 tx=0).stop 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 shutdown_connections 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fcd3040 0x56138fcd5470 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcc3680 0x56138fcc07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcb8dc0 0x56138fcc0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 --2- 172.21.15.22:0/2432688994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc2fd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef0f7fe640 0 client.16416 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:07.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 >> 172.21.15.22:0/2432688994 conn(0x56138fcb4a30 msgr2=0x56138fcba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 shutdown_connections 2024-09-11T22:35:07.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 1 -- 172.21.15.22:0/2432688994 wait complete. 2024-09-11T22:35:07.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.316+0000 7fef389d6740 20 client.16416 trim_cache size 0 max 16384 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 Processor -- start 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 -- start start 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcbeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fcba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.333+0000 7fef389d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef301ab730 con 0x56138fcb84a0 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef389d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef301adfb0 con 0x56138fcb8dc0 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef389d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef301abda0 con 0x56138fcc3680 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42034/0 (socket says 172.21.15.22:42034) 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 -- 172.21.15.22:0/1718035696 learned_addr learned my addr 172.21.15.22:0/1718035696 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef27fff640 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcbeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 -- 172.21.15.22:0/1718035696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 msgr2=0x56138fcba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fcba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 -- 172.21.15.22:0/1718035696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 msgr2=0x56138fcbeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcbeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 -- 172.21.15.22:0/1718035696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138fcbf230 con 0x56138fcb84a0 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef27fff640 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcbeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef2ffff640 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fef200f3010 tx=0x7fef200ba370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95afe06ac4b00504 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef25ffb640 1 -- 172.21.15.22:0/1718035696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20049070 con 0x56138fcb84a0 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef25ffb640 1 -- 172.21.15.22:0/1718035696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef200c0160 con 0x56138fcb84a0 2024-09-11T22:35:07.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.334+0000 7fef25ffb640 1 -- 172.21.15.22:0/1718035696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200056b0 con 0x56138fcb84a0 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 -- 172.21.15.22:0/1718035696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 msgr2=0x56138fccf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fef200f3010 tx=0x7fef200ba370 comp rx=0 tx=0).stop 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 -- 172.21.15.22:0/1718035696 shutdown_connections 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fcba600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcbeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 --2- 172.21.15.22:0/1718035696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fccf4b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 -- 172.21.15.22:0/1718035696 >> 172.21.15.22:0/1718035696 conn(0x56138fcb4a30 msgr2=0x56138fcb9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 -- 172.21.15.22:0/1718035696 shutdown_connections 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.335+0000 7fef389d6740 1 -- 172.21.15.22:0/1718035696 wait complete. 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 -- start start 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 Processor -- start 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fd3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef301ac470 con 0x56138fcb84a0 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef301ad8e0 con 0x56138fcb8dc0 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef301acb40 con 0x56138fcc3680 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef389d6740 10 client.0 _ll_register_callbacks cb 0x7fef200f5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:07.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42050/0 (socket says 172.21.15.22:42050) 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef2ffff640 1 -- 172.21.15.22:0/2806738834 learned_addr learned my addr 172.21.15.22:0/2806738834 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef27fff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.336+0000 7fef2ffff640 1 -- 172.21.15.22:0/2806738834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 msgr2=0x56138fd3cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef34b9a640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fd3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fd3cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef2ffff640 1 -- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 msgr2=0x56138fcc7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef2ffff640 1 -- 172.21.15.22:0/2806738834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138fcb8bf0 con 0x56138fcb84a0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef2ffff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fef200f5190 tx=0x7fef200b81c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe2ec7ef6a01b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2009f060 con 0x56138fcb84a0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fef20031bc0 con 0x56138fcb84a0 2024-09-11T22:35:07.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef200c0160 con 0x56138fcb84a0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fef20049070 con 0x56138fcb84a0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef389d6740 10 client.16422 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56138fcb8bf0 con 0x56138fcb84a0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef200c0160 con 0x56138fcb84a0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.337+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fef200bb3d0 con 0x56138fcb84a0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 10 client.16422 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 20 client.16422 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fd3e510 0x56138fd40900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 4 client.16422 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56138fc25d60 con 0x56138fd3e510 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef27fff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fd3e510 0x56138fd40900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef0f7fe640 10 client.16422 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:07.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef27fff640 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fd3e510 0x56138fd40900 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f558d21960d595 server_cookie=aab4a41ac833bb73 in_seq=0 out_seq=0 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef0f7fe640 1 -- 172.21.15.22:0/2806738834 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56138fc25d60 con 0x56138fd3e510 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef0f7fe640 10 client.16422 handle_command_reply: tid=0 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.338+0000 7fef389d6740 1 client.16422 shutdown 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 msgr2=0x56138fcc79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fef200f5190 tx=0x7fef200b81c0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 shutdown_connections 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56138fd3e510 0x56138fd40900 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56138fcc3680 0x56138fd3cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56138fcb8dc0 0x56138fcc7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 --2- 172.21.15.22:0/2806738834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56138fcb84a0 0x56138fcc79d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 >> 172.21.15.22:0/2806738834 conn(0x56138fcb4a30 msgr2=0x56138fcb3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef0f7fe640 0 client.16422 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:07.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 shutdown_connections 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 1 -- 172.21.15.22:0/2806738834 wait complete. 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef389d6740 20 client.16422 trim_cache size 0 max 16384 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:35:07.345 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 msgr2=0x7fef1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 0x7fef1c0a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef28005fd0 tx=0x7fef28009600 comp rx=0 tx=0).stop 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 msgr2=0x7fef301985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fef20006010 tx=0x7fef20004c00 comp rx=0 tx=0).stop 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 shutdown_connections 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fef1c0a2cf0 0x7fef1c0a51b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef30102ef0 0x7fef3019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef30102570 0x7fef30198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 --2- 172.21.15.22:0/1368270288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef30100e20 0x7fef301985e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:07.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.339+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 >> 172.21.15.22:0/1368270288 conn(0x7fef300fc7d0 msgr2=0x7fef3006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:07.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.340+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 shutdown_connections 2024-09-11T22:35:07.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:07.340+0000 7fef365fd640 1 -- 172.21.15.22:0/1368270288 wait complete. 2024-09-11T22:35:07.752 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:07 smithi022 ceph-mon[30966]: pgmap v186: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:07 smithi169 ceph-mon[35628]: pgmap v186: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:07 smithi045 ceph-mon[35556]: pgmap v186: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:08.187 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:35:08.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:35:08.454 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.953+0000 7f4c1aca5640 1 -- 172.21.15.22:0/3029338196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 msgr2=0x7f4c1410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.953+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/3029338196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1410ea90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009ca0 tx=0x7f4c0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 -- 172.21.15.22:0/3029338196 shutdown_connections 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/3029338196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1410ea90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/3029338196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14102790 0x7f4c141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/3029338196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14101de0 0x7f4c141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 -- 172.21.15.22:0/3029338196 >> 172.21.15.22:0/3029338196 conn(0x7f4c140fd8c0 msgr2=0x7f4c140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 -- 172.21.15.22:0/3029338196 shutdown_connections 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 -- 172.21.15.22:0/3029338196 wait complete. 2024-09-11T22:35:08.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 Processor -- start 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 -- start start 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14101de0 0x7f4c1419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14102790 0x7f4c1419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.954+0000 7f4c1aca5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c1aca5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141120e0 con 0x7f4c14106f10 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c1aca5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14111f60 con 0x7f4c14101de0 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c1aca5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14112260 con 0x7f4c14102790 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c18a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14101de0 0x7f4c1419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c13fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14102790 0x7f4c1419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42060/0 (socket says 172.21.15.22:42060) 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 -- 172.21.15.22:0/2775023226 learned_addr learned my addr 172.21.15.22:0/2775023226 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:08.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 -- 172.21.15.22:0/2775023226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14102790 msgr2=0x7f4c1419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14102790 0x7f4c1419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 -- 172.21.15.22:0/2775023226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14101de0 msgr2=0x7f4c1419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14101de0 0x7f4c1419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 -- 172.21.15.22:0/2775023226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1419f650 con 0x7f4c14106f10 2024-09-11T22:35:08.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.955+0000 7f4c19242640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c003f10 tx=0x7f4c0c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.956+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c031710 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.956+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4c0c0318b0 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.956+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1419f8e0 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.956+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c02fc50 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.956+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c141a7220 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.957+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c141021c0 con 0x7f4c14106f10 2024-09-11T22:35:08.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.959+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4c0c004b40 con 0x7f4c14106f10 2024-09-11T22:35:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.959+0000 7f4c11ffb640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 0x7f4c040a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.960+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f4c0c0f08e0 con 0x7f4c14106f10 2024-09-11T22:35:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.960+0000 7f4c18a41640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 0x7f4c040a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:08.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.960+0000 7f4c18a41640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 0x7f4c040a5230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800bbe0 tx=0x7f4c0800b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:08.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:08.963+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c0c0bd600 con 0x7f4c14106f10 2024-09-11T22:35:09.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.173+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c1419ba00 con 0x7f4c14106f10 2024-09-11T22:35:09.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.174+0000 7f4c11ffb640 1 -- 172.21.15.22:0/2775023226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f4c1419ba00 con 0x7f4c14106f10 2024-09-11T22:35:09.175 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:35:09.175 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:35:09.175 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 msgr2=0x7f4c040a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 0x7f4c040a5230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800bbe0 tx=0x7f4c0800b390 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 msgr2=0x7f4c1419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c003f10 tx=0x7f4c0c003f40 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 shutdown_connections 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4c040a2d70 0x7f4c040a5230 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c14106f10 0x7f4c1419ef70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c14102790 0x7f4c1419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 --2- 172.21.15.22:0/2775023226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c14101de0 0x7f4c1419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 >> 172.21.15.22:0/2775023226 conn(0x7f4c140fd8c0 msgr2=0x7f4c140fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 shutdown_connections 2024-09-11T22:35:09.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:09.176+0000 7f4c1aca5640 1 -- 172.21.15.22:0/2775023226 wait complete. 2024-09-11T22:35:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:09 smithi022 ceph-mon[30966]: pgmap v187: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:09 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2775023226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:09 smithi169 ceph-mon[35628]: pgmap v187: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:09 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2775023226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:09 smithi045 ceph-mon[35556]: pgmap v187: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T22:35:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:09 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2775023226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:09.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:35:10.220 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 -- 172.21.15.22:0/3398923673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48102ef0 msgr2=0x7fea4810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 --2- 172.21.15.22:0/3398923673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48102ef0 0x7fea4810da40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fea40009ca0 tx=0x7fea4002a950 comp rx=0 tx=0).stop 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 -- 172.21.15.22:0/3398923673 shutdown_connections 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 --2- 172.21.15.22:0/3398923673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48102ef0 0x7fea4810da40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 --2- 172.21.15.22:0/3398923673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102570 0x7fea481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 --2- 172.21.15.22:0/3398923673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48100e20 0x7fea48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 -- 172.21.15.22:0/3398923673 >> 172.21.15.22:0/3398923673 conn(0x7fea480fc7d0 msgr2=0x7fea480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 -- 172.21.15.22:0/3398923673 shutdown_connections 2024-09-11T22:35:10.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.696+0000 7fea50362640 1 -- 172.21.15.22:0/3398923673 wait complete. 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 Processor -- start 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 -- start start 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48102570 0x7fea48197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 0x7fea4819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea481110a0 con 0x7fea48100e20 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea48110f20 con 0x7fea48102ef0 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea50362640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea48111220 con 0x7fea48102570 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea4e0fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea4e0fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42068/0 (socket says 172.21.15.22:42068) 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.697+0000 7fea4e0fe640 1 -- 172.21.15.22:0/1641221915 learned_addr learned my addr 172.21.15.22:0/1641221915 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:10.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 0x7fea4819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48102570 0x7fea48197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 -- 172.21.15.22:0/1641221915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48102570 msgr2=0x7fea48197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48102570 0x7fea48197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 -- 172.21.15.22:0/1641221915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 msgr2=0x7fea4819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 0x7fea4819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 -- 172.21.15.22:0/1641221915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4819c2f0 con 0x7fea48100e20 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 0x7fea4819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea44007b50 tx=0x7fea4400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea3f7fe640 1 -- 172.21.15.22:0/1641221915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44007c40 con 0x7fea48100e20 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4819c5e0 con 0x7fea48100e20 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea3f7fe640 1 -- 172.21.15.22:0/1641221915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea44007de0 con 0x7fea48100e20 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea3f7fe640 1 -- 172.21.15.22:0/1641221915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440153f0 con 0x7fea48100e20 2024-09-11T22:35:10.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.698+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea48069f70 con 0x7fea48100e20 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.700+0000 7fea3f7fe640 1 -- 172.21.15.22:0/1641221915 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fea4400a440 con 0x7fea48100e20 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 Processor -- start 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 -- start start 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b83ce42f0 con 0x563b83d7fb40 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563b83c8bcf0 con 0x563b83d7e5d0 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea5273b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b83ce02b0 con 0x563b83d89370 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea4e8ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea4e8ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42080/0 (socket says 172.21.15.22:42080) 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.701+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1488891084 learned_addr learned my addr 172.21.15.22:0/1488891084 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:10.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea3f7fe640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 0x7fea340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1488891084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 msgr2=0x563b83d8b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d8b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1488891084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 msgr2=0x563b83d7ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d7ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1488891084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b83c703a0 con 0x563b83d7fb40 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d7ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 0x7fea340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea3f7fe640 1 -- 172.21.15.22:0/1641221915 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea440d0b60 con 0x7fea48100e20 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fea4002fb20 tx=0x7fea4002fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8af2b37a5ec090 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea3cdea640 1 -- 172.21.15.22:0/1488891084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40040040 con 0x563b83d7fb40 2024-09-11T22:35:10.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea3cdea640 1 -- 172.21.15.22:0/1488891084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea40004540 con 0x563b83d7fb40 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.702+0000 7fea3cdea640 1 -- 172.21.15.22:0/1488891084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40034070 con 0x563b83d7fb40 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 -- 172.21.15.22:0/1488891084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 msgr2=0x563b83d7e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 0x7fea340a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea4004b000 tx=0x7fea4004c000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fea4002fb20 tx=0x7fea4002fb50 comp rx=0 tx=0).stop 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 -- 172.21.15.22:0/1488891084 shutdown_connections 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d7ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 --2- 172.21.15.22:0/1488891084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d7e090 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 -- 172.21.15.22:0/1488891084 >> 172.21.15.22:0/1488891084 conn(0x563b83d47310 msgr2=0x563b83d7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 -- 172.21.15.22:0/1488891084 shutdown_connections 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.703+0000 7fea5273b740 1 -- 172.21.15.22:0/1488891084 wait complete. 2024-09-11T22:35:10.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 -- start start 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 Processor -- start 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d88d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d7fb40 0x563b83d86030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b83d8c070 con 0x563b83d89370 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563b83c9f060 con 0x563b83d7e5d0 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b83d8c1f0 con 0x563b83d7fb40 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea5273b740 10 client.0 _ll_register_callbacks cb 0x563b839f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea4e8ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea4e8ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42094/0 (socket says 172.21.15.22:42094) 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1943585343 learned_addr learned my addr 172.21.15.22:0/1943585343 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d88d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.704+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d7fb40 0x563b83d86030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1943585343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d7fb40 msgr2=0x563b83d86030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d7fb40 0x563b83d86030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 msgr2=0x563b83d88d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d88d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 -- 172.21.15.22:0/1943585343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b83a553c0 con 0x563b83d89370 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fea4002f920 tx=0x7fea400304e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75284e1d7da16d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40040050 con 0x563b83d89370 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea400046f0 con 0x563b83d89370 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea40004540 con 0x563b83d89370 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea40061050 con 0x563b83d89370 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea5273b740 10 client.16440 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563b83d8c070 con 0x563b83d89370 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.705+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea40004540 con 0x563b83d89370 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea4004f880 con 0x563b83d89370 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 10 client.16440 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 20 client.16440 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83d9b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 4 client.16440 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b83cf1860 con 0x563b83d98cc0 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83d9b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea31ffb640 10 client.16440 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.706+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83d9b0b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4417e5e3e98e730 server_cookie=542d8bb6a3aa2332 in_seq=0 out_seq=0 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea31ffb640 1 -- 172.21.15.22:0/1943585343 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b83cf1860 con 0x563b83d98cc0 2024-09-11T22:35:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea31ffb640 10 client.16440 handle_command_reply: tid=0 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 client.16440 shutdown 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 msgr2=0x563b83d86640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fea4002f920 tx=0x7fea400304e0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 shutdown_connections 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83d9b0b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d89370 0x563b83d86640 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d7fb40 0x563b83d86030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea31ffb640 0 client.16440 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.707+0000 7fea5273b740 1 --2- 172.21.15.22:0/1943585343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d88d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.708+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 >> 172.21.15.22:0/1943585343 conn(0x563b83d47310 msgr2=0x563b83d80930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.708+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 shutdown_connections 2024-09-11T22:35:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.708+0000 7fea5273b740 1 -- 172.21.15.22:0/1943585343 wait complete. 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.708+0000 7fea5273b740 20 client.16440 trim_cache size 0 max 16384 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 Processor -- start 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 -- start start 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 0x563b83d81120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea481a9450 con 0x563b83d7e5d0 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea481abcd0 con 0x563b83d7fb40 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea5273b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea481a9ac0 con 0x563b83d89370 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42104/0 (socket says 172.21.15.22:42104) 2024-09-11T22:35:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 -- 172.21.15.22:0/4293680155 learned_addr learned my addr 172.21.15.22:0/4293680155 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 0x563b83d81120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 -- 172.21.15.22:0/4293680155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 msgr2=0x563b83d81660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d81660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 -- 172.21.15.22:0/4293680155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 msgr2=0x563b83d81120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 0x563b83d81120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 -- 172.21.15.22:0/4293680155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b83d7b960 con 0x563b83d7e5d0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 0x563b83d81120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.721+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e920 tx=0x7fea44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ecc0cf9d1a94ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea33fff640 1 -- 172.21.15.22:0/4293680155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440a14b0 con 0x563b83d7e5d0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea33fff640 1 -- 172.21.15.22:0/4293680155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea440a5ce0 con 0x563b83d7e5d0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea33fff640 1 -- 172.21.15.22:0/4293680155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44099770 con 0x563b83d7e5d0 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 -- 172.21.15.22:0/4293680155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 msgr2=0x563b83d87fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fea4400e920 tx=0x7fea44000bc0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 -- 172.21.15.22:0/4293680155 shutdown_connections 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d81660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7fb40 0x563b83d81120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 --2- 172.21.15.22:0/4293680155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7e5d0 0x563b83d87fa0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 -- 172.21.15.22:0/4293680155 >> 172.21.15.22:0/4293680155 conn(0x563b83d47310 msgr2=0x563b83d87890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 -- 172.21.15.22:0/4293680155 shutdown_connections 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.722+0000 7fea5273b740 1 -- 172.21.15.22:0/4293680155 wait complete. 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 -- start start 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 Processor -- start 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d83000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d83a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea481aa190 con 0x563b83d7fb40 2024-09-11T22:35:10.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea481ab600 con 0x563b83d7e5d0 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea481aa860 con 0x563b83d89370 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea5273b740 10 client.0 _ll_register_callbacks cb 0x7fea4002f9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42120/0 (socket says 172.21.15.22:42120) 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 -- 172.21.15.22:0/3981287249 learned_addr learned my addr 172.21.15.22:0/3981287249 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d83000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d83a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 -- 172.21.15.22:0/3981287249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 msgr2=0x563b83d83a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d83a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 -- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 msgr2=0x563b83d83000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d83000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4d8fd640 1 -- 172.21.15.22:0/3981287249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b83e02840 con 0x563b83d7fb40 2024-09-11T22:35:10.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4e8ff640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d83a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.723+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d83000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea4d8fd640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x563b83d7f070 tx=0x7fea38003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3b36f26c3fcd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38005020 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fea380051c0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea440a5ce0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea380053c0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 10 client.16446 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563b83e03aa0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea440a5ce0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea38012be0 con 0x563b83d7fb40 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 10 client.16446 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:10.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 20 client.16446 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83e06270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 4 client.16446 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.724+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b83cebd70 con 0x563b83d98cc0 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83e06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea4e0fe640 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83e06270 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ef030883a59bc7 server_cookie=c4f9d8f2ca402822 in_seq=0 out_seq=0 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea31ffb640 10 client.16446 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea31ffb640 1 -- 172.21.15.22:0/3981287249 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b83cebd70 con 0x563b83d98cc0 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea31ffb640 10 client.16446 handle_command_reply: tid=0 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 client.16446 shutdown 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 msgr2=0x563b83d83540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x563b83d7f070 tx=0x7fea38003a80 comp rx=0 tx=0).stop 2024-09-11T22:35:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 shutdown_connections 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563b83d98cc0 0x563b83e06270 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b83d89370 0x563b83d83a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b83d7fb40 0x563b83d83540 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea31ffb640 0 client.16446 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 --2- 172.21.15.22:0/3981287249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b83d7e5d0 0x563b83d83000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.725+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 >> 172.21.15.22:0/3981287249 conn(0x563b83d47310 msgr2=0x563b83d79d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:35:10.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 shutdown_connections 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea5273b740 1 -- 172.21.15.22:0/3981287249 wait complete. 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea5273b740 20 client.16446 trim_cache size 0 max 16384 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 msgr2=0x7fea340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 0x7fea340a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea4004b000 tx=0x7fea4004c000 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 msgr2=0x7fea48197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea44007b50 tx=0x7fea4400e420 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 shutdown_connections 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea340a2cf0 0x7fea340a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea48102ef0 0x7fea4819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea48102570 0x7fea48197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 --2- 172.21.15.22:0/1641221915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea48100e20 0x7fea48197340 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 >> 172.21.15.22:0/1641221915 conn(0x7fea480fc7d0 msgr2=0x7fea481056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 shutdown_connections 2024-09-11T22:35:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:10.726+0000 7fea50362640 1 -- 172.21.15.22:0/1641221915 wait complete. 2024-09-11T22:35:11.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:11 smithi022 ceph-mon[30966]: pgmap v188: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:11.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:11 smithi169 ceph-mon[35628]: pgmap v188: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:11.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:11 smithi045 ceph-mon[35556]: pgmap v188: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:12.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:35:12.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:35:12.698 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.298+0000 7f603e03e640 1 -- 172.21.15.22:0/2772240966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 msgr2=0x7f603810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.298+0000 7f603e03e640 1 --2- 172.21.15.22:0/2772240966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f603810e610 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6030009ca0 tx=0x7f603002a950 comp rx=0 tx=0).stop 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 -- 172.21.15.22:0/2772240966 shutdown_connections 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 --2- 172.21.15.22:0/2772240966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f603810e610 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 --2- 172.21.15.22:0/2772240966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 0x7f603810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 --2- 172.21.15.22:0/2772240966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 0x7f6038103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 -- 172.21.15.22:0/2772240966 >> 172.21.15.22:0/2772240966 conn(0x7f60380fc7a0 msgr2=0x7f60380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 -- 172.21.15.22:0/2772240966 shutdown_connections 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 -- 172.21.15.22:0/2772240966 wait complete. 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 Processor -- start 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.299+0000 7f603e03e640 1 -- start start 2024-09-11T22:35:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 0x7f60381009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 0x7f6038100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6038112070 con 0x7f603810c170 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6038111ef0 con 0x7f6038103660 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f603e03e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60381121f0 con 0x7f6038102d40 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42146/0 (socket says 172.21.15.22:42146) 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 -- 172.21.15.22:0/1633476858 learned_addr learned my addr 172.21.15.22:0/1633476858 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f60377fe640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 0x7f60381009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6036ffd640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 0x7f6038100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 -- 172.21.15.22:0/1633476858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 msgr2=0x7f60381009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 0x7f60381009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 -- 172.21.15.22:0/1633476858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 msgr2=0x7f6038100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 0x7f6038100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 -- 172.21.15.22:0/1633476858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60381a6950 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.300+0000 7f6037fff640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6030005cc0 tx=0x7f603002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.301+0000 7f6034ff9640 1 -- 172.21.15.22:0/1633476858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030034040 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.301+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60381a6be0 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.301+0000 7f6034ff9640 1 -- 172.21.15.22:0/1633476858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6030030940 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.301+0000 7f6034ff9640 1 -- 172.21.15.22:0/1633476858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030045480 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.301+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381a7110 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.303+0000 7f6034ff9640 1 -- 172.21.15.22:0/1633476858 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6030037020 con 0x7f603810c170 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.303+0000 7f6040417740 1 Processor -- start 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.303+0000 7f6040417740 1 -- start start 2024-09-11T22:35:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.303+0000 7f6040417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d3b60 0x55f83a8d3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.303+0000 7f6040417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6040417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6040417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f83a839280 con 0x55f83a8ded40 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6040417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f83a7e0b10 con 0x55f83a8d3b60 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6040417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f83a835240 con 0x55f83a8d4480 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6034ff9640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 0x7f60200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42158/0 (socket says 172.21.15.22:42158) 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 -- 172.21.15.22:0/2212809104 learned_addr learned my addr 172.21.15.22:0/2212809104 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d3b60 0x55f83a8d3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6037fff640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 0x7f60200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f60377fe640 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6034ff9640 1 -- 172.21.15.22:0/1633476858 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f60300f0290 con 0x7f603810c170 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 -- 172.21.15.22:0/2212809104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 msgr2=0x55f83a8de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8de800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 -- 172.21.15.22:0/2212809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d3b60 msgr2=0x55f83a8d3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d3b60 0x55f83a8d3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 -- 172.21.15.22:0/2212809104 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83a7ed1f0 con 0x55f83a8ded40 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f602c012710 tx=0x7f602c00b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d813d4329b59fee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.304+0000 7f6037fff640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 0x7f60200a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60300b8d10 tx=0x7f60300878d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f601dffb640 1 -- 172.21.15.22:0/2212809104 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c012c90 con 0x55f83a8ded40 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f601dffb640 1 -- 172.21.15.22:0/2212809104 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f602c012e30 con 0x55f83a8ded40 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f601dffb640 1 -- 172.21.15.22:0/2212809104 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c0037f0 con 0x55f83a8ded40 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 -- 172.21.15.22:0/2212809104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 msgr2=0x55f83a8e1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f602c012710 tx=0x7f602c00b5a0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 -- 172.21.15.22:0/2212809104 shutdown_connections 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8ded40 0x55f83a8e1130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 --2- 172.21.15.22:0/2212809104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d3b60 0x55f83a8d3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 -- 172.21.15.22:0/2212809104 >> 172.21.15.22:0/2212809104 conn(0x55f83a8d00f0 msgr2=0x55f83a8d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 -- 172.21.15.22:0/2212809104 shutdown_connections 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.305+0000 7f6040417740 1 -- 172.21.15.22:0/2212809104 wait complete. 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 -- start start 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 Processor -- start 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8dc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f83a8e1910 con 0x55f83a8d3b60 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f83a7f3f10 con 0x55f83a8d4480 2024-09-11T22:35:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f83a8e1a90 con 0x55f83a8ded40 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6040417740 10 client.0 _ll_register_callbacks cb 0x55f83a7bca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42174/0 (socket says 172.21.15.22:42174) 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.306+0000 7f6036ffd640 1 -- 172.21.15.22:0/1555397940 learned_addr learned my addr 172.21.15.22:0/1555397940 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 -- 172.21.15.22:0/1555397940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 msgr2=0x55f83a8dc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f60377fe640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 -- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 msgr2=0x55f83a8dc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8dc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 -- 172.21.15.22:0/1555397940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83a5aa6a0 con 0x55f83a8d3b60 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f60377fe640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8dc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6036ffd640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f602c010e60 tx=0x7f602c00b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3dce22605b97d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c027060 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f602c004430 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f602c012e30 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f602c010970 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 10 client.16458 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f83a8ed520 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f602c012e30 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f602c004c70 con 0x55f83a8d3b60 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 10 client.16458 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.307+0000 7f6040417740 20 client.16458 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a8ee870 0x55f83a8f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f6040417740 4 client.16458 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f83a8467f0 con 0x55f83a8ee870 2024-09-11T22:35:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f60377fe640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a8ee870 0x55f83a8f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f60377fe640 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a8ee870 0x55f83a8f0c60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f05f7246553cc1 server_cookie=8f49d779349d927f in_seq=0 out_seq=0 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.308+0000 7f6016ffd640 10 client.16458 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6016ffd640 1 -- 172.21.15.22:0/1555397940 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f83a8467f0 con 0x55f83a8ee870 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6016ffd640 10 client.16458 handle_command_reply: tid=0 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 client.16458 shutdown 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 msgr2=0x55f83a8dbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f602c010e60 tx=0x7f602c00b3f0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 shutdown_connections 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a8ee870 0x55f83a8f0c60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8dc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8dc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 --2- 172.21.15.22:0/1555397940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8dbbd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6016ffd640 0 client.16458 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:13.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 >> 172.21.15.22:0/1555397940 conn(0x55f83a8d00f0 msgr2=0x55f83a8d5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 shutdown_connections 2024-09-11T22:35:13.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 1 -- 172.21.15.22:0/1555397940 wait complete. 2024-09-11T22:35:13.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.309+0000 7f6040417740 20 client.16458 trim_cache size 0 max 16384 2024-09-11T22:35:13.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.327+0000 7f6040417740 1 Processor -- start 2024-09-11T22:35:13.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.327+0000 7f6040417740 1 -- start start 2024-09-11T22:35:13.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8f6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60381ad9d0 con 0x55f83a8d3b60 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f60381b0250 con 0x55f83a8d4480 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6040417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60381ae040 con 0x55f83a8ded40 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42188/0 (socket says 172.21.15.22:42188) 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 -- 172.21.15.22:0/84047666 learned_addr learned my addr 172.21.15.22:0/84047666 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f60377fe640 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 -- 172.21.15.22:0/84047666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 msgr2=0x55f83a8f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 -- 172.21.15.22:0/84047666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 msgr2=0x55f83a8f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.328+0000 7f6036ffd640 1 -- 172.21.15.22:0/84047666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83a8cff20 con 0x55f83a8d3b60 2024-09-11T22:35:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.329+0000 7f6036ffd640 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b3c0 tx=0x7f602c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954d7aef4e507c6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.329+0000 7f601d7fa640 1 -- 172.21.15.22:0/84047666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c027040 con 0x55f83a8d3b60 2024-09-11T22:35:13.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.329+0000 7f601d7fa640 1 -- 172.21.15.22:0/84047666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f602c016070 con 0x55f83a8d3b60 2024-09-11T22:35:13.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.329+0000 7f601d7fa640 1 -- 172.21.15.22:0/84047666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c003b80 con 0x55f83a8d3b60 2024-09-11T22:35:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- 172.21.15.22:0/84047666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 msgr2=0x55f83a8daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f602c00b3c0 tx=0x7f602c003860 comp rx=0 tx=0).stop 2024-09-11T22:35:13.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- 172.21.15.22:0/84047666 shutdown_connections 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8ded40 0x55f83a8f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8d4480 0x55f83a8f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 --2- 172.21.15.22:0/84047666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8daa80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- 172.21.15.22:0/84047666 >> 172.21.15.22:0/84047666 conn(0x55f83a8d00f0 msgr2=0x55f83a8da370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- 172.21.15.22:0/84047666 shutdown_connections 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- 172.21.15.22:0/84047666 wait complete. 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 -- start start 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.330+0000 7f6040417740 1 Processor -- start 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8ded40 0x55f83a8e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60381ae710 con 0x55f83a8d3b60 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f60381afb80 con 0x55f83a8ded40 2024-09-11T22:35:13.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f60381aede0 con 0x55f83a8d4480 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6040417740 10 client.0 _ll_register_callbacks cb 0x7f602c00be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42194/0 (socket says 172.21.15.22:42194) 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 -- 172.21.15.22:0/2510829367 learned_addr learned my addr 172.21.15.22:0/2510829367 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f60377fe640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8ded40 0x55f83a8e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 -- 172.21.15.22:0/2510829367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 msgr2=0x55f83a8e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 -- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8ded40 msgr2=0x55f83a8e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8ded40 0x55f83a8e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 -- 172.21.15.22:0/2510829367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83a958500 con 0x55f83a8d3b60 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6036ffd640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f602c005d00 tx=0x7f602c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759ded8cd03792a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.331+0000 7f6016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:13.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c03d060 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f602c003d30 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f602c016070 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f602c027070 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 10 client.16464 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f83a9597e0 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f602c016070 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f602c034440 con 0x55f83a8d3b60 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 10 client.16464 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 20 client.16464 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a959d90 0x55f83a95c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 4 client.16464 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:35:13.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.332+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f83a840d00 con 0x55f83a959d90 2024-09-11T22:35:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.333+0000 7f60377fe640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a959d90 0x55f83a95c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.333+0000 7f60377fe640 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a959d90 0x55f83a95c180 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60111f5207fbae7d server_cookie=b8a3cd31315c6f65 in_seq=0 out_seq=0 2024-09-11T22:35:13.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.333+0000 7f6016ffd640 10 client.16464 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6016ffd640 1 -- 172.21.15.22:0/2510829367 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f83a840d00 con 0x55f83a959d90 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6016ffd640 10 client.16464 handle_command_reply: tid=0 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 client.16464 shutdown 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 msgr2=0x55f83a8e2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f602c005d00 tx=0x7f602c005670 comp rx=0 tx=0).stop 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 shutdown_connections 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f83a959d90 0x55f83a95c180 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f83a8ded40 0x55f83a8e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83a8d4480 0x55f83a8e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 --2- 172.21.15.22:0/2510829367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f83a8d3b60 0x55f83a8e2bd0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 >> 172.21.15.22:0/2510829367 conn(0x55f83a8d00f0 msgr2=0x55f83a8cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6016ffd640 0 client.16464 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 shutdown_connections 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 1 -- 172.21.15.22:0/2510829367 wait complete. 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.334+0000 7f6040417740 20 client.16464 trim_cache size 0 max 16384 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:35:13.339 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "7f0a9c22-f6af-497b-adb4-96a982d8090c", 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 msgr2=0x7f60200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 0x7f60200a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60300b8d10 tx=0x7f60300878d0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 msgr2=0x7f6038101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6030005cc0 tx=0x7f603002f790 comp rx=0 tx=0).stop 2024-09-11T22:35:13.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 shutdown_connections 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f60200a2cf0 0x7f60200a51b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f603810c170 0x7f6038101420 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6038103660 0x7f6038100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 --2- 172.21.15.22:0/1633476858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6038102d40 0x7f60381009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 >> 172.21.15.22:0/1633476858 conn(0x7f60380fc7a0 msgr2=0x7f60380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 shutdown_connections 2024-09-11T22:35:13.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:13.335+0000 7f603e03e640 1 -- 172.21.15.22:0/1633476858 wait complete. 2024-09-11T22:35:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:13 smithi022 ceph-mon[30966]: pgmap v189: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:13 smithi169 ceph-mon[35628]: pgmap v189: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:13 smithi045 ceph-mon[35556]: pgmap v189: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T22:35:14.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:35:14.309 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:14.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:35:14.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:14.721 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 -- 172.21.15.22:0/2018571235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8106f10 msgr2=0x7fecb810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 --2- 172.21.15.22:0/2018571235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8106f10 0x7fecb810ea90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009ca0 tx=0x7fecb002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 -- 172.21.15.22:0/2018571235 shutdown_connections 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 --2- 172.21.15.22:0/2018571235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8106f10 0x7fecb810ea90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 --2- 172.21.15.22:0/2018571235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8102790 0x7fecb81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 --2- 172.21.15.22:0/2018571235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8101de0 0x7fecb81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 -- 172.21.15.22:0/2018571235 >> 172.21.15.22:0/2018571235 conn(0x7fecb80fd8c0 msgr2=0x7fecb80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 -- 172.21.15.22:0/2018571235 shutdown_connections 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.804+0000 7fecc0080640 1 -- 172.21.15.22:0/2018571235 wait complete. 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 Processor -- start 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 -- start start 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8101de0 0x7fecb80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8106f10 0x7fecb8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8112090 con 0x7fecb8102790 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8111f10 con 0x7fecb8106f10 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecc0080640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecb8112210 con 0x7fecb8101de0 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34310/0 (socket says 172.21.15.22:34310) 2024-09-11T22:35:14.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.805+0000 7fecbd61b640 1 -- 172.21.15.22:0/2328178494 learned_addr learned my addr 172.21.15.22:0/2328178494 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbe61d640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8106f10 0x7fecb8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbde1c640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8101de0 0x7fecb80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 -- 172.21.15.22:0/2328178494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8101de0 msgr2=0x7fecb80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8101de0 0x7fecb80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 -- 172.21.15.22:0/2328178494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8106f10 msgr2=0x7fecb8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8106f10 0x7fecb8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 -- 172.21.15.22:0/2328178494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb81a6960 con 0x7fecb8102790 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9f0 tx=0x7feca800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecaeffd640 1 -- 172.21.15.22:0/2328178494 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca800cd80 con 0x7fecb8102790 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecaeffd640 1 -- 172.21.15.22:0/2328178494 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feca8005520 con 0x7fecb8102790 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecaeffd640 1 -- 172.21.15.22:0/2328178494 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8010690 con 0x7fecb8102790 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb81a6c50 con 0x7fecb8102790 2024-09-11T22:35:14.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.806+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb81a7190 con 0x7fecb8102790 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecaeffd640 1 -- 172.21.15.22:0/2328178494 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7feca80046c0 con 0x7fecb8102790 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 Processor -- start 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 -- start start 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875ba4a0 0x558f875ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558f875202e0 con 0x558f875c5680 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558f874c7ce0 con 0x558f875badc0 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.809+0000 7fecc2459740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558f8751c2a0 con 0x558f875ba4a0 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34312/0 (socket says 172.21.15.22:34312) 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbd61b640 1 -- 172.21.15.22:0/3545656173 learned_addr learned my addr 172.21.15.22:0/3545656173 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecaeffd640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 0x7feca40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbe61d640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875ba4a0 0x558f875ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbe61d640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 0x7feca40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecaeffd640 1 -- 172.21.15.22:0/2328178494 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7feca80cf810 con 0x7fecb8102790 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 -- 172.21.15.22:0/3545656173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875ba4a0 msgr2=0x558f875ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875ba4a0 0x558f875ba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 -- 172.21.15.22:0/3545656173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 msgr2=0x558f875c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 -- 172.21.15.22:0/3545656173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f874ac440 con 0x558f875badc0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbd61b640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbde1c640 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c5140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecb400dbe0 tx=0x7fecb400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26088590dad03794 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7fecbe61d640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 0x7feca40a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005fe0 tx=0x7fecb00095c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7feca3fff640 1 -- 172.21.15.22:0/3545656173 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4005020 con 0x558f875badc0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7feca3fff640 1 -- 172.21.15.22:0/3545656173 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecb40047a0 con 0x558f875badc0 2024-09-11T22:35:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.810+0000 7feca3fff640 1 -- 172.21.15.22:0/3545656173 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb40116a0 con 0x558f875badc0 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 -- 172.21.15.22:0/3545656173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 msgr2=0x558f875c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c5140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecb400dbe0 tx=0x7fecb400f730 comp rx=0 tx=0).stop 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 -- 172.21.15.22:0/3545656173 shutdown_connections 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875c5680 0x558f875c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c5140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 --2- 172.21.15.22:0/3545656173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875ba4a0 0x558f875ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 -- 172.21.15.22:0/3545656173 >> 172.21.15.22:0/3545656173 conn(0x558f875b6a30 msgr2=0x558f875b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 -- 172.21.15.22:0/3545656173 shutdown_connections 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.811+0000 7fecc2459740 1 -- 172.21.15.22:0/3545656173 wait complete. 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 -- start start 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 Processor -- start 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558f875c8250 con 0x558f875ba4a0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558f874db050 con 0x558f875badc0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558f875c83d0 con 0x558f875c5680 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecc2459740 10 client.0 _ll_register_callbacks cb 0x558f8751b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecbde1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecbde1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34316/0 (socket says 172.21.15.22:34316) 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecbde1c640 1 -- 172.21.15.22:0/4230654863 learned_addr learned my addr 172.21.15.22:0/4230654863 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.812+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbe61d640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 -- 172.21.15.22:0/4230654863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 msgr2=0x558f875c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 -- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 msgr2=0x558f875c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 -- 172.21.15.22:0/4230654863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f872913c0 con 0x558f875ba4a0 2024-09-11T22:35:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000c00 tx=0x7fecb40046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2327457f454c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7feca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb402b060 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fecb4004b60 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecb40047a0 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fecb4005000 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecc2459740 10 client.16476 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558f875d3ba0 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.813+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecb40047a0 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fecb401bca0 con 0x558f875ba4a0 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 10 client.16476 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 20 client.16476 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f875d5000 0x558f875d73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 4 client.16476 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f8752d850 con 0x558f875d5000 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f875d5000 0x558f875d73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7feca17fa640 10 client.16476 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.814+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f875d5000 0x558f875d73f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c086d45aa5c2fb5 server_cookie=dd7b31c0101556d2 in_seq=0 out_seq=0 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7feca17fa640 1 -- 172.21.15.22:0/4230654863 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f8752d850 con 0x558f875d5000 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7feca17fa640 10 client.16476 handle_command_reply: tid=0 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 client.16476 shutdown 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 msgr2=0x558f875c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000c00 tx=0x7fecb40046f0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 shutdown_connections 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f875d5000 0x558f875d73f0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875badc0 0x558f875c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7feca17fa640 0 client.16476 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 --2- 172.21.15.22:0/4230654863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875ba4a0 0x558f875c4f30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 >> 172.21.15.22:0/4230654863 conn(0x558f875b6a30 msgr2=0x558f875bc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 shutdown_connections 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.815+0000 7fecc2459740 1 -- 172.21.15.22:0/4230654863 wait complete. 2024-09-11T22:35:14.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.816+0000 7fecc2459740 20 client.16476 trim_cache size 0 max 16384 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 Processor -- start 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 -- start start 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875dcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ad9a0 con 0x558f875badc0 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81b0220 con 0x558f875ba4a0 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecc2459740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ae010 con 0x558f875c5680 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34320/0 (socket says 172.21.15.22:34320) 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 -- 172.21.15.22:0/2750053495 learned_addr learned my addr 172.21.15.22:0/2750053495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:14.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbde1c640 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 -- 172.21.15.22:0/2750053495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 msgr2=0x558f875dcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875dcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 -- 172.21.15.22:0/2750053495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 msgr2=0x558f875d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbd61b640 1 -- 172.21.15.22:0/2750053495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f875c52a0 con 0x558f875badc0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.833+0000 7fecbde1c640 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecbd61b640 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9c0 tx=0x7feca80d1c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8099ea2bf3005e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7feca37fe640 1 -- 172.21.15.22:0/2750053495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80d5020 con 0x558f875badc0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7feca37fe640 1 -- 172.21.15.22:0/2750053495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feca809c420 con 0x558f875badc0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7feca37fe640 1 -- 172.21.15.22:0/2750053495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca80a4500 con 0x558f875badc0 2024-09-11T22:35:14.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 -- 172.21.15.22:0/2750053495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 msgr2=0x558f875dca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9c0 tx=0x7feca80d1c60 comp rx=0 tx=0).stop 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 -- 172.21.15.22:0/2750053495 shutdown_connections 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875dcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875dca50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 --2- 172.21.15.22:0/2750053495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.834+0000 7fecc2459740 1 -- 172.21.15.22:0/2750053495 >> 172.21.15.22:0/2750053495 conn(0x558f875b6a30 msgr2=0x558f875c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- 172.21.15.22:0/2750053495 shutdown_connections 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- 172.21.15.22:0/2750053495 wait complete. 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- start start 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 Processor -- start 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81ae6e0 con 0x558f875badc0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81afb50 con 0x558f875ba4a0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fecb81aedb0 con 0x558f875c5680 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.835+0000 7fecc2459740 10 client.0 _ll_register_callbacks cb 0x7fecb4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbe61d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbd61b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34330/0 (socket says 172.21.15.22:34330) 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbd61b640 1 -- 172.21.15.22:0/4029186640 learned_addr learned my addr 172.21.15.22:0/4029186640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 -- 172.21.15.22:0/4029186640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 msgr2=0x558f875ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 -- 172.21.15.22:0/4029186640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 msgr2=0x558f875c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:14.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 -- 172.21.15.22:0/4029186640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f8763ec70 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecbde1c640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875c9680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e010 tx=0x7fecb400df50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7bffa483a9d671 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7feca17fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb402b070 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca809c420 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fecb4011d60 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fecb400d6c0 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.836+0000 7fecc2459740 10 client.26027 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x558f8763feb0 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feca809c420 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fecb4005410 con 0x558f875ba4a0 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 10 client.26027 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:14.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 10 client.26027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 20 client.26027 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f876405c0 0x558f876429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 4 client.26027 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f87527d60 con 0x558f876405c0 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.837+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f876405c0 0x558f876429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7feca17fa640 10 client.26027 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecbd61b640 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f876405c0 0x558f876429b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f40207f3950656 server_cookie=fbf06de55bc00967 in_seq=0 out_seq=0 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7feca17fa640 1 -- 172.21.15.22:0/4029186640 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558f87527d60 con 0x558f876405c0 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7feca17fa640 10 client.26027 handle_command_reply: tid=0 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 client.26027 shutdown 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 msgr2=0x558f875c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875c9680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e010 tx=0x7fecb400df50 comp rx=0 tx=0).stop 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 shutdown_connections 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x558f876405c0 0x558f876429b0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f875c5680 0x558f875ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7feca17fa640 0 client.26027 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558f875badc0 0x558f875c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 --2- 172.21.15.22:0/4029186640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558f875ba4a0 0x558f875c9680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 >> 172.21.15.22:0/4029186640 conn(0x558f875b6a30 msgr2=0x558f875b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 shutdown_connections 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 1 -- 172.21.15.22:0/4029186640 wait complete. 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.838+0000 7fecc2459740 20 client.26027 trim_cache size 0 max 16384 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:35:14.848 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 msgr2=0x7feca40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 0x7feca40a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005fe0 tx=0x7fecb00095c0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 msgr2=0x7fecb8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feca800e9f0 tx=0x7feca800edf0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 shutdown_connections 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7feca40a2d70 0x7feca40a5230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb8106f10 0x7fecb8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8102790 0x7fecb8074a30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 --2- 172.21.15.22:0/2328178494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fecb8101de0 0x7fecb80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 >> 172.21.15.22:0/2328178494 conn(0x7fecb80fd8c0 msgr2=0x7fecb80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 shutdown_connections 2024-09-11T22:35:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:14.839+0000 7fecc0080640 1 -- 172.21.15.22:0/2328178494 wait complete. 2024-09-11T22:35:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:35:15.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:15.101 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:15.102 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:35:15.102 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:15.102 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:15.102 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:35:15.574 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:35:15.574 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:35:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:16.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:16 smithi022 ceph-mon[30966]: pgmap v190: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:35:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 -- 172.21.15.22:0/646944597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 msgr2=0x7f113810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 --2- 172.21.15.22:0/646944597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f113810d130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1130009ca0 tx=0x7f113002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 -- 172.21.15.22:0/646944597 shutdown_connections 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 --2- 172.21.15.22:0/646944597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f113810d130 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 --2- 172.21.15.22:0/646944597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100e30 0x7f1138104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 --2- 172.21.15.22:0/646944597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100480 0x7f1138100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 -- 172.21.15.22:0/646944597 >> 172.21.15.22:0/646944597 conn(0x7f1138077210 msgr2=0x7f11380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 -- 172.21.15.22:0/646944597 shutdown_connections 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.276+0000 7f113ecb6640 1 -- 172.21.15.22:0/646944597 wait complete. 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 Processor -- start 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 -- start start 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100480 0x7f1138102c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100e30 0x7f1138103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:16.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1138110770 con 0x7f11381055b0 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f11381105f0 con 0x7f1138100e30 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ecb6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11381108f0 con 0x7f1138100480 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113d253640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113d253640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34360/0 (socket says 172.21.15.22:34360) 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113d253640 1 -- 172.21.15.22:0/2138104938 learned_addr learned my addr 172.21.15.22:0/2138104938 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f112ffff640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100e30 0x7f1138103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.277+0000 7f113ca52640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100480 0x7f1138102c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 -- 172.21.15.22:0/2138104938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100480 msgr2=0x7f1138102c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100480 0x7f1138102c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 -- 172.21.15.22:0/2138104938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100e30 msgr2=0x7f1138103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100e30 0x7f1138103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 -- 172.21.15.22:0/2138104938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11381a6a00 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113d253640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1130009dc0 tx=0x7f1130031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113002fba0 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381a6c90 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f113002fd40 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130046910 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.278+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381a71d0 con 0x7f11381055b0 2024-09-11T22:35:16.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.279+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1138100860 con 0x7f11381055b0 2024-09-11T22:35:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.281+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1130030c50 con 0x7f11381055b0 2024-09-11T22:35:16.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.282+0000 7f112dffb640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 0x7f11200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.282+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f11300f0ac0 con 0x7f11381055b0 2024-09-11T22:35:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.282+0000 7f113ca52640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 0x7f11200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:16.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.283+0000 7f113ca52640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 0x7f11200a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f113400abe0 tx=0x7f113400a2d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.285+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11300bd840 con 0x7f11381055b0 2024-09-11T22:35:16.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.497+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11381a7460 con 0x7f11381055b0 2024-09-11T22:35:16.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.498+0000 7f112dffb640 1 -- 172.21.15.22:0/2138104938 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f11300bd140 con 0x7f11381055b0 2024-09-11T22:35:16.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:35:16.499 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:35:16.499 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:35:16.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 msgr2=0x7f11200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 0x7f11200a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f113400abe0 tx=0x7f113400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 msgr2=0x7f11381036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1130009dc0 tx=0x7f1130031b10 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 shutdown_connections 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f11200a2cf0 0x7f11200a51b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11381055b0 0x7f11381036a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1138100e30 0x7f1138103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 --2- 172.21.15.22:0/2138104938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1138100480 0x7f1138102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 >> 172.21.15.22:0/2138104938 conn(0x7f1138077210 msgr2=0x7f1138110f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 shutdown_connections 2024-09-11T22:35:16.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:16.500+0000 7f113ecb6640 1 -- 172.21.15.22:0/2138104938 wait complete. 2024-09-11T22:35:16.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:16 smithi169 ceph-mon[35628]: pgmap v190: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:35:16.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:16 smithi045 ceph-mon[35556]: pgmap v190: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-11T22:35:17.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:35:17.458 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:17.580 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:17 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2138104938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:17.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:17 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2138104938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:17.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:17 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2138104938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 -- 172.21.15.22:0/3238041748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc101de0 msgr2=0x7ff2dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 --2- 172.21.15.22:0/3238041748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1021c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009900 tx=0x7ff2cc02a410 comp rx=0 tx=0).stop 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 -- 172.21.15.22:0/3238041748 shutdown_connections 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 --2- 172.21.15.22:0/3238041748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 0x7ff2dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 --2- 172.21.15.22:0/3238041748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc102790 0x7ff2dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 --2- 172.21.15.22:0/3238041748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1021c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 -- 172.21.15.22:0/3238041748 >> 172.21.15.22:0/3238041748 conn(0x7ff2dc0fd8c0 msgr2=0x7ff2dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 -- 172.21.15.22:0/3238041748 shutdown_connections 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.895+0000 7ff2e164e640 1 -- 172.21.15.22:0/3238041748 wait complete. 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 Processor -- start 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 -- start start 2024-09-11T22:35:17.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 0x7ff2dc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1120d0 con 0x7ff2dc102790 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc111f50 con 0x7ff2dc101de0 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2e164e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc112250 con 0x7ff2dc106f10 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34376/0 (socket says 172.21.15.22:34376) 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.896+0000 7ff2da7fc640 1 -- 172.21.15.22:0/4271927668 learned_addr learned my addr 172.21.15.22:0/4271927668 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2daffd640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 0x7ff2dc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 -- 172.21.15.22:0/4271927668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 msgr2=0x7ff2dc19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 0x7ff2dc19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 -- 172.21.15.22:0/4271927668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 msgr2=0x7ff2dc1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 -- 172.21.15.22:0/4271927668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc19aed0 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2daffd640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000eab0 tx=0x7ff2d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2c3fff640 1 -- 172.21.15.22:0/4271927668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000ce40 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2c3fff640 1 -- 172.21.15.22:0/4271927668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2d0011970 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc19b1c0 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2c3fff640 1 -- 172.21.15.22:0/4271927668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0010bb0 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.897+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1a7510 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.899+0000 7ff2c3fff640 1 -- 172.21.15.22:0/4271927668 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff2d0010d50 con 0x7ff2dc102790 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.900+0000 7ff2e3a27740 1 Processor -- start 2024-09-11T22:35:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.900+0000 7ff2c3fff640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 0x7ff2c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.900+0000 7ff2e3a27740 1 -- start start 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 0x7ff2c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2c3fff640 1 -- 172.21.15.22:0/4271927668 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff2d00cfb70 con 0x7ff2dc102790 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db2651a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db265e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561db25b72f0 con 0x561db2652b40 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561db255ecf0 con 0x561db265c370 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561db25b32b0 con 0x561db26515d0 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34380/0 (socket says 172.21.15.22:34380) 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 -- 172.21.15.22:0/2546329997 learned_addr learned my addr 172.21.15.22:0/2546329997 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db2651a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db265e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 0x7ff2c40a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b880 tx=0x7ff2d4008040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 -- 172.21.15.22:0/2546329997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 msgr2=0x561db2651a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db2651a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 -- 172.21.15.22:0/2546329997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 msgr2=0x561db265e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db265e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 -- 172.21.15.22:0/2546329997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db25433a0 con 0x561db2652b40 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db2651a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db265e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.901+0000 7ff2daffd640 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc033000 tx=0x7ff2cc032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcb06e20d375a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2c17fa640 1 -- 172.21.15.22:0/2546329997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc03f070 con 0x561db2652b40 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2c17fa640 1 -- 172.21.15.22:0/2546329997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc031840 con 0x561db2652b40 2024-09-11T22:35:17.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2c17fa640 1 -- 172.21.15.22:0/2546329997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc035070 con 0x561db2652b40 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 -- 172.21.15.22:0/2546329997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 msgr2=0x561db2651090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc033000 tx=0x7ff2cc032d30 comp rx=0 tx=0).stop 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 -- 172.21.15.22:0/2546329997 shutdown_connections 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db265e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db2651a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/2546329997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2651090 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 -- 172.21.15.22:0/2546329997 >> 172.21.15.22:0/2546329997 conn(0x561db261a310 msgr2=0x561db264dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.902+0000 7ff2e3a27740 1 -- 172.21.15.22:0/2546329997 shutdown_connections 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 -- 172.21.15.22:0/2546329997 wait complete. 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 -- start start 2024-09-11T22:35:17.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 Processor -- start 2024-09-11T22:35:17.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db265bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db2659580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561db265f010 con 0x561db2652b40 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561db2572060 con 0x561db265c370 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561db265f190 con 0x561db26515d0 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2e3a27740 10 client.0 _ll_register_callbacks cb 0x561db22c58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.903+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34392/0 (socket says 172.21.15.22:34392) 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 -- 172.21.15.22:0/3288327960 learned_addr learned my addr 172.21.15.22:0/3288327960 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db2659580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2daffd640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db265bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 -- 172.21.15.22:0/3288327960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 msgr2=0x561db265bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db265bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 -- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 msgr2=0x561db2659580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db2659580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 -- 172.21.15.22:0/3288327960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db23283c0 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009bd80 tx=0x7ff2d009baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1faa27813a24d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2beff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a0430 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff2d00986f0 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.904+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2cc031840 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff2d00a4cf0 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 10 client.16500 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561db266aac0 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc031840 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff2d000f040 con 0x561db2652b40 2024-09-11T22:35:17.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 10 client.16500 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 20 client.16500 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db266be60 0x561db266e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 4 client.16500 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561db25c4860 con 0x561db266be60 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.905+0000 7ff2daffd640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db266be60 0x561db266e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.906+0000 7ff2daffd640 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db266be60 0x561db266e2f0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=997126c3c18de998 server_cookie=8a01e8935e930e3e in_seq=0 out_seq=0 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.906+0000 7ff2beff5640 10 client.16500 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2beff5640 1 -- 172.21.15.22:0/3288327960 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561db25c4860 con 0x561db266be60 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2beff5640 10 client.16500 handle_command_reply: tid=0 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 client.16500 shutdown 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 msgr2=0x561db2658fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009bd80 tx=0x7ff2d009baa0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 shutdown_connections 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db266be60 0x561db266e2f0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db265c370 0x561db2659580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2658fe0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2beff5640 0 client.16500 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3288327960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db265bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 >> 172.21.15.22:0/3288327960 conn(0x561db261a310 msgr2=0x561db2653960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 shutdown_connections 2024-09-11T22:35:17.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3288327960 wait complete. 2024-09-11T22:35:17.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.907+0000 7ff2e3a27740 20 client.16500 trim_cache size 0 max 16384 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 Processor -- start 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 -- start start 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db26682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db2652b40 0x561db2650d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1ad9b0 con 0x561db265c370 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1b0230 con 0x561db2652b40 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1ae020 con 0x561db26515d0 2024-09-11T22:35:17.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.920+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34400/0 (socket says 172.21.15.22:34400) 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 -- 172.21.15.22:0/3455411098 learned_addr learned my addr 172.21.15.22:0/3455411098 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db2652b40 0x561db2650d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2daffd640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db26682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 -- 172.21.15.22:0/3455411098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 msgr2=0x561db26682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db26682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 -- 172.21.15.22:0/3455411098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db2652b40 msgr2=0x561db2650d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db2652b40 0x561db2650d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 -- 172.21.15.22:0/3455411098 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db265ead0 con 0x561db265c370 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2daffd640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db26682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d9f0 tx=0x7ff2d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ea35750f10a7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2c0ff9640 1 -- 172.21.15.22:0/3455411098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40149b0 con 0x561db265c370 2024-09-11T22:35:17.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2c0ff9640 1 -- 172.21.15.22:0/3455411098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2d4026070 con 0x561db265c370 2024-09-11T22:35:17.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.921+0000 7ff2c0ff9640 1 -- 172.21.15.22:0/3455411098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4021e50 con 0x561db265c370 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3455411098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 msgr2=0x561db2673bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d9f0 tx=0x7ff2d4012000 comp rx=0 tx=0).stop 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3455411098 shutdown_connections 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db265c370 0x561db2673bc0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db2652b40 0x561db2650d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/3455411098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db26515d0 0x561db26682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3455411098 >> 172.21.15.22:0/3455411098 conn(0x561db261a310 msgr2=0x561db265b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3455411098 shutdown_connections 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- 172.21.15.22:0/3455411098 wait complete. 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 -- start start 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.922+0000 7ff2e3a27740 1 Processor -- start 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 0x561db2660340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db265c370 0x561db2660dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1ae6f0 con 0x561db2652b40 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1afb60 con 0x561db26515d0 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc1aedc0 con 0x561db265c370 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2e3a27740 10 client.0 _ll_register_callbacks cb 0x7ff2d0011ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34408/0 (socket says 172.21.15.22:34408) 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 -- 172.21.15.22:0/1446848588 learned_addr learned my addr 172.21.15.22:0/1446848588 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2daffd640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 0x561db2660340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2db7fe640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db265c370 0x561db2660dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 -- 172.21.15.22:0/1446848588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db265c370 msgr2=0x561db2660dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db265c370 0x561db2660dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 -- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 msgr2=0x561db2660340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 0x561db2660340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 -- 172.21.15.22:0/1446848588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db26d5d90 con 0x561db2652b40 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2daffd640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 0x561db2660340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2da7fc640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00984e0 tx=0x7ff2d0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d742bff5618c5cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.923+0000 7ff2beff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:17.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a0430 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff2d009b4d0 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d4026070 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff2d007e030 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 10 client.16506 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561db26d7030 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2d4026070 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff2d0081070 con 0x561db2652b40 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 10 client.16506 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 20 client.16506 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db26d75f0 0x561db26d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 4 client.16506 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:35:17.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.924+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561db25bed70 con 0x561db26d75f0 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2daffd640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db26d75f0 0x561db26d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2beff5640 10 client.16506 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2daffd640 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db26d75f0 0x561db26d9a10 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b226e9836915f4 server_cookie=101c1387861c4dd8 in_seq=0 out_seq=0 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2beff5640 1 -- 172.21.15.22:0/1446848588 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561db25bed70 con 0x561db26d75f0 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2beff5640 10 client.16506 handle_command_reply: tid=0 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 client.16506 shutdown 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 msgr2=0x561db2660880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00984e0 tx=0x7ff2d0011dd0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 shutdown_connections 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x561db26d75f0 0x561db26d9a10 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561db265c370 0x561db2660dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561db2652b40 0x561db2660880 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 --2- 172.21.15.22:0/1446848588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561db26515d0 0x561db2660340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 >> 172.21.15.22:0/1446848588 conn(0x561db261a310 msgr2=0x561db2657780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2beff5640 0 client.16506 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 shutdown_connections 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.925+0000 7ff2e3a27740 1 -- 172.21.15.22:0/1446848588 wait complete. 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e3a27740 20 client.16506 trim_cache size 0 max 16384 2024-09-11T22:35:17.932 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 msgr2=0x7ff2c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 0x7ff2c40a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b880 tx=0x7ff2d4008040 comp rx=0 tx=0).stop 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 msgr2=0x7ff2dc1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000eab0 tx=0x7ff2d000ef70 comp rx=0 tx=0).stop 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 shutdown_connections 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff2c40a2cf0 0x7ff2c40a51b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2dc106f10 0x7ff2dc19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2dc102790 0x7ff2dc1a0ad0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 --2- 172.21.15.22:0/4271927668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2dc101de0 0x7ff2dc1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 >> 172.21.15.22:0/4271927668 conn(0x7ff2dc0fd8c0 msgr2=0x7ff2dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 shutdown_connections 2024-09-11T22:35:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:17.926+0000 7ff2e164e640 1 -- 172.21.15.22:0/4271927668 wait complete. 2024-09-11T22:35:18.563 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:18 smithi045 ceph-mon[35556]: pgmap v191: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:35:18.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:18 smithi022 ceph-mon[30966]: pgmap v191: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:35:18.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:18 smithi169 ceph-mon[35628]: pgmap v191: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-11T22:35:19.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:35:19.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:35:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:20.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:20 smithi022 ceph-mon[30966]: pgmap v192: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-11T22:35:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1223681212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81082a0 msgr2=0x7fe8c810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1223681212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81082a0 0x7fe8c810ec40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009930 tx=0x7fe8c002a420 comp rx=0 tx=0).stop 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1223681212 shutdown_connections 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1223681212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81082a0 0x7fe8c810ec40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1223681212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81036e0 0x7fe8c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1223681212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 0x7fe8c8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1223681212 >> 172.21.15.22:0/1223681212 conn(0x7fe8c80fc7d0 msgr2=0x7fe8c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1223681212 shutdown_connections 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1223681212 wait complete. 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.381+0000 7fe8cdf53640 1 Processor -- start 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 -- start start 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 0x7fe8c8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 0x7fe8c819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81121e0 con 0x7fe8c81036e0 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8112060 con 0x7fe8c81082a0 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8cdf53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c8112360 con 0x7fe8c8102d30 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34426/0 (socket says 172.21.15.22:34426) 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/1983494991 learned_addr learned my addr 172.21.15.22:0/1983494991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 0x7fe8c819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 0x7fe8c8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/1983494991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 msgr2=0x7fe8c8198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 0x7fe8c8198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/1983494991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 msgr2=0x7fe8c819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 0x7fe8c819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/1983494991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c819d5d0 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.382+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 0x7fe8c819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00d740 tx=0x7fe8bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8c4ff9640 1 -- 172.21.15.22:0/1983494991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c819d8c0 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8c4ff9640 1 -- 172.21.15.22:0/1983494991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8bc00de50 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8c4ff9640 1 -- 172.21.15.22:0/1983494991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00f740 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.383+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c81a51a0 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.385+0000 7fe8c4ff9640 1 -- 172.21.15.22:0/1983494991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe8bc01a070 con 0x7fe8c81036e0 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.385+0000 7fe8d032c740 1 Processor -- start 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.385+0000 7fe8d032c740 1 -- start start 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.385+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eedbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.385+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8d032c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56248ee41280 con 0x56248eee6d40 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8d032c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56248ede8b10 con 0x56248eedc480 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8d032c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56248ee3d240 con 0x56248eedbb60 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eedbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:58474/0 (socket says 172.21.15.22:58474) 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c77fe640 1 -- 172.21.15.22:0/574744480 learned_addr learned my addr 172.21.15.22:0/574744480 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c4ff9640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 0x7fe8b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34434/0 (socket says 172.21.15.22:34434) 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 0x7fe8b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/574744480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 msgr2=0x56248eedbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eedbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/574744480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 msgr2=0x56248eee6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c4ff9640 1 -- 172.21.15.22:0/1983494991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe8bc0cee60 con 0x7fe8c81036e0 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/574744480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248edf51f0 con 0x56248eee6d40 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.386+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cc600 tx=0x7fe8bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816b9a5579166bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8adffb640 1 -- 172.21.15.22:0/574744480 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc021030 con 0x56248eee6d40 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 0x7fe8b00a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0005c40 tx=0x7fe8c002a420 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8adffb640 1 -- 172.21.15.22:0/574744480 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8bc0a4040 con 0x56248eee6d40 2024-09-11T22:35:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8adffb640 1 -- 172.21.15.22:0/574744480 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc05fc60 con 0x56248eee6d40 2024-09-11T22:35:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 -- 172.21.15.22:0/574744480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 msgr2=0x56248eee9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cc600 tx=0x7fe8bc000bc0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 -- 172.21.15.22:0/574744480 shutdown_connections 2024-09-11T22:35:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eee9130 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 --2- 172.21.15.22:0/574744480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eedbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 -- 172.21.15.22:0/574744480 >> 172.21.15.22:0/574744480 conn(0x56248eed80f0 msgr2=0x56248eed84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 -- 172.21.15.22:0/574744480 shutdown_connections 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.387+0000 7fe8d032c740 1 -- 172.21.15.22:0/574744480 wait complete. 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 -- start start 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 Processor -- start 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eee6d40 0x56248eee4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56248eee98b0 con 0x56248eedc480 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56248edfbf10 con 0x56248eee6d40 2024-09-11T22:35:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56248eee9a30 con 0x56248eedbb60 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8d032c740 10 client.0 _ll_register_callbacks cb 0x56248edc4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.388+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34444/0 (socket says 172.21.15.22:34444) 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/3652825824 learned_addr learned my addr 172.21.15.22:0/3652825824 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eee6d40 0x56248eee4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/3652825824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 msgr2=0x56248eee3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eee6d40 msgr2=0x56248eee4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eee6d40 0x56248eee4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 -- 172.21.15.22:0/3652825824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248ebb26a0 con 0x56248eedc480 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cc6b0 tx=0x7fe8bc09b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fe163254d0577d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc021070 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8bc0a4040 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe8bc0cc880 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe8bc0b3030 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8d032c740 10 client.16518 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.389+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56248eef5530 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8bc0a4040 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe8bc0a8040 con 0x56248eedc480 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 10 client.16518 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 20 client.16518 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248eef6880 0x56248eef8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 4 client.16518 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56248ee4e7f0 con 0x56248eef6880 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.390+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248eef6880 0x56248eef8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.391+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248eef6880 0x56248eef8c70 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef0790a7f74c484 server_cookie=87501ace9ae1c188 in_seq=0 out_seq=0 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.391+0000 7fe8a6ffd640 10 client.16518 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.391+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3652825824 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56248ee4e7f0 con 0x56248eef6880 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.391+0000 7fe8a6ffd640 10 client.16518 handle_command_reply: tid=0 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.391+0000 7fe8d032c740 1 client.16518 shutdown 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 msgr2=0x56248eee41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cc6b0 tx=0x7fe8bc09b2b0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 shutdown_connections 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248eef6880 0x56248eef8c70 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eee6d40 0x56248eee4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eedc480 0x56248eee41e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8a6ffd640 0 client.16518 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3652825824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 >> 172.21.15.22:0/3652825824 conn(0x56248eed80f0 msgr2=0x56248eedde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 shutdown_connections 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 1 -- 172.21.15.22:0/3652825824 wait complete. 2024-09-11T22:35:20.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.392+0000 7fe8d032c740 20 client.16518 trim_cache size 0 max 16384 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.409+0000 7fe8d032c740 1 Processor -- start 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.409+0000 7fe8d032c740 1 -- start start 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ab840 con 0x56248eee6d40 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ae0c0 con 0x56248eedc480 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8d032c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81abeb0 con 0x56248eedbb60 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34452/0 (socket says 172.21.15.22:34452) 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 -- 172.21.15.22:0/332102103 learned_addr learned my addr 172.21.15.22:0/332102103 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 -- 172.21.15.22:0/332102103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 msgr2=0x56248eee4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 -- 172.21.15.22:0/332102103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 msgr2=0x56248eee2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 -- 172.21.15.22:0/332102103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248eedc2b0 con 0x56248eee6d40 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009230 tx=0x7fe8c0005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa05c0b817643da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8ad7fa640 1 -- 172.21.15.22:0/332102103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0046040 con 0x56248eee6d40 2024-09-11T22:35:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8ad7fa640 1 -- 172.21.15.22:0/332102103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c0050070 con 0x56248eee6d40 2024-09-11T22:35:20.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.410+0000 7fe8ad7fa640 1 -- 172.21.15.22:0/332102103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0035070 con 0x56248eee6d40 2024-09-11T22:35:20.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- 172.21.15.22:0/332102103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 msgr2=0x56248eefe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009230 tx=0x7fe8c0005b70 comp rx=0 tx=0).stop 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- 172.21.15.22:0/332102103 shutdown_connections 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eefe270 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eee2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 --2- 172.21.15.22:0/332102103 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eee4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- 172.21.15.22:0/332102103 >> 172.21.15.22:0/332102103 conn(0x56248eed80f0 msgr2=0x56248eee2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- 172.21.15.22:0/332102103 shutdown_connections 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- 172.21.15.22:0/332102103 wait complete. 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.411+0000 7fe8d032c740 1 -- start start 2024-09-11T22:35:20.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 Processor -- start 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eeeabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eeeb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ac580 con 0x56248eee6d40 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81ad9f0 con 0x56248eedc480 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c81acc50 con 0x56248eedbb60 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8d032c740 10 client.0 _ll_register_callbacks cb 0x7fe8b8009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:20.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34468/0 (socket says 172.21.15.22:34468) 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 -- 172.21.15.22:0/3829731690 learned_addr learned my addr 172.21.15.22:0/3829731690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c6ffd640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eeeb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eeeabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 -- 172.21.15.22:0/3829731690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 msgr2=0x56248eeeabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eeeabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 -- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 msgr2=0x56248eeeb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eeeb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.412+0000 7fe8c7fff640 1 -- 172.21.15.22:0/3829731690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248ef60440 con 0x56248eee6d40 2024-09-11T22:35:20.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8c7fff640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0031a10 tx=0x7fe8c0004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1cfe322a76c9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004fb0 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe8c0005150 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c0050070 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe8c0005350 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 10 client.16524 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56248ef61720 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c0050070 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe8c003a480 con 0x56248eee6d40 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 10 client.16524 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:20.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 20 client.16524 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.413+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248ef61e10 0x56248ef64230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.414+0000 7fe8d032c740 4 client.16524 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.414+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56248ee48d00 con 0x56248ef61e10 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.414+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248ef61e10 0x56248ef64230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.414+0000 7fe8c77fe640 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248ef61e10 0x56248ef64230 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ad7185f33a8026b server_cookie=9748135b1cbf9006 in_seq=0 out_seq=0 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.414+0000 7fe8a6ffd640 10 client.16524 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:20.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8a6ffd640 1 -- 172.21.15.22:0/3829731690 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56248ee48d00 con 0x56248ef61e10 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8a6ffd640 10 client.16524 handle_command_reply: tid=0 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 client.16524 shutdown 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 msgr2=0x56248eeeb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0031a10 tx=0x7fe8c0004b50 comp rx=0 tx=0).stop 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 shutdown_connections 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56248ef61e10 0x56248ef64230 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56248eee6d40 0x56248eeeb630 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56248eedc480 0x56248eeeb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 --2- 172.21.15.22:0/3829731690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56248eedbb60 0x56248eeeabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8a6ffd640 0 client.16524 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 >> 172.21.15.22:0/3829731690 conn(0x56248eed80f0 msgr2=0x56248eedddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 shutdown_connections 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.415+0000 7fe8d032c740 1 -- 172.21.15.22:0/3829731690 wait complete. 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8d032c740 20 client.16524 trim_cache size 0 max 16384 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "0e036884-0383-4263-8034-d18ca1695216", 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:35:20.423 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:20.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 msgr2=0x7fe8b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 0x7fe8b00a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0005c40 tx=0x7fe8c002a420 comp rx=0 tx=0).stop 2024-09-11T22:35:20.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 msgr2=0x7fe8c8198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:20.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00d740 tx=0x7fe8bc00dc00 comp rx=0 tx=0).stop 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 shutdown_connections 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe8b00a2cf0 0x7fe8b00a51b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c81082a0 0x7fe8c819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8c81036e0 0x7fe8c8198b60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 --2- 172.21.15.22:0/1983494991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe8c8102d30 0x7fe8c8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 >> 172.21.15.22:0/1983494991 conn(0x7fe8c80fc7d0 msgr2=0x7fe8c8105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 shutdown_connections 2024-09-11T22:35:20.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:20.416+0000 7fe8cdf53640 1 -- 172.21.15.22:0/1983494991 wait complete. 2024-09-11T22:35:20.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:20 smithi169 ceph-mon[35628]: pgmap v192: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-11T22:35:20.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:20 smithi045 ceph-mon[35556]: pgmap v192: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-11T22:35:21.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:35:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:21 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:35:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:21 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:21 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:35:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:21 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:21.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:21 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:35:21.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:21 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:21 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:35:21.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:21 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:21 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:35:21.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:21 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:21 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:35:21.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:21 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 -- 172.21.15.22:0/2918917379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01036a0 msgr2=0x7ff1f010bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 --2- 172.21.15.22:0/2918917379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01036a0 0x7ff1f010bb90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e402a480 comp rx=0 tx=0).stop 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 -- 172.21.15.22:0/2918917379 shutdown_connections 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 --2- 172.21.15.22:0/2918917379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 0x7ff1f010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 --2- 172.21.15.22:0/2918917379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f01036a0 0x7ff1f010bb90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 --2- 172.21.15.22:0/2918917379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f0102d80 0x7ff1f0103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 -- 172.21.15.22:0/2918917379 >> 172.21.15.22:0/2918917379 conn(0x7ff1f00fc780 msgr2=0x7ff1f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 -- 172.21.15.22:0/2918917379 shutdown_connections 2024-09-11T22:35:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.895+0000 7ff1f8233640 1 -- 172.21.15.22:0/2918917379 wait complete. 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 Processor -- start 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 -- start start 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 0x7ff1f01a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 0x7ff1f019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01120e0 con 0x7ff1f0102d80 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0111f60 con 0x7ff1f01036a0 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f8233640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0112260 con 0x7ff1f010c160 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34478/0 (socket says 172.21.15.22:34478) 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1387055421 learned_addr learned my addr 172.21.15.22:0/1387055421 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 0x7ff1f01a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 0x7ff1f019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1387055421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 msgr2=0x7ff1f019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 0x7ff1f019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1387055421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 msgr2=0x7ff1f01a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 0x7ff1f01a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1387055421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f019acf0 con 0x7ff1f0102d80 2024-09-11T22:35:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.896+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 0x7ff1f01a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b4a0 tx=0x7ff1ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1387055421 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec014070 con 0x7ff1f0102d80 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f019afe0 con 0x7ff1f0102d80 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1387055421 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1ec010b10 con 0x7ff1f0102d80 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1387055421 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec017d60 con 0x7ff1f0102d80 2024-09-11T22:35:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.897+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01a72d0 con 0x7ff1f0102d80 2024-09-11T22:35:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.899+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1387055421 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff1ec017070 con 0x7ff1f0102d80 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.899+0000 7ff1fa60c740 1 Processor -- start 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 -- start start 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7176c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c71777680 0x555c71779a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c716d22e0 con 0x555c7176cdc0 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555c71679ce0 con 0x555c71777680 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c716ce2a0 con 0x555c7176c4a0 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1e2ffd640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 0x7ff1dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34488/0 (socket says 172.21.15.22:34488) 2024-09-11T22:35:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/2512082106 learned_addr learned my addr 172.21.15.22:0/2512082106 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 0x7ff1dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7176c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1e2ffd640 1 -- 172.21.15.22:0/1387055421 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1ec0ce740 con 0x7ff1f0102d80 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c71777680 0x555c71779a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/2512082106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 msgr2=0x555c7176c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7176c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/2512082106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c71777680 msgr2=0x555c71779a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c71777680 0x555c71779a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.900+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/2512082106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c7165e440 con 0x555c7176cdc0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.901+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 0x7ff1dc0a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8005fd0 tx=0x7ff1e8009a30 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.901+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c00 tx=0x7ff1ec0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0b2e2887dbca54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.901+0000 7ff1dbfff640 1 -- 172.21.15.22:0/2512082106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec01e070 con 0x555c7176cdc0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.901+0000 7ff1dbfff640 1 -- 172.21.15.22:0/2512082106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1ec0bc040 con 0x555c7176cdc0 2024-09-11T22:35:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.901+0000 7ff1dbfff640 1 -- 172.21.15.22:0/2512082106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec097430 con 0x555c7176cdc0 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- 172.21.15.22:0/2512082106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 msgr2=0x555c71777140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c00 tx=0x7ff1ec0047d0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- 172.21.15.22:0/2512082106 shutdown_connections 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c71777680 0x555c71779a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176cdc0 0x555c71777140 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/2512082106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7176c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- 172.21.15.22:0/2512082106 >> 172.21.15.22:0/2512082106 conn(0x555c71768a30 msgr2=0x555c71768e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- 172.21.15.22:0/2512082106 shutdown_connections 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- 172.21.15.22:0/2512082106 wait complete. 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 -- start start 2024-09-11T22:35:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.902+0000 7ff1fa60c740 1 Processor -- start 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c71776f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c71774210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c7177a250 con 0x555c71777680 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555c7168d050 con 0x555c7176cdc0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c7177a3d0 con 0x555c7176c4a0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 10 client.0 _ll_register_callbacks cb 0x555c716cd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34492/0 (socket says 172.21.15.22:34492) 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 -- 172.21.15.22:0/1231145873 learned_addr learned my addr 172.21.15.22:0/1231145873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c71776f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c71774210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 -- 172.21.15.22:0/1231145873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 msgr2=0x555c71776f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c71776f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 -- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 msgr2=0x555c71774210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c71774210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 -- 172.21.15.22:0/1231145873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c714433c0 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c71776f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8010cf0 tx=0x7ff1e8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92bedf7e17c7300 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8004b20 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1e8004cc0 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.903+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ec0bc040 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff1e802e020 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 10 client.16536 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555c71785ba0 con 0x555c71777680 2024-09-11T22:35:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1ec0bc040 con 0x555c71777680 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff1e801f070 con 0x555c71777680 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 10 client.16536 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 20 client.16536 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c71787000 0x555c71789470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 4 client.16536 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.904+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c716df850 con 0x555c71787000 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.905+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c71787000 0x555c71789470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.905+0000 7ff1d97fa640 10 client.16536 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.905+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c71787000 0x555c71789470 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc89dd61cc269709 server_cookie=e3f88cf015fb495a in_seq=0 out_seq=0 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1d97fa640 1 -- 172.21.15.22:0/1231145873 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c716df850 con 0x555c71787000 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1d97fa640 10 client.16536 handle_command_reply: tid=0 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 client.16536 shutdown 2024-09-11T22:35:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 msgr2=0x555c71774750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8010cf0 tx=0x7ff1e8005bd0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 shutdown_connections 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c71787000 0x555c71789470 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c71774750 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c71774210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1231145873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c71776f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1d97fa640 0 client.16536 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 >> 172.21.15.22:0/1231145873 conn(0x555c71768a30 msgr2=0x555c7176e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 shutdown_connections 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1231145873 wait complete. 2024-09-11T22:35:21.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.906+0000 7ff1fa60c740 20 client.16536 trim_cache size 0 max 16384 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 Processor -- start 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 -- start start 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7178ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c71777680 0x555c7178f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01adae0 con 0x555c7176c4a0 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01b0360 con 0x555c7176cdc0 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.923+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01ae150 con 0x555c71777680 2024-09-11T22:35:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34504/0 (socket says 172.21.15.22:34504) 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1033363202 learned_addr learned my addr 172.21.15.22:0/1033363202 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7178ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c71777680 0x555c7178f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1033363202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c71777680 msgr2=0x555c7178f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c71777680 0x555c7178f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1033363202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 msgr2=0x555c7178ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7178ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 -- 172.21.15.22:0/1033363202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c71768860 con 0x555c7176c4a0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00be60 tx=0x7ff1ec0177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666c8bcea6ecc67f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1db7fe640 1 -- 172.21.15.22:0/1033363202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec01e040 con 0x555c7176c4a0 2024-09-11T22:35:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1db7fe640 1 -- 172.21.15.22:0/1033363202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1ec0173f0 con 0x555c7176c4a0 2024-09-11T22:35:21.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.924+0000 7ff1db7fe640 1 -- 172.21.15.22:0/1033363202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec09a210 con 0x555c7176c4a0 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1033363202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 msgr2=0x555c717834b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00be60 tx=0x7ff1ec0177c0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1033363202 shutdown_connections 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c71777680 0x555c7178f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7178ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/1033363202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7176c4a0 0x555c717834b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1033363202 >> 172.21.15.22:0/1033363202 conn(0x555c71768a30 msgr2=0x555c7176f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1033363202 shutdown_connections 2024-09-11T22:35:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- 172.21.15.22:0/1033363202 wait complete. 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 -- start start 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.925+0000 7ff1fa60c740 1 Processor -- start 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7177fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7177af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01ae820 con 0x555c71777680 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01afc90 con 0x555c7176cdc0 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f01aeef0 con 0x555c7176c4a0 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1fa60c740 10 client.0 _ll_register_callbacks cb 0x7ff1e8009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34508/0 (socket says 172.21.15.22:34508) 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 -- 172.21.15.22:0/3035843079 learned_addr learned my addr 172.21.15.22:0/3035843079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:21.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7177af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7177fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 -- 172.21.15.22:0/3035843079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 msgr2=0x555c7177fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7177fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 -- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 msgr2=0x555c7177af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7177af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f67d0640 1 -- 172.21.15.22:0/3035843079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7177bb00 con 0x555c71777680 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.926+0000 7ff1f57ce640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7177af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1f67d0640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff1e802c660 tx=0x7ff1e8012360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fae5afaa129d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80128a0 con 0x555c71777680 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7ff1e801b070 con 0x555c71777680 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ec0173f0 con 0x555c71777680 2024-09-11T22:35:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff1e8043050 con 0x555c71777680 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 10 client.16542 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555c717f1b90 con 0x555c71777680 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1ec0173f0 con 0x555c71777680 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff1e803f4a0 con 0x555c71777680 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 10 client.16542 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 20 client.16542 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c717f2300 0x555c717f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 4 client.16542 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.927+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c716d9d60 con 0x555c717f2300 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c717f2300 0x555c717f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1f5fcf640 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c717f2300 0x555c717f46f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fbe5284913e4ba9 server_cookie=846c28d9202d2d1a in_seq=0 out_seq=0 2024-09-11T22:35:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1d97fa640 10 client.16542 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1d97fa640 1 -- 172.21.15.22:0/3035843079 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555c716d9d60 con 0x555c717f2300 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1d97fa640 10 client.16542 handle_command_reply: tid=0 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1fa60c740 1 client.16542 shutdown 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 msgr2=0x555c7177b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff1e802c660 tx=0x7ff1e8012360 comp rx=0 tx=0).stop 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 shutdown_connections 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.928+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555c717f2300 0x555c717f46f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c71777680 0x555c7177b490 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c7176cdc0 0x555c7177af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1d97fa640 0 client.16542 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 --2- 172.21.15.22:0/3035843079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c7176c4a0 0x555c7177fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 >> 172.21.15.22:0/3035843079 conn(0x555c71768a30 msgr2=0x555c71772ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 shutdown_connections 2024-09-11T22:35:21.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 1 -- 172.21.15.22:0/3035843079 wait complete. 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1fa60c740 20 client.16542 trim_cache size 0 max 16384 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "0e036884-0383-4263-8034-d18ca1695216": { 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "0e036884-0383-4263-8034-d18ca1695216", 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:35:21.936 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 msgr2=0x7ff1dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 0x7ff1dc0a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8005fd0 tx=0x7ff1e8009a30 comp rx=0 tx=0).stop 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 msgr2=0x7ff1f01a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b4a0 tx=0x7ff1ec00b960 comp rx=0 tx=0).stop 2024-09-11T22:35:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 shutdown_connections 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff1dc0a2cf0 0x7ff1dc0a51b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1f010c160 0x7ff1f019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01036a0 0x7ff1f01a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 --2- 172.21.15.22:0/1387055421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1f0102d80 0x7ff1f01a0400 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 >> 172.21.15.22:0/1387055421 conn(0x7ff1f00fc780 msgr2=0x7ff1f0100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 shutdown_connections 2024-09-11T22:35:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:21.929+0000 7ff1f8233640 1 -- 172.21.15.22:0/1387055421 wait complete. 2024-09-11T22:35:22.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:22 smithi022 ceph-mon[30966]: pgmap v193: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:22.621 INFO:tasks.cephfs.filesystem:scrub status for tag:0e036884-0383-4263-8034-d18ca1695216 - {'path': '/', 'tag': '0e036884-0383-4263-8034-d18ca1695216', 'options': 'recursive,force'} 2024-09-11T22:35:22.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:22 smithi169 ceph-mon[35628]: pgmap v193: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:22.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:22 smithi045 ceph-mon[35556]: pgmap v193: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:24 smithi022 ceph-mon[30966]: pgmap v194: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:24 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:35:24.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:24 smithi169 ceph-mon[35628]: pgmap v194: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:24.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:24 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:35:24.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:24 smithi045 ceph-mon[35556]: pgmap v194: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T22:35:24.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:24 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:35:26.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:26 smithi022 ceph-mon[30966]: pgmap v195: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:35:26.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:26 smithi169 ceph-mon[35628]: pgmap v195: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:35:26.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:26 smithi045 ceph-mon[35556]: pgmap v195: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-11T22:35:28.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:28 smithi022 ceph-mon[30966]: pgmap v196: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:28.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:28 smithi169 ceph-mon[35628]: pgmap v196: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:28.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:28 smithi045 ceph-mon[35556]: pgmap v196: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:30.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:30 smithi022 ceph-mon[30966]: pgmap v197: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:30.656 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:30 smithi169 ceph-mon[35628]: pgmap v197: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:30.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:30 smithi045 ceph-mon[35556]: pgmap v197: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:32 smithi022 ceph-mon[30966]: pgmap v198: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:32.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:32 smithi169 ceph-mon[35628]: pgmap v198: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:32.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:32 smithi045 ceph-mon[35556]: pgmap v198: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:34.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:34 smithi022 ceph-mon[30966]: pgmap v199: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:34.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:34 smithi169 ceph-mon[35628]: pgmap v199: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:34.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:34 smithi045 ceph-mon[35556]: pgmap v199: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:35:36.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:36 smithi022 ceph-mon[30966]: pgmap v200: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:36.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:36 smithi169 ceph-mon[35628]: pgmap v200: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:36.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:36 smithi045 ceph-mon[35556]: pgmap v200: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:35:38.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:38 smithi022 ceph-mon[30966]: pgmap v201: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:38.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:38 smithi169 ceph-mon[35628]: pgmap v201: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:38.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:38 smithi045 ceph-mon[35556]: pgmap v201: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:40.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:40 smithi022 ceph-mon[30966]: pgmap v202: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:40.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:40 smithi169 ceph-mon[35628]: pgmap v202: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:40.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:40 smithi045 ceph-mon[35556]: pgmap v202: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:42.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:42 smithi022 ceph-mon[30966]: pgmap v203: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:42.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:42 smithi169 ceph-mon[35628]: pgmap v203: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:42.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:42 smithi045 ceph-mon[35556]: pgmap v203: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:44 smithi022 ceph-mon[30966]: pgmap v204: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:44.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:44 smithi169 ceph-mon[35628]: pgmap v204: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:44.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:44 smithi045 ceph-mon[35556]: pgmap v204: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:46 smithi022 ceph-mon[30966]: pgmap v205: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:46.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:46 smithi169 ceph-mon[35628]: pgmap v205: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:46.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:46 smithi045 ceph-mon[35556]: pgmap v205: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:48.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:48 smithi022 ceph-mon[30966]: pgmap v206: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:48.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:48 smithi169 ceph-mon[35628]: pgmap v206: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:48.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:48 smithi045 ceph-mon[35556]: pgmap v206: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:50 smithi022 ceph-mon[30966]: pgmap v207: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:50.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:50 smithi169 ceph-mon[35628]: pgmap v207: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:50.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:50 smithi045 ceph-mon[35556]: pgmap v207: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:52.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:35:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:52 smithi022 ceph-mon[30966]: pgmap v208: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:52.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:52 smithi169 ceph-mon[35628]: pgmap v208: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:52.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:52 smithi045 ceph-mon[35556]: pgmap v208: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:52.897 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 -- 172.21.15.22:0/4083889851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f0102d40 msgr2=0x7f78f0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 --2- 172.21.15.22:0/4083889851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f0102d40 0x7f78f0103120 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002a480 comp rx=0 tx=0).stop 2024-09-11T22:35:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 -- 172.21.15.22:0/4083889851 shutdown_connections 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 --2- 172.21.15.22:0/4083889851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f010c170 0x7f78f010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 --2- 172.21.15.22:0/4083889851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 0x7f78f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 --2- 172.21.15.22:0/4083889851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f0102d40 0x7f78f0103120 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 -- 172.21.15.22:0/4083889851 >> 172.21.15.22:0/4083889851 conn(0x7f78f00fc7a0 msgr2=0x7f78f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 -- 172.21.15.22:0/4083889851 shutdown_connections 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.444+0000 7f78f5d39640 1 -- 172.21.15.22:0/4083889851 wait complete. 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.445+0000 7f78f5d39640 1 Processor -- start 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.445+0000 7f78f5d39640 1 -- start start 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 0x7f78f0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 0x7f78f0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0112090 con 0x7f78f010c170 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0111f10 con 0x7f78f0102d40 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78f5d39640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0112210 con 0x7f78f0103660 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40324/0 (socket says 172.21.15.22:40324) 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 -- 172.21.15.22:0/777867319 learned_addr learned my addr 172.21.15.22:0/777867319 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78eeffd640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 0x7f78f0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 0x7f78f0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 -- 172.21.15.22:0/777867319 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 msgr2=0x7f78f0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 0x7f78f0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 -- 172.21.15.22:0/777867319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 msgr2=0x7f78f0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 0x7f78f0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 -- 172.21.15.22:0/777867319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f019d540 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 0x7f78f0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.446+0000 7f78effff640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f78e800cad0 tx=0x7f78e800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.447+0000 7f78ecff9640 1 -- 172.21.15.22:0/777867319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e800ae20 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.447+0000 7f78ecff9640 1 -- 172.21.15.22:0/777867319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78e8004b20 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.447+0000 7f78ecff9640 1 -- 172.21.15.22:0/777867319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e800f780 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.447+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f019d830 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.447+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f01a5110 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.449+0000 7f78ecff9640 1 -- 172.21.15.22:0/777867319 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f78e8004cd0 con 0x7f78f010c170 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.449+0000 7f78f8112740 1 Processor -- start 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.449+0000 7f78f8112740 1 -- start start 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0624140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0626a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55deb057f2e0 con 0x55deb06194a0 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55deb0526ce0 con 0x55deb0619dc0 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78f8112740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55deb057b2a0 con 0x55deb0624680 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78ecff9640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 0x7f78dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40330/0 (socket says 172.21.15.22:40330) 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 -- 172.21.15.22:0/8616339 learned_addr learned my addr 172.21.15.22:0/8616339 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0624140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78effff640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 0x7f78dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0626a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78ecff9640 1 -- 172.21.15.22:0/777867319 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78e80cf4a0 con 0x7f78f010c170 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 -- 172.21.15.22:0/8616339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 msgr2=0x55deb0626a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0626a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 -- 172.21.15.22:0/8616339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 msgr2=0x55deb0624140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0624140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 -- 172.21.15.22:0/8616339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb050b440 con 0x55deb06194a0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78eeffd640 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f78d80058a0 tx=0x7f78d800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6060ccb8e4bf41ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78effff640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 0x7f78dc0a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78e809b6b0 tx=0x7f78e8044040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.450+0000 7f78e5ffb640 1 -- 172.21.15.22:0/8616339 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004030 con 0x55deb06194a0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78e5ffb640 1 -- 172.21.15.22:0/8616339 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d80041d0 con 0x55deb06194a0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78e5ffb640 1 -- 172.21.15.22:0/8616339 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d800f6e0 con 0x55deb06194a0 2024-09-11T22:35:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 -- 172.21.15.22:0/8616339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 msgr2=0x55deb0619880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f78d80058a0 tx=0x7f78d800b830 comp rx=0 tx=0).stop 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 -- 172.21.15.22:0/8616339 shutdown_connections 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0626a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0624140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 --2- 172.21.15.22:0/8616339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0619880 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 -- 172.21.15.22:0/8616339 >> 172.21.15.22:0/8616339 conn(0x55deb0615a30 msgr2=0x55deb0615e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 -- 172.21.15.22:0/8616339 shutdown_connections 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.451+0000 7f78f8112740 1 -- 172.21.15.22:0/8616339 wait complete. 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 -- start start 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 Processor -- start 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0621220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0621760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55deb0627250 con 0x55deb06194a0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55deb053a050 con 0x55deb0619dc0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55deb06273d0 con 0x55deb0624680 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78f8112740 10 client.0 _ll_register_callbacks cb 0x55deb057a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.452+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40346/0 (socket says 172.21.15.22:40346) 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 -- 172.21.15.22:0/4142567495 learned_addr learned my addr 172.21.15.22:0/4142567495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0621220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0621760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 -- 172.21.15.22:0/4142567495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 msgr2=0x55deb0621760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0621760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 -- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 msgr2=0x55deb0621220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0621220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 -- 172.21.15.22:0/4142567495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb02f03c0 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78eeffd640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f78d8003db0 tx=0x7f78d8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf73861f950a48e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8005260 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78d8005400 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d80041d0 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f78d8036050 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78f8112740 10 client.16554 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.453+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55deb0632bc0 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d80041d0 con 0x55deb06194a0 2024-09-11T22:35:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f78d8004ba0 con 0x55deb06194a0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 10 client.16554 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 20 client.16554 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb0633fd0 0x55deb06363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 4 client.16554 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deb058c850 con 0x55deb0633fd0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.454+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb0633fd0 0x55deb06363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.455+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb0633fd0 0x55deb06363c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9b40942cef760e server_cookie=f4d16cfb6f520075 in_seq=0 out_seq=0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.455+0000 7f78ceffd640 10 client.16554 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78ceffd640 1 -- 172.21.15.22:0/4142567495 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55deb058c850 con 0x55deb0633fd0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78ceffd640 10 client.16554 handle_command_reply: tid=0 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 client.16554 shutdown 2024-09-11T22:35:53.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 msgr2=0x55deb0623f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f78d8003db0 tx=0x7f78d8005c50 comp rx=0 tx=0).stop 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 shutdown_connections 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb0633fd0 0x55deb06363c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0624680 0x55deb0621760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78ceffd640 0 client.16554 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb0621220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 --2- 172.21.15.22:0/4142567495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb0623f70 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 >> 172.21.15.22:0/4142567495 conn(0x55deb0615a30 msgr2=0x55deb061b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 shutdown_connections 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 1 -- 172.21.15.22:0/4142567495 wait complete. 2024-09-11T22:35:53.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.456+0000 7f78f8112740 20 client.16554 trim_cache size 0 max 16384 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 Processor -- start 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 -- start start 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 0x55deb063bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0624680 0x55deb063bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01ab900 con 0x55deb06194a0 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01ae160 con 0x55deb0624680 2024-09-11T22:35:53.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78f8112740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01abf50 con 0x55deb0619dc0 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40358/0 (socket says 172.21.15.22:40358) 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.474+0000 7f78eeffd640 1 -- 172.21.15.22:0/3140669408 learned_addr learned my addr 172.21.15.22:0/3140669408 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 0x55deb063bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 -- 172.21.15.22:0/3140669408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 msgr2=0x55deb063bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 0x55deb063bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 -- 172.21.15.22:0/3140669408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0624680 msgr2=0x55deb063bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0624680 0x55deb063bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 -- 172.21.15.22:0/3140669408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb06242e0 con 0x55deb06194a0 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 0x55deb063bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:53.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f78d800c010 tx=0x7f78d8012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d1b3b2ff954f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78e57fa640 1 -- 172.21.15.22:0/3140669408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8003de0 con 0x55deb06194a0 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78e57fa640 1 -- 172.21.15.22:0/3140669408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d802a040 con 0x55deb06194a0 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.475+0000 7f78e57fa640 1 -- 172.21.15.22:0/3140669408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8010e10 con 0x55deb06194a0 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- 172.21.15.22:0/3140669408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 msgr2=0x55deb061faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f78d800c010 tx=0x7f78d8012e70 comp rx=0 tx=0).stop 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- 172.21.15.22:0/3140669408 shutdown_connections 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0624680 0x55deb063bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb0619dc0 0x55deb063bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 --2- 172.21.15.22:0/3140669408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb06194a0 0x55deb061faf0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- 172.21.15.22:0/3140669408 >> 172.21.15.22:0/3140669408 conn(0x55deb0615a30 msgr2=0x55deb0614b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- 172.21.15.22:0/3140669408 shutdown_connections 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- 172.21.15.22:0/3140669408 wait complete. 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 -- start start 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.476+0000 7f78f8112740 1 Processor -- start 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb06194a0 0x55deb062c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb062cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01ac620 con 0x55deb0624680 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01ada90 con 0x55deb0619dc0 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01accf0 con 0x55deb06194a0 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78f8112740 10 client.0 _ll_register_callbacks cb 0x7f78e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40366/0 (socket says 172.21.15.22:40366) 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 -- 172.21.15.22:0/3448524671 learned_addr learned my addr 172.21.15.22:0/3448524671 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb06194a0 0x55deb062c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb062cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 -- 172.21.15.22:0/3448524671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb06194a0 msgr2=0x55deb062c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb06194a0 0x55deb062c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 -- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 msgr2=0x55deb062cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb062cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78eeffd640 1 -- 172.21.15.22:0/3448524671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb062a2a0 con 0x55deb0624680 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.477+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb062cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78eeffd640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f78d8010670 tx=0x7f78d800bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170e42c5f64af889 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8005260 con 0x55deb0624680 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f78d8005400 con 0x55deb0624680 2024-09-11T22:35:53.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d802a040 con 0x55deb0624680 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f78d8005600 con 0x55deb0624680 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 10 client.16560 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55deb069e580 con 0x55deb0624680 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d802a040 con 0x55deb0624680 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f78d801e790 con 0x55deb0624680 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 10 client.16560 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 20 client.16560 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb069eae0 0x55deb06a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 4 client.16560 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.478+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55deb0586d60 con 0x55deb069eae0 2024-09-11T22:35:53.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb069eae0 0x55deb06a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78ef7fe640 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb069eae0 0x55deb06a0ed0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f356350b74af6b server_cookie=3a138b794a063c7e in_seq=0 out_seq=0 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78ceffd640 10 client.16560 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78ceffd640 1 -- 172.21.15.22:0/3448524671 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55deb0586d60 con 0x55deb069eae0 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78ceffd640 10 client.16560 handle_command_reply: tid=0 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 client.16560 shutdown 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 msgr2=0x55deb0629bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f78d8010670 tx=0x7f78d800bc10 comp rx=0 tx=0).stop 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 shutdown_connections 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55deb069eae0 0x55deb06a0ed0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55deb0624680 0x55deb0629bb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55deb0619dc0 0x55deb062cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 --2- 172.21.15.22:0/3448524671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55deb06194a0 0x55deb062c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.479+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 >> 172.21.15.22:0/3448524671 conn(0x55deb0615a30 msgr2=0x55deb0622a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78ceffd640 0 client.16560 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 shutdown_connections 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f8112740 1 -- 172.21.15.22:0/3448524671 wait complete. 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f8112740 20 client.16560 trim_cache size 0 max 16384 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:35:53.490 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 msgr2=0x7f78dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 0x7f78dc0a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78e809b6b0 tx=0x7f78e8044040 comp rx=0 tx=0).stop 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 msgr2=0x7f78f019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f78e800cad0 tx=0x7f78e800cf90 comp rx=0 tx=0).stop 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 shutdown_connections 2024-09-11T22:35:53.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f78dc0a2cf0 0x7f78dc0a51b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78f010c170 0x7f78f019ce60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78f0103660 0x7f78f0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 --2- 172.21.15.22:0/777867319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78f0102d40 0x7f78f0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 >> 172.21.15.22:0/777867319 conn(0x7f78f00fc7a0 msgr2=0x7f78f00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 shutdown_connections 2024-09-11T22:35:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:53.480+0000 7f78f5d39640 1 -- 172.21.15.22:0/777867319 wait complete. 2024-09-11T22:35:54.226 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:35:54.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:35:54.537 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:54 smithi022 ceph-mon[30966]: pgmap v209: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:54.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:54 smithi169 ceph-mon[35628]: pgmap v209: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:54.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:54 smithi045 ceph-mon[35556]: pgmap v209: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- 172.21.15.22:0/3921901202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 msgr2=0x7fdfd0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 --2- 172.21.15.22:0/3921901202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd0106e60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc002a420 comp rx=0 tx=0).stop 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- 172.21.15.22:0/3921901202 shutdown_connections 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 --2- 172.21.15.22:0/3921901202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0101420 0x7fdfd010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 --2- 172.21.15.22:0/3921901202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0100a80 0x7fdfd0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 --2- 172.21.15.22:0/3921901202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd0106e60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- 172.21.15.22:0/3921901202 >> 172.21.15.22:0/3921901202 conn(0x7fdfd00fc7a0 msgr2=0x7fdfd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- 172.21.15.22:0/3921901202 shutdown_connections 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- 172.21.15.22:0/3921901202 wait complete. 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 Processor -- start 2024-09-11T22:35:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.034+0000 7fdfd6587640 1 -- start start 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0100a80 0x7fdfd0196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0101420 0x7fdfd0196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd010fef0 con 0x7fdfd0106a80 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd010fd70 con 0x7fdfd0100a80 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd6587640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd0110070 con 0x7fdfd0101420 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46366/0 (socket says 172.21.15.22:46366) 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 -- 172.21.15.22:0/2287200733 learned_addr learned my addr 172.21.15.22:0/2287200733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfcf7fe640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0101420 0x7fdfd0196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfcffff640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0100a80 0x7fdfd0196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:55.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 -- 172.21.15.22:0/2287200733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0101420 msgr2=0x7fdfd0196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0101420 0x7fdfd0196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 -- 172.21.15.22:0/2287200733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0100a80 msgr2=0x7fdfd0196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0100a80 0x7fdfd0196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.035+0000 7fdfd4b24640 1 -- 172.21.15.22:0/2287200733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd019b300 con 0x7fdfd0106a80 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfd4b24640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800eaa0 tx=0x7fdfc800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800cdb0 con 0x7fdfd0106a80 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfc8004b20 con 0x7fdfd0106a80 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd019b5f0 con 0x7fdfd0106a80 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011760 con 0x7fdfd0106a80 2024-09-11T22:35:55.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.036+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd01a2ed0 con 0x7fdfd0106a80 2024-09-11T22:35:55.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.037+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd0100ee0 con 0x7fdfd0106a80 2024-09-11T22:35:55.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.038+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdfc8004cd0 con 0x7fdfd0106a80 2024-09-11T22:35:55.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.039+0000 7fdfcd7fa640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 0x7fdfb80a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:55.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.039+0000 7fdfcffff640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 0x7fdfb80a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:55.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.039+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fdfc80cf920 con 0x7fdfd0106a80 2024-09-11T22:35:55.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.040+0000 7fdfcffff640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 0x7fdfb80a7440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006010 tx=0x7fdfc0005a20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.042+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfc8016030 con 0x7fdfd0106a80 2024-09-11T22:35:55.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.253+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfd01976b0 con 0x7fdfd0106a80 2024-09-11T22:35:55.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.254+0000 7fdfcd7fa640 1 -- 172.21.15.22:0/2287200733 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7fdfd01976b0 con 0x7fdfd0106a80 2024-09-11T22:35:55.255 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:35:55.255 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:35:55.255 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 msgr2=0x7fdfb80a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 0x7fdfb80a7440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006010 tx=0x7fdfc0005a20 comp rx=0 tx=0).stop 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 msgr2=0x7fdfd019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800eaa0 tx=0x7fdfc800ef60 comp rx=0 tx=0).stop 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 shutdown_connections 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fdfb80a4f80 0x7fdfb80a7440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfd0106a80 0x7fdfd019ac20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfd0101420 0x7fdfd0196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 --2- 172.21.15.22:0/2287200733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd0100a80 0x7fdfd0196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:55.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 >> 172.21.15.22:0/2287200733 conn(0x7fdfd00fc7a0 msgr2=0x7fdfd00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:55.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 shutdown_connections 2024-09-11T22:35:55.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:55.256+0000 7fdfd6587640 1 -- 172.21.15.22:0/2287200733 wait complete. 2024-09-11T22:35:55.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:35:56.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:56.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:56 smithi022 ceph-mon[30966]: pgmap v210: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:56.567 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:56 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2287200733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:56.670 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:56 smithi169 ceph-mon[35628]: pgmap v210: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:56.671 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:56 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2287200733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 -- 172.21.15.22:0/3783387101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c100a80 msgr2=0x7fe53c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 --2- 172.21.15.22:0/3783387101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c100a80 0x7fe53c100ee0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009930 tx=0x7fe52c02a420 comp rx=0 tx=0).stop 2024-09-11T22:35:56.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 -- 172.21.15.22:0/3783387101 shutdown_connections 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 --2- 172.21.15.22:0/3783387101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 0x7fe53c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 --2- 172.21.15.22:0/3783387101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c100a80 0x7fe53c100ee0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 --2- 172.21.15.22:0/3783387101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c106a80 0x7fe53c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 -- 172.21.15.22:0/3783387101 >> 172.21.15.22:0/3783387101 conn(0x7fe53c0fc7a0 msgr2=0x7fe53c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 -- 172.21.15.22:0/3783387101 shutdown_connections 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.650+0000 7fe543ba6640 1 -- 172.21.15.22:0/3783387101 wait complete. 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 Processor -- start 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 -- start start 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c100a80 0x7fe53c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 0x7fe53c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c111000 con 0x7fe53c106a80 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c110e80 con 0x7fe53c101420 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe543ba6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c111180 con 0x7fe53c100a80 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe542143640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe542143640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46396/0 (socket says 172.21.15.22:46396) 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe542143640 1 -- 172.21.15.22:0/2995299769 learned_addr learned my addr 172.21.15.22:0/2995299769 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe541942640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c100a80 0x7fe53c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.651+0000 7fe541141640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 0x7fe53c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 -- 172.21.15.22:0/2995299769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c100a80 msgr2=0x7fe53c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c100a80 0x7fe53c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 -- 172.21.15.22:0/2995299769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 msgr2=0x7fe53c198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 0x7fe53c198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 -- 172.21.15.22:0/2995299769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c19d5e0 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe542143640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b970 tx=0x7fe53400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe532ffd640 1 -- 172.21.15.22:0/2995299769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534019070 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53c19d8d0 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe532ffd640 1 -- 172.21.15.22:0/2995299769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe53400cb40 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe532ffd640 1 -- 172.21.15.22:0/2995299769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534007700 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.652+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe53c1a51b0 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.654+0000 7fe532ffd640 1 -- 172.21.15.22:0/2995299769 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe53401c070 con 0x7fe53c106a80 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 Processor -- start 2024-09-11T22:35:56.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 -- start start 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 0x562ddad00a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad11b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ddac662f0 con 0x562ddad01b40 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562ddac0dcf0 con 0x562ddad005d0 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe545f7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ddac622b0 con 0x562ddad0f780 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46400/0 (socket says 172.21.15.22:46400) 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe541141640 1 -- 172.21.15.22:0/602730925 learned_addr learned my addr 172.21.15.22:0/602730925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe532ffd640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 0x7fe5280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.655+0000 7fe541942640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 0x562ddad00a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad11b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe542143640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 0x7fe5280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe532ffd640 1 -- 172.21.15.22:0/2995299769 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe5340ce9f0 con 0x7fe53c106a80 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 -- 172.21.15.22:0/602730925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 msgr2=0x562ddad11b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad11b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 -- 172.21.15.22:0/602730925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 msgr2=0x562ddad00a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 0x562ddad00a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 -- 172.21.15.22:0/602730925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddabf23a0 con 0x562ddad01b40 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541942640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 0x562ddad00a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe541141640 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005ab0 tx=0x7fe52c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593adfb5eb802ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe542143640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 0x7fe5280a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5340979e0 tx=0x7fe53406cfd0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe527fff640 1 -- 172.21.15.22:0/602730925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c043020 con 0x562ddad01b40 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe527fff640 1 -- 172.21.15.22:0/602730925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe52c005520 con 0x562ddad01b40 2024-09-11T22:35:56.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.656+0000 7fe527fff640 1 -- 172.21.15.22:0/602730925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c035050 con 0x562ddad01b40 2024-09-11T22:35:56.680 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:56 smithi045 ceph-mon[35556]: pgmap v210: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:35:56.680 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:56 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2287200733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- 172.21.15.22:0/602730925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 msgr2=0x562ddad00090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005ab0 tx=0x7fe52c0058b0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- 172.21.15.22:0/602730925 shutdown_connections 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad11b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad005d0 0x562ddad00a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 --2- 172.21.15.22:0/602730925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad01b40 0x562ddad00090 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- 172.21.15.22:0/602730925 >> 172.21.15.22:0/602730925 conn(0x562ddacc9310 msgr2=0x562ddacfcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- 172.21.15.22:0/602730925 shutdown_connections 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- 172.21.15.22:0/602730925 wait complete. 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 -- start start 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.657+0000 7fe545f7f740 1 Processor -- start 2024-09-11T22:35:56.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 0x562ddad0c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad0f780 0x562ddad0ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562ddad12420 con 0x562ddad005d0 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562ddac21060 con 0x562ddad0f780 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ddad125a0 con 0x562ddad01b40 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe545f7f740 10 client.0 _ll_register_callbacks cb 0x562dda9748c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46412/0 (socket says 172.21.15.22:46412) 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 -- 172.21.15.22:0/1609747064 learned_addr learned my addr 172.21.15.22:0/1609747064 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541942640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 0x562ddad0c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 -- 172.21.15.22:0/1609747064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 msgr2=0x562ddad0c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 0x562ddad0c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 -- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad0f780 msgr2=0x562ddad0ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad0f780 0x562ddad0ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541141640 1 -- 172.21.15.22:0/1609747064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dda9d73c0 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.658+0000 7fe541942640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 0x562ddad0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe541141640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe52c004ac0 tx=0x7fe52c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b1ff61fb26b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c04b020 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe52c03a890 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52c005520 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe52c056050 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 10 client.16578 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562ddad1def0 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe52c005520 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe52c03d7e0 con 0x562ddad005d0 2024-09-11T22:35:56.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 10 client.16578 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 20 client.16578 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad21630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 4 client.16578 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.659+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ddac73860 con 0x562ddad1f240 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.660+0000 7fe541942640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad21630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.660+0000 7fe5257fa640 10 client.16578 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.660+0000 7fe541942640 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad21630 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612d2a4633b1749 server_cookie=acbb07cba31021b1 in_seq=0 out_seq=0 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe5257fa640 1 -- 172.21.15.22:0/1609747064 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ddac73860 con 0x562ddad1f240 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe5257fa640 10 client.16578 handle_command_reply: tid=0 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 client.16578 shutdown 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 msgr2=0x562ddad0f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe52c004ac0 tx=0x7fe52c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 shutdown_connections 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad21630 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad0f780 0x562ddad0ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad01b40 0x562ddad0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe5257fa640 0 client.16578 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1609747064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad0f190 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 >> 172.21.15.22:0/1609747064 conn(0x562ddacc9310 msgr2=0x562ddad02960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 shutdown_connections 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 1 -- 172.21.15.22:0/1609747064 wait complete. 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.661+0000 7fe545f7f740 20 client.16578 trim_cache size 0 max 16384 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.674+0000 7fe545f7f740 1 Processor -- start 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.674+0000 7fe545f7f740 1 -- start start 2024-09-11T22:35:56.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.674+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.674+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddacfba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.674+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddacfbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe545f7f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1a95a0 con 0x562ddad005d0 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe545f7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1abe00 con 0x562ddad01b40 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe545f7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1a9bf0 con 0x562ddad0f780 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46420/0 (socket says 172.21.15.22:46420) 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 -- 172.21.15.22:0/768433373 learned_addr learned my addr 172.21.15.22:0/768433373 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541942640 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddacfba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 -- 172.21.15.22:0/768433373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 msgr2=0x562ddacfbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddacfbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 -- 172.21.15.22:0/768433373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 msgr2=0x562ddacfba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddacfba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 -- 172.21.15.22:0/768433373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddacfced0 con 0x562ddad005d0 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe541141640 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe52c004990 tx=0x7fe52c047380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28745e89be045d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe5277fe640 1 -- 172.21.15.22:0/768433373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c04b040 con 0x562ddad005d0 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe5277fe640 1 -- 172.21.15.22:0/768433373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe52c009520 con 0x562ddad005d0 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.675+0000 7fe5277fe640 1 -- 172.21.15.22:0/768433373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c035030 con 0x562ddad005d0 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- 172.21.15.22:0/768433373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 msgr2=0x562ddad1b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe52c004990 tx=0x7fe52c047380 comp rx=0 tx=0).stop 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- 172.21.15.22:0/768433373 shutdown_connections 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddacfbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddacfba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 --2- 172.21.15.22:0/768433373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad1b6c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- 172.21.15.22:0/768433373 >> 172.21.15.22:0/768433373 conn(0x562ddacc9310 msgr2=0x562ddacfb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- 172.21.15.22:0/768433373 shutdown_connections 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- 172.21.15.22:0/768433373 wait complete. 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 -- start start 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.676+0000 7fe545f7f740 1 Processor -- start 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddad13060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad135a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1aa2c0 con 0x562ddad005d0 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1ab730 con 0x562ddad01b40 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1aa990 con 0x562ddad0f780 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe545f7f740 10 client.0 _ll_register_callbacks cb 0x7fe53800c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541141640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46422/0 (socket says 172.21.15.22:46422) 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541141640 1 -- 172.21.15.22:0/1364673950 learned_addr learned my addr 172.21.15.22:0/1364673950 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddad13060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541141640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 -- 172.21.15.22:0/1364673950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 msgr2=0x562ddad135a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad135a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 -- 172.21.15.22:0/1364673950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 msgr2=0x562ddad17d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541942640 1 -- 172.21.15.22:0/1364673950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ddad13b60 con 0x562ddad01b40 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.677+0000 7fe541141640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe541942640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddad13060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x562ddad21b70 tx=0x7fe5380054d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754416d7bd60e2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538023470 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7fe538023610 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe52c009520 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe538023810 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 10 client.26111 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562ddad899b0 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe52c009520 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe53802dc90 con 0x562ddad01b40 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 10 client.26111 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.678+0000 7fe545f7f740 20 client.26111 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad8c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 4 client.26111 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ddac6dd70 con 0x562ddad1f240 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe541141640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad8c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe541141640 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad8c100 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9866c752a5eea15 server_cookie=7ba1ab61f7707763 in_seq=0 out_seq=0 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe5257fa640 10 client.26111 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe5257fa640 1 -- 172.21.15.22:0/1364673950 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ddac6dd70 con 0x562ddad1f240 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe5257fa640 10 client.26111 handle_command_reply: tid=0 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 1 client.26111 shutdown 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 msgr2=0x562ddad13060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.679+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddad13060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x562ddad21b70 tx=0x7fe5380054d0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 shutdown_connections 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x562ddad1f240 0x562ddad8c100 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ddad0f780 0x562ddad135a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562ddad01b40 0x562ddad13060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe5257fa640 0 client.26111 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 --2- 172.21.15.22:0/1364673950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562ddad005d0 0x562ddad17d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 >> 172.21.15.22:0/1364673950 conn(0x562ddacc9310 msgr2=0x562ddad0a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 shutdown_connections 2024-09-11T22:35:56.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 1 -- 172.21.15.22:0/1364673950 wait complete. 2024-09-11T22:35:56.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe545f7f740 20 client.26111 trim_cache size 0 max 16384 2024-09-11T22:35:56.699 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 msgr2=0x7fe5280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 0x7fe5280a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe5340979e0 tx=0x7fe53406cfd0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 msgr2=0x7fe53c19cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b970 tx=0x7fe53400be30 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 shutdown_connections 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe5280a2cf0 0x7fe5280a51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe53c106a80 0x7fe53c19cf00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe53c101420 0x7fe53c198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 --2- 172.21.15.22:0/2995299769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53c100a80 0x7fe53c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 >> 172.21.15.22:0/2995299769 conn(0x7fe53c0fc7a0 msgr2=0x7fe53c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 shutdown_connections 2024-09-11T22:35:56.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:56.680+0000 7fe543ba6640 1 -- 172.21.15.22:0/2995299769 wait complete. 2024-09-11T22:35:58.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:35:58.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:35:58.543 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:35:58 smithi022 ceph-mon[30966]: pgmap v211: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:58.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:35:58 smithi169 ceph-mon[35628]: pgmap v211: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:58.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:35:58 smithi045 ceph-mon[35556]: pgmap v211: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:35:58.786 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 -- 172.21.15.22:0/1669750547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 msgr2=0x7f933c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 --2- 172.21.15.22:0/1669750547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c10bb50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9330009900 tx=0x7f933002a480 comp rx=0 tx=0).stop 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 -- 172.21.15.22:0/1669750547 shutdown_connections 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 --2- 172.21.15.22:0/1669750547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f933c10c170 0x7f933c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 --2- 172.21.15.22:0/1669750547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c10bb50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 --2- 172.21.15.22:0/1669750547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 0x7f933c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 -- 172.21.15.22:0/1669750547 >> 172.21.15.22:0/1669750547 conn(0x7f933c0fc7a0 msgr2=0x7f933c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 -- 172.21.15.22:0/1669750547 shutdown_connections 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.202+0000 7f93441e4640 1 -- 172.21.15.22:0/1669750547 wait complete. 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 Processor -- start 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 -- start start 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 0x7f933c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f933c10c170 0x7f933c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1120f0 con 0x7f933c103660 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f933c111f70 con 0x7f933c102d40 2024-09-11T22:35:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f93441e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f933c112270 con 0x7f933c10c170 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46444/0 (socket says 172.21.15.22:46444) 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 -- 172.21.15.22:0/1588299156 learned_addr learned my addr 172.21.15.22:0/1588299156 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f9341f80640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 0x7f933c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 -- 172.21.15.22:0/1588299156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f933c10c170 msgr2=0x7f933c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f933c10c170 0x7f933c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 -- 172.21.15.22:0/1588299156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 msgr2=0x7f933c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 0x7f933c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 -- 172.21.15.22:0/1588299156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c19d520 con 0x7f933c103660 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.203+0000 7f934177f640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9330006010 tx=0x7f93300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.204+0000 7f933affd640 1 -- 172.21.15.22:0/1588299156 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933003f030 con 0x7f933c103660 2024-09-11T22:35:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.204+0000 7f933affd640 1 -- 172.21.15.22:0/1588299156 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9330003d00 con 0x7f933c103660 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.204+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c19d7b0 con 0x7f933c103660 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.204+0000 7f933affd640 1 -- 172.21.15.22:0/1588299156 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330035070 con 0x7f933c103660 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.204+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c1a50f0 con 0x7f933c103660 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.206+0000 7f933affd640 1 -- 172.21.15.22:0/1588299156 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9330042030 con 0x7f933c103660 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.206+0000 7f93465bd740 1 Processor -- start 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.206+0000 7f93465bd740 1 -- start start 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 0x560f824c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560f82428280 con 0x560f824d2150 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560f823cfb10 con 0x560f824c2a60 2024-09-11T22:35:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f93465bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560f82424240 con 0x560f824c3380 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9341f80640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9341f80640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:37438/0 (socket says 172.21.15.22:37438) 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9341f80640 1 -- 172.21.15.22:0/1549147756 learned_addr learned my addr 172.21.15.22:0/1549147756 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 0x560f824c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f934177f640 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 -- 172.21.15.22:0/1549147756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 msgr2=0x560f824d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 -- 172.21.15.22:0/1549147756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 msgr2=0x560f824d4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f9342781640 1 -- 172.21.15.22:0/1549147756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f823dc1f0 con 0x560f824c2a60 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.207+0000 7f933affd640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 0x7f93240a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f9342781640 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 0x560f824c2e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9334009cc0 tx=0x7f933400b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87655ace0101c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f933affd640 1 -- 172.21.15.22:0/1588299156 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f93300ef4d0 con 0x7f933c103660 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f9323fff640 1 -- 172.21.15.22:0/1549147756 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334024620 con 0x560f824c2a60 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f9323fff640 1 -- 172.21.15.22:0/1549147756 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9334024cc0 con 0x560f824c2a60 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f9323fff640 1 -- 172.21.15.22:0/1549147756 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334023c20 con 0x560f824c2a60 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.208+0000 7f9341f80640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 0x7f93240a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- 172.21.15.22:0/1549147756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 msgr2=0x560f824c2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f9341f80640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 0x7f93240a5230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x560f824c5750 tx=0x7f932c00b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 0x560f824c2e40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9334009cc0 tx=0x7f933400b7e0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- 172.21.15.22:0/1549147756 shutdown_connections 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 --2- 172.21.15.22:0/1549147756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c2a60 0x560f824c2e40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- 172.21.15.22:0/1549147756 >> 172.21.15.22:0/1549147756 conn(0x560f824bf0f0 msgr2=0x560f824bf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- 172.21.15.22:0/1549147756 shutdown_connections 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- 172.21.15.22:0/1549147756 wait complete. 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 -- start start 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.209+0000 7f93465bd740 1 Processor -- start 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c2a60 0x560f824cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c3380 0x560f824cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560f824d4d80 con 0x560f824d2150 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560f823e2f10 con 0x560f824c3380 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560f824d4f00 con 0x560f824c2a60 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f93465bd740 10 client.0 _ll_register_callbacks cb 0x560f823aba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46448/0 (socket says 172.21.15.22:46448) 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 -- 172.21.15.22:0/3745296300 learned_addr learned my addr 172.21.15.22:0/3745296300 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9341f80640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c2a60 0x560f824cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f934177f640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c3380 0x560f824cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 -- 172.21.15.22:0/3745296300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c2a60 msgr2=0x560f824cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c2a60 0x560f824cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 -- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c3380 msgr2=0x560f824cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c3380 0x560f824cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.210+0000 7f9342781640 1 -- 172.21.15.22:0/3745296300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f821996a0 con 0x560f824d2150 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f9342781640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f93340246b0 tx=0x7f93340246e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6003256a5d0fb95e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334038610 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9334024cc0 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f93340387b0 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9334024b10 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 10 client.16596 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560f824e09f0 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9334024cc0 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f9334042480 con 0x560f824d2150 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 10 client.16596 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 20 client.16596 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f824e1d40 0x560f824e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 4 client.16596 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:35:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.211+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f824357f0 con 0x560f824e1d40 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.212+0000 7f9341f80640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f824e1d40 0x560f824e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.212+0000 7f93217fa640 10 client.16596 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.212+0000 7f9341f80640 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f824e1d40 0x560f824e4130 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1300596babdc30b7 server_cookie=bd73f6cc9ad30dc8 in_seq=0 out_seq=0 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93217fa640 1 -- 172.21.15.22:0/3745296300 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f824357f0 con 0x560f824e1d40 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93217fa640 10 client.16596 handle_command_reply: tid=0 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 client.16596 shutdown 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 msgr2=0x560f824cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f93340246b0 tx=0x7f93340246e0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 shutdown_connections 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f824e1d40 0x560f824e4130 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824cfad0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824c3380 0x560f824cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93217fa640 0 client.16596 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 --2- 172.21.15.22:0/3745296300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c2a60 0x560f824cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 >> 172.21.15.22:0/3745296300 conn(0x560f824bf0f0 msgr2=0x560f824c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 shutdown_connections 2024-09-11T22:35:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 1 -- 172.21.15.22:0/3745296300 wait complete. 2024-09-11T22:35:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.213+0000 7f93465bd740 20 client.16596 trim_cache size 0 max 16384 2024-09-11T22:35:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 Processor -- start 2024-09-11T22:35:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 -- start start 2024-09-11T22:35:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 0x560f824e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f933c070010 con 0x560f824c2a60 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f933c072890 con 0x560f824d2150 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f93465bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f933c070680 con 0x560f824c3380 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46458/0 (socket says 172.21.15.22:46458) 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 -- 172.21.15.22:0/4222286112 learned_addr learned my addr 172.21.15.22:0/4222286112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 -- 172.21.15.22:0/4222286112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 msgr2=0x560f824cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9342781640 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 0x560f824e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 -- 172.21.15.22:0/4222286112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 msgr2=0x560f824e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 0x560f824e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 -- 172.21.15.22:0/4222286112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f824e44a0 con 0x560f824c2a60 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9342781640 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 0x560f824e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.231+0000 7f9341f80640 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x560f824e4670 tx=0x7f932c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fffc1573fde1cae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93237fe640 1 -- 172.21.15.22:0/4222286112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c01ea10 con 0x560f824c2a60 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93237fe640 1 -- 172.21.15.22:0/4222286112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f932c005520 con 0x560f824c2a60 2024-09-11T22:35:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93237fe640 1 -- 172.21.15.22:0/4222286112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c004dd0 con 0x560f824c2a60 2024-09-11T22:35:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 -- 172.21.15.22:0/4222286112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 msgr2=0x560f824cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x560f824e4670 tx=0x7f932c004610 comp rx=0 tx=0).stop 2024-09-11T22:35:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 -- 172.21.15.22:0/4222286112 shutdown_connections 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d2150 0x560f824e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 --2- 172.21.15.22:0/4222286112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824c2a60 0x560f824cf920 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 -- 172.21.15.22:0/4222286112 >> 172.21.15.22:0/4222286112 conn(0x560f824bf0f0 msgr2=0x560f824cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 -- 172.21.15.22:0/4222286112 shutdown_connections 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.232+0000 7f93465bd740 1 -- 172.21.15.22:0/4222286112 wait complete. 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 -- start start 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 Processor -- start 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824da8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d6100 0x560f824d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f933c070d50 con 0x560f824d2150 2024-09-11T22:35:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0721c0 con 0x560f824d6100 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f933c071420 con 0x560f824c3380 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f93465bd740 10 client.0 _ll_register_callbacks cb 0x7f93300f2e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f934177f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f934177f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46464/0 (socket says 172.21.15.22:46464) 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f934177f640 1 -- 172.21.15.22:0/2078096299 learned_addr learned my addr 172.21.15.22:0/2078096299 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f9342781640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d6100 0x560f824d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.233+0000 7f9341f80640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824da8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 -- 172.21.15.22:0/2078096299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 msgr2=0x560f824da8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824da8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 -- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d6100 msgr2=0x560f824d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d6100 0x560f824d6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 -- 172.21.15.22:0/2078096299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f8254b7d0 con 0x560f824d2150 2024-09-11T22:35:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f9341f80640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824da8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f934177f640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f93300b83b0 tx=0x7f9330009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a4c702f3795de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330049040 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f93300ece90 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f932c005520 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f93300bb520 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93465bd740 10 client.16602 fetch_fsmap learned FSMap version 22 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560f8254ca60 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f932c005520 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.234+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f93300bbc40 con 0x560f824d2150 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 10 client.16602 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:35:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 20 client.16602 populate_metadata read hostname 'smithi022' 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f8254d260 0x560f8254f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 4 client.16602 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f8242fd00 con 0x560f8254d260 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f9341f80640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f8254d260 0x560f8254f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f9341f80640 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f8254d260 0x560f8254f680 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fdeb510ad086c42 server_cookie=9fae77e1efc9bcaa in_seq=0 out_seq=0 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.235+0000 7f93217fa640 10 client.16602 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93217fa640 1 -- 172.21.15.22:0/2078096299 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f8242fd00 con 0x560f8254d260 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93217fa640 10 client.16602 handle_command_reply: tid=0 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 client.16602 shutdown 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 msgr2=0x560f824d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f93300b83b0 tx=0x7f9330009620 comp rx=0 tx=0).stop 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 shutdown_connections 2024-09-11T22:35:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560f8254d260 0x560f8254f680 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f824d6100 0x560f824d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560f824d2150 0x560f824d5bc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 --2- 172.21.15.22:0/2078096299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f824c3380 0x560f824da8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93217fa640 0 client.16602 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.236+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 >> 172.21.15.22:0/2078096299 conn(0x560f824bf0f0 msgr2=0x560f824be270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 shutdown_connections 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93465bd740 1 -- 172.21.15.22:0/2078096299 wait complete. 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93465bd740 20 client.16602 trim_cache size 0 max 16384 2024-09-11T22:35:59.242 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "6c04a05f-758b-47be-aa45-6db3189e3b02", 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 msgr2=0x7f93240a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 0x7f93240a5230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x560f824c5750 tx=0x7f932c00b390 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 msgr2=0x7f933c198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9330006010 tx=0x7f93300042f0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 shutdown_connections 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f93240a2d70 0x7f93240a5230 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f933c10c170 0x7f933c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f933c103660 0x7f933c198ab0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 --2- 172.21.15.22:0/1588299156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f933c102d40 0x7f933c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 >> 172.21.15.22:0/1588299156 conn(0x7f933c0fc7a0 msgr2=0x7f933c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 shutdown_connections 2024-09-11T22:35:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:35:59.237+0000 7f93441e4640 1 -- 172.21.15.22:0/1588299156 wait complete. 2024-09-11T22:35:59.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:36:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:00.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:00 smithi022 ceph-mon[30966]: pgmap v212: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:00.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:00 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:36:00.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:00 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:00 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:36:00.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:00 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:00 smithi169 ceph-mon[35628]: pgmap v212: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:00.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:00 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:36:00.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:00 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:00 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:36:00.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:00 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:00 smithi045 ceph-mon[35556]: pgmap v212: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:00.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:00 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:36:00.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:00 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:00 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:36:00.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:00 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:00.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 -- 172.21.15.22:0/4092705814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 msgr2=0x7f1284106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4092705814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f1284106e60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1274009930 tx=0x7f127402a420 comp rx=0 tx=0).stop 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 -- 172.21.15.22:0/4092705814 shutdown_connections 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4092705814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284101420 0x7f128410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4092705814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284100a80 0x7f1284100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4092705814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f1284106e60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 -- 172.21.15.22:0/4092705814 >> 172.21.15.22:0/4092705814 conn(0x7f12840fc7a0 msgr2=0x7f12840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 -- 172.21.15.22:0/4092705814 shutdown_connections 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 -- 172.21.15.22:0/4092705814 wait complete. 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.682+0000 7f1288b2f640 1 Processor -- start 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 -- start start 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284100a80 0x7f12841985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284101420 0x7f1284198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1284110fa0 con 0x7f1284106a80 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1284110e20 con 0x7f1284100a80 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1288b2f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111120 con 0x7f1284101420 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46490/0 (socket says 172.21.15.22:46490) 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 -- 172.21.15.22:0/4134544239 learned_addr learned my addr 172.21.15.22:0/4134544239 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1281d9b640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284101420 0x7f1284198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f128259c640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284100a80 0x7f12841985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 -- 172.21.15.22:0/4134544239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284101420 msgr2=0x7f1284198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284101420 0x7f1284198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 -- 172.21.15.22:0/4134544239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284100a80 msgr2=0x7f12841985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284100a80 0x7f12841985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 -- 172.21.15.22:0/4134544239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128419d560 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.683+0000 7f1282d9d640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f127c00eaa0 tx=0x7f127c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.684+0000 7f12737fe640 1 -- 172.21.15.22:0/4134544239 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c00cdb0 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.684+0000 7f12737fe640 1 -- 172.21.15.22:0/4134544239 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f127c004b20 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.684+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128419d850 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.684+0000 7f12737fe640 1 -- 172.21.15.22:0/4134544239 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c011760 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.684+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841a5130 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.686+0000 7f12737fe640 1 -- 172.21.15.22:0/4134544239 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f127c004cd0 con 0x7f1284106a80 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.686+0000 7f128af08740 1 Processor -- start 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 -- start start 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d683bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683c1d0 0x55b1d6846550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b1d679d2e0 con 0x55b1d6846a90 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b1d6744ce0 con 0x55b1d683c1d0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128af08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1d67992a0 con 0x55b1d683b8b0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f12737fe640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 0x7f126c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f128259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683c1d0 0x55b1d6846550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46500/0 (socket says 172.21.15.22:46500) 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 -- 172.21.15.22:0/3615228147 learned_addr learned my addr 172.21.15.22:0/3615228147 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1282d9d640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 0x7f126c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d683bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f12737fe640 1 -- 172.21.15.22:0/4134544239 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f127c0cf610 con 0x7f1284106a80 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 -- 172.21.15.22:0/3615228147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 msgr2=0x55b1d683bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d683bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 -- 172.21.15.22:0/3615228147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683c1d0 msgr2=0x55b1d6846550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683c1d0 0x55b1d6846550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.687+0000 7f1281d9b640 1 -- 172.21.15.22:0/3615228147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d6729440 con 0x55b1d6846a90 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.688+0000 7f1281d9b640 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1278012520 tx=0x7f127800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98f74056bda1bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.688+0000 7f1282d9d640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 0x7f126c0a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f127c09bb10 tx=0x7f127c0c6710 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.688+0000 7f1270ff9640 1 -- 172.21.15.22:0/3615228147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278004250 con 0x55b1d6846a90 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.688+0000 7f1270ff9640 1 -- 172.21.15.22:0/3615228147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12780043f0 con 0x55b1d6846a90 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.688+0000 7f1270ff9640 1 -- 172.21.15.22:0/3615228147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12780035f0 con 0x55b1d6846a90 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- 172.21.15.22:0/3615228147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 msgr2=0x55b1d6848e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1278012520 tx=0x7f127800b870 comp rx=0 tx=0).stop 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- 172.21.15.22:0/3615228147 shutdown_connections 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6848e80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683c1d0 0x55b1d6846550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- 172.21.15.22:0/3615228147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d683bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- 172.21.15.22:0/3615228147 >> 172.21.15.22:0/3615228147 conn(0x55b1d6837e40 msgr2=0x55b1d6838220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- 172.21.15.22:0/3615228147 shutdown_connections 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- 172.21.15.22:0/3615228147 wait complete. 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- start start 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 Processor -- start 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d6846430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 0x55b1d6843c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b1d6849660 con 0x55b1d683c1d0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.689+0000 7f128af08740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b1d6758050 con 0x55b1d6846a90 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128af08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1d68497e0 con 0x55b1d683b8b0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128af08740 10 client.0 _ll_register_callbacks cb 0x55b1d6798160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46516/0 (socket says 172.21.15.22:46516) 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 -- 172.21.15.22:0/1573682018 learned_addr learned my addr 172.21.15.22:0/1573682018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 0x55b1d6843c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d6846430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 -- 172.21.15.22:0/1573682018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 msgr2=0x55b1d6846430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d6846430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 -- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 msgr2=0x55b1d6843c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 0x55b1d6843c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 -- 172.21.15.22:0/1573682018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d650e3c0 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 0x55b1d6843c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128259c640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f127402a940 tx=0x7f1274031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4807887c2d063853 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274035040 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f1274004240 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12780043f0 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1274004440 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128af08740 10 client.16614 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.690+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b1d6855070 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12780043f0 con 0x55b1d683c1d0 2024-09-11T22:36:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f1274004bf0 con 0x55b1d683c1d0 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 10 client.16614 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 20 client.16614 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d6856480 0x55b1d68588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 4 client.16614 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1d67aa850 con 0x55b1d6856480 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.691+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d6856480 0x55b1d68588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f1269ffb640 10 client.16614 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d6856480 0x55b1d68588e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e87ed27c1dd789 server_cookie=1128508696dc6da1 in_seq=0 out_seq=0 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f1269ffb640 1 -- 172.21.15.22:0/1573682018 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1d67aa850 con 0x55b1d6856480 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f1269ffb640 10 client.16614 handle_command_reply: tid=0 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 client.16614 shutdown 2024-09-11T22:36:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 msgr2=0x55b1d68436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f127402a940 tx=0x7f1274031870 comp rx=0 tx=0).stop 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 shutdown_connections 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d6856480 0x55b1d68588e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d6846a90 0x55b1d6843c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d683c1d0 0x55b1d68436e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 --2- 172.21.15.22:0/1573682018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683b8b0 0x55b1d6846430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f1269ffb640 0 client.16614 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.692+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 >> 172.21.15.22:0/1573682018 conn(0x55b1d6837e40 msgr2=0x55b1d6832b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.693+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 shutdown_connections 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.693+0000 7f128af08740 1 -- 172.21.15.22:0/1573682018 wait complete. 2024-09-11T22:36:00.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.693+0000 7f128af08740 20 client.16614 trim_cache size 0 max 16384 2024-09-11T22:36:00.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 Processor -- start 2024-09-11T22:36:00.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 -- start start 2024-09-11T22:36:00.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d683ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d68528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f12841a96a0 con 0x55b1d6846a90 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f12841abf00 con 0x55b1d683b8b0 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128af08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12841a9cf0 con 0x55b1d683c1d0 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46522/0 (socket says 172.21.15.22:46522) 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 -- 172.21.15.22:0/4196575671 learned_addr learned my addr 172.21.15.22:0/4196575671 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d683ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f128259c640 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d68528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 -- 172.21.15.22:0/4196575671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 msgr2=0x55b1d68528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d68528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 -- 172.21.15.22:0/4196575671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 msgr2=0x55b1d683ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d683ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.710+0000 7f1281d9b640 1 -- 172.21.15.22:0/4196575671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d6858f60 con 0x55b1d6846a90 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f1281d9b640 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1278012e70 tx=0x7f1278004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf2826760d76809 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f126bfff640 1 -- 172.21.15.22:0/4196575671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278029040 con 0x55b1d6846a90 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f126bfff640 1 -- 172.21.15.22:0/4196575671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f127802fac0 con 0x55b1d6846a90 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f126bfff640 1 -- 172.21.15.22:0/4196575671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278005290 con 0x55b1d6846a90 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 -- 172.21.15.22:0/4196575671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 msgr2=0x55b1d685e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1278012e70 tx=0x7f1278004b30 comp rx=0 tx=0).stop 2024-09-11T22:36:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 -- 172.21.15.22:0/4196575671 shutdown_connections 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d685e1b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d68528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 --2- 172.21.15.22:0/4196575671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d683ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 -- 172.21.15.22:0/4196575671 >> 172.21.15.22:0/4196575671 conn(0x55b1d6837e40 msgr2=0x55b1d6845760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 -- 172.21.15.22:0/4196575671 shutdown_connections 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.711+0000 7f128af08740 1 -- 172.21.15.22:0/4196575671 wait complete. 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 -- start start 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 Processor -- start 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d68405e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d6840b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f12841aa3c0 con 0x55b1d6846a90 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ab830 con 0x55b1d683b8b0 2024-09-11T22:36:00.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12841aaa90 con 0x55b1d683c1d0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128af08740 10 client.0 _ll_register_callbacks cb 0x7f12740314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f1281d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46524/0 (socket says 172.21.15.22:46524) 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f1281d9b640 1 -- 172.21.15.22:0/1433902591 learned_addr learned my addr 172.21.15.22:0/1433902591 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f128259c640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d6840b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.712+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d68405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 -- 172.21.15.22:0/1433902591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 msgr2=0x55b1d6840b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d6840b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 -- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 msgr2=0x55b1d68405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d68405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 -- 172.21.15.22:0/1433902591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d68c0180 con 0x55b1d6846a90 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1281d9b640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1278004ac0 tx=0x7f1278021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f20cc2fc7f8fe0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278004ba0 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8440+0+0 (secure 0 0 0) 0x7f127802f3c0 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f127802fac0 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f127802f5c0 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f128af08740 10 client.16620 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b1d68c1340 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f127802fac0 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.713+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f1278010560 con 0x55b1d6846a90 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 10 client.16620 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 20 client.16620 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d68c1710 0x55b1d68c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 4 client.16620 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1d67a4d60 con 0x55b1d68c1710 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128259c640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d68c1710 0x55b1d68c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f1269ffb640 10 client.16620 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128259c640 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d68c1710 0x55b1d68c3b00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e1cdcfbd984fe5 server_cookie=1ebed1a1886ee005 in_seq=0 out_seq=0 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f1269ffb640 1 -- 172.21.15.22:0/1433902591 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b1d67a4d60 con 0x55b1d68c1710 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f1269ffb640 10 client.16620 handle_command_reply: tid=0 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.714+0000 7f128af08740 1 client.16620 shutdown 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 msgr2=0x55b1d6841060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1278004ac0 tx=0x7f1278021040 comp rx=0 tx=0).stop 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 shutdown_connections 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b1d68c1710 0x55b1d68c3b00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b1d6846a90 0x55b1d6841060 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1d683c1d0 0x55b1d6840b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 --2- 172.21.15.22:0/1433902591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1d683b8b0 0x55b1d68405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 >> 172.21.15.22:0/1433902591 conn(0x55b1d6837e40 msgr2=0x55b1d6841e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f1269ffb640 0 client.16620 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 shutdown_connections 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 1 -- 172.21.15.22:0/1433902591 wait complete. 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f128af08740 20 client.16620 trim_cache size 0 max 16384 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:36:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "6c04a05f-758b-47be-aa45-6db3189e3b02": { 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "6c04a05f-758b-47be-aa45-6db3189e3b02", 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:36:00.730 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 msgr2=0x7f126c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 0x7f126c0a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f127c09bb10 tx=0x7f127c0c6710 comp rx=0 tx=0).stop 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.715+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 msgr2=0x7f128419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f127c00eaa0 tx=0x7f127c00ef60 comp rx=0 tx=0).stop 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 shutdown_connections 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f126c0a2cf0 0x7f126c0a51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1284106a80 0x7f128419ce80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1284101420 0x7f1284198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 --2- 172.21.15.22:0/4134544239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1284100a80 0x7f12841985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 >> 172.21.15.22:0/4134544239 conn(0x7f12840fc7a0 msgr2=0x7f128406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 shutdown_connections 2024-09-11T22:36:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:00.716+0000 7f1288b2f640 1 -- 172.21.15.22:0/4134544239 wait complete. 2024-09-11T22:36:01.400 INFO:tasks.cephfs.filesystem:scrub status for tag:6c04a05f-758b-47be-aa45-6db3189e3b02 - {'path': '/', 'tag': '6c04a05f-758b-47be-aa45-6db3189e3b02', 'options': 'recursive,force'} 2024-09-11T22:36:02.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:02 smithi022 ceph-mon[30966]: pgmap v213: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:02.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:02 smithi169 ceph-mon[35628]: pgmap v213: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:02.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:02 smithi045 ceph-mon[35556]: pgmap v213: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:04 smithi022 ceph-mon[30966]: pgmap v214: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:04 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:36:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:04 smithi169 ceph-mon[35628]: pgmap v214: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:04.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:04 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:36:04.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:04 smithi045 ceph-mon[35556]: pgmap v214: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:04.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:04 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:36:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:05 smithi022 ceph-mon[30966]: pgmap v215: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:05.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:05 smithi169 ceph-mon[35628]: pgmap v215: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:05.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:05 smithi045 ceph-mon[35556]: pgmap v215: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:07.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:07 smithi022 ceph-mon[30966]: pgmap v216: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:36:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:07 smithi169 ceph-mon[35628]: pgmap v216: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:36:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:07 smithi045 ceph-mon[35556]: pgmap v216: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:36:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:09 smithi022 ceph-mon[30966]: pgmap v217: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:09 smithi169 ceph-mon[35628]: pgmap v217: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:09 smithi045 ceph-mon[35556]: pgmap v217: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:36:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:10 smithi022 ceph-mon[30966]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:36:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:10 smithi169 ceph-mon[35628]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:36:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:10 smithi045 ceph-mon[35556]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:36:11.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:11 smithi022 ceph-mon[30966]: pgmap v219: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:11.915 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:11 smithi169 ceph-mon[35628]: pgmap v219: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:11.916 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:11 smithi045 ceph-mon[35556]: pgmap v219: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:13.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:13 smithi022 ceph-mon[30966]: pgmap v220: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:13 smithi169 ceph-mon[35628]: pgmap v220: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:13 smithi045 ceph-mon[35556]: pgmap v220: 97 pgs: 97 active+clean; 131 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:36:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:14 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:14 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:14 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:15 smithi022 ceph-mon[30966]: pgmap v221: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:36:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:15 smithi169 ceph-mon[35628]: pgmap v221: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:36:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:15 smithi045 ceph-mon[35556]: pgmap v221: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:36:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:17 smithi022 ceph-mon[30966]: pgmap v222: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:17.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:17 smithi169 ceph-mon[35628]: pgmap v222: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:17.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:17 smithi045 ceph-mon[35556]: pgmap v222: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:19 smithi022 ceph-mon[30966]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:36:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:19 smithi022 ceph-mon[30966]: pgmap v224: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T22:36:19.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:19 smithi169 ceph-mon[35628]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:36:19.653 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:19 smithi169 ceph-mon[35628]: pgmap v224: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T22:36:19.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:19 smithi045 ceph-mon[35556]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:36:19.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:19 smithi045 ceph-mon[35556]: pgmap v224: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T22:36:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:21 smithi022 ceph-mon[30966]: pgmap v225: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:21.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:21 smithi169 ceph-mon[35628]: pgmap v225: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:21 smithi045 ceph-mon[35556]: pgmap v225: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:23 smithi022 ceph-mon[30966]: pgmap v226: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:23 smithi169 ceph-mon[35628]: pgmap v226: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:23 smithi045 ceph-mon[35556]: pgmap v226: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:36:25.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:25 smithi022 ceph-mon[30966]: pgmap v227: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:25 smithi169 ceph-mon[35628]: pgmap v227: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:25 smithi045 ceph-mon[35556]: pgmap v227: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:27.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:27 smithi022 ceph-mon[30966]: pgmap v228: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:27.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:27 smithi169 ceph-mon[35628]: pgmap v228: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:27 smithi045 ceph-mon[35556]: pgmap v228: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:36:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:29 smithi022 ceph-mon[30966]: pgmap v229: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:36:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:29 smithi169 ceph-mon[35628]: pgmap v229: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:36:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:29 smithi045 ceph-mon[35556]: pgmap v229: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:36:31.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:36:31.678 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:31.799 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:31 smithi022 ceph-mon[30966]: pgmap v230: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:31 smithi169 ceph-mon[35628]: pgmap v230: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:31 smithi045 ceph-mon[35556]: pgmap v230: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 -- 172.21.15.22:0/2282499972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec102790 msgr2=0x7f4fec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/2282499972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec102790 0x7f4fec1067e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc02a410 comp rx=0 tx=0).stop 2024-09-11T22:36:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 -- 172.21.15.22:0/2282499972 shutdown_connections 2024-09-11T22:36:32.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/2282499972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec106f10 0x7f4fec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/2282499972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec102790 0x7f4fec1067e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/2282499972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec101de0 0x7f4fec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.173+0000 7f4ff3d40640 1 -- 172.21.15.22:0/2282499972 >> 172.21.15.22:0/2282499972 conn(0x7f4fec0fd8c0 msgr2=0x7f4fec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- 172.21.15.22:0/2282499972 shutdown_connections 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- 172.21.15.22:0/2282499972 wait complete. 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 Processor -- start 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- start start 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec102790 0x7f4fec198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec106f10 0x7f4fec19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec112090 con 0x7f4fec101de0 2024-09-11T22:36:32.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec111f10 con 0x7f4fec102790 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.174+0000 7f4ff3d40640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec112210 con 0x7f4fec106f10 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54008/0 (socket says 172.21.15.22:54008) 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 -- 172.21.15.22:0/519698949 learned_addr learned my addr 172.21.15.22:0/519698949 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff12db640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec102790 0x7f4fec198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec106f10 0x7f4fec19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 -- 172.21.15.22:0/519698949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec106f10 msgr2=0x7f4fec19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec106f10 0x7f4fec19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 -- 172.21.15.22:0/519698949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec102790 msgr2=0x7f4fec198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec102790 0x7f4fec198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 -- 172.21.15.22:0/519698949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec19d4a0 con 0x7f4fec101de0 2024-09-11T22:36:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d770 tx=0x7f4fe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4fe2ffd640 1 -- 172.21.15.22:0/519698949 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8017070 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec19d790 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4fe2ffd640 1 -- 172.21.15.22:0/519698949 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fe8005520 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4fe2ffd640 1 -- 172.21.15.22:0/519698949 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8010460 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.175+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec1a5070 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4fe2ffd640 1 -- 172.21.15.22:0/519698949 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4fe8004ea0 con 0x7f4fec101de0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 Processor -- start 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 -- start start 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef74550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 0x555f0ef76e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555f0eecb2e0 con 0x555f0ef698b0 2024-09-11T22:36:32.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0ee72ce0 con 0x555f0ef74a90 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.178+0000 7f4ff6119740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f0eec72a0 con 0x555f0ef6a1d0 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54022/0 (socket says 172.21.15.22:54022) 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 -- 172.21.15.22:0/2444649616 learned_addr learned my addr 172.21.15.22:0/2444649616 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef74550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4fe2ffd640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 0x7f4fd80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff12db640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 0x555f0ef76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 -- 172.21.15.22:0/2444649616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 msgr2=0x555f0ef74550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef74550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 -- 172.21.15.22:0/2444649616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 msgr2=0x555f0ef76e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 0x555f0ef76e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 -- 172.21.15.22:0/2444649616 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0ee57440 con 0x555f0ef698b0 2024-09-11T22:36:32.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff12db640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 0x555f0ef76e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 0x7f4fd80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4fe2ffd640 1 -- 172.21.15.22:0/519698949 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f4fe80ceeb0 con 0x7f4fec101de0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4010440 tx=0x7f4fe4010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a054ea9dcc9d1bad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.179+0000 7f4fd7fff640 1 -- 172.21.15.22:0/2444649616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe401d400 con 0x555f0ef698b0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4fd7fff640 1 -- 172.21.15.22:0/2444649616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fe401daa0 con 0x555f0ef698b0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4fd7fff640 1 -- 172.21.15.22:0/2444649616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe401c940 con 0x555f0ef698b0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 -- 172.21.15.22:0/2444649616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 msgr2=0x555f0ef69c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 0x7f4fd80a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4021000 tx=0x7f4fe401e000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4010440 tx=0x7f4fe4010900 comp rx=0 tx=0).stop 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 -- 172.21.15.22:0/2444649616 shutdown_connections 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef74a90 0x555f0ef76e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef74550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 --2- 172.21.15.22:0/2444649616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef698b0 0x555f0ef69c90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 -- 172.21.15.22:0/2444649616 >> 172.21.15.22:0/2444649616 conn(0x555f0ef65e40 msgr2=0x555f0ef66220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 -- 172.21.15.22:0/2444649616 shutdown_connections 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.180+0000 7f4ff6119740 1 -- 172.21.15.22:0/2444649616 wait complete. 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 -- start start 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 Processor -- start 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef698b0 0x555f0ef74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef6a1d0 0x555f0ef71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555f0ef77660 con 0x555f0ef74a90 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0ee86050 con 0x555f0ef6a1d0 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f0ef777e0 con 0x555f0ef698b0 2024-09-11T22:36:32.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff6119740 10 client.0 _ll_register_callbacks cb 0x555f0eec6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54026/0 (socket says 172.21.15.22:54026) 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff22dd640 1 -- 172.21.15.22:0/371879210 learned_addr learned my addr 172.21.15.22:0/371879210 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.181+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef698b0 0x555f0ef74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff12db640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef6a1d0 0x555f0ef71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 -- 172.21.15.22:0/371879210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef698b0 msgr2=0x555f0ef74360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef698b0 0x555f0ef74360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 -- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef6a1d0 msgr2=0x555f0ef71610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef6a1d0 0x555f0ef71610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 -- 172.21.15.22:0/371879210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0ec3c3c0 con 0x555f0ef74a90 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4fe401c560 tx=0x7f4fe401ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cfebd161c6c25e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:32.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40134c0 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f4fe401c950 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe401daa0 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4fe4003970 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff6119740 10 client.16632 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555f0ef82fb0 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fe401daa0 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.182+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f4fe400f040 con 0x555f0ef74a90 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 10 client.16632 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 20 client.16632 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0ef84360 0x555f0ef86750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 4 client.16632 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:32.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f0eed8850 con 0x555f0ef84360 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0ef84360 0x555f0ef86750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4fd57fa640 10 client.16632 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.183+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0ef84360 0x555f0ef86750 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819cdc2fbc0644b9 server_cookie=66fd9c498c4a7ba2 in_seq=0 out_seq=0 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4fd57fa640 1 -- 172.21.15.22:0/371879210 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f0eed8850 con 0x555f0ef84360 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4fd57fa640 10 client.16632 handle_command_reply: tid=0 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 client.16632 shutdown 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 msgr2=0x555f0ef71b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4fe401c560 tx=0x7f4fe401ce70 comp rx=0 tx=0).stop 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 shutdown_connections 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0ef84360 0x555f0ef86750 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef71b50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef6a1d0 0x555f0ef71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 --2- 172.21.15.22:0/371879210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef698b0 0x555f0ef74360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4fd57fa640 0 client.16632 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.184+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 >> 172.21.15.22:0/371879210 conn(0x555f0ef65e40 msgr2=0x555f0ef60b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.185+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 shutdown_connections 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.185+0000 7f4ff6119740 1 -- 172.21.15.22:0/371879210 wait complete. 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.185+0000 7f4ff6119740 20 client.16632 trim_cache size 0 max 16384 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 Processor -- start 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 -- start start 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef73690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1a9730 con 0x555f0ef74a90 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1abf90 con 0x555f0ef698b0 2024-09-11T22:36:32.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff6119740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1a9d80 con 0x555f0ef6a1d0 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54036/0 (socket says 172.21.15.22:54036) 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 -- 172.21.15.22:0/3674795309 learned_addr learned my addr 172.21.15.22:0/3674795309 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 -- 172.21.15.22:0/3674795309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 msgr2=0x555f0ef73690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 -- 172.21.15.22:0/3674795309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 msgr2=0x555f0ef808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef808c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.202+0000 7f4ff22dd640 1 -- 172.21.15.22:0/3674795309 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0ef6a000 con 0x555f0ef74a90 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005130 tx=0x7f4fe401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375c4d78bc540c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4fd77fe640 1 -- 172.21.15.22:0/3674795309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4009a00 con 0x555f0ef74a90 2024-09-11T22:36:32.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4fd77fe640 1 -- 172.21.15.22:0/3674795309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fe402b050 con 0x555f0ef74a90 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4fd77fe640 1 -- 172.21.15.22:0/3674795309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40057a0 con 0x555f0ef74a90 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 -- 172.21.15.22:0/3674795309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 msgr2=0x555f0ef8be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005130 tx=0x7f4fe401c610 comp rx=0 tx=0).stop 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 -- 172.21.15.22:0/3674795309 shutdown_connections 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef74a90 0x555f0ef8be90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef6a1d0 0x555f0ef73690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 --2- 172.21.15.22:0/3674795309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 -- 172.21.15.22:0/3674795309 >> 172.21.15.22:0/3674795309 conn(0x555f0ef65e40 msgr2=0x555f0ef6cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 -- 172.21.15.22:0/3674795309 shutdown_connections 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.203+0000 7f4ff6119740 1 -- 172.21.15.22:0/3674795309 wait complete. 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 -- start start 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 Processor -- start 2024-09-11T22:36:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef7cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef74a90 0x555f0ef75810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1aa450 con 0x555f0ef6a1d0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1ab8c0 con 0x555f0ef698b0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec1aab20 con 0x555f0ef74a90 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff6119740 10 client.0 _ll_register_callbacks cb 0x7f4fe4020020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff12db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff12db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54042/0 (socket says 172.21.15.22:54042) 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff12db640 1 -- 172.21.15.22:0/361860516 learned_addr learned my addr 172.21.15.22:0/361860516 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff22dd640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef74a90 0x555f0ef75810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.204+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef7cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 -- 172.21.15.22:0/361860516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef74a90 msgr2=0x555f0ef75810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef74a90 0x555f0ef75810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 -- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 msgr2=0x555f0ef7cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef7cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 -- 172.21.15.22:0/361860516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0ef76010 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff12db640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a6725b04a3f2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4fd57fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc035040 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f4fdc004450 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe402b050 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc005020 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff6119740 10 client.16638 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.205+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555f0ef7c850 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fe402b050 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f4fdc04c070 con 0x555f0ef6a1d0 2024-09-11T22:36:32.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 10 client.16638 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 20 client.16638 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:36:32.356 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0efef360 0x555f0eff1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 4 client.16638 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f0eed2d60 con 0x555f0efef360 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0efef360 0x555f0eff1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4fd57fa640 10 client.16638 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.206+0000 7f4ff1adc640 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0efef360 0x555f0eff1780 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efa2b6e008a144b1 server_cookie=ba228b48fb456a38 in_seq=0 out_seq=0 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4fd57fa640 1 -- 172.21.15.22:0/361860516 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555f0eed2d60 con 0x555f0efef360 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4fd57fa640 10 client.16638 handle_command_reply: tid=0 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 client.16638 shutdown 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 msgr2=0x555f0ef7d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc031870 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 shutdown_connections 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f0efef360 0x555f0eff1780 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f0ef74a90 0x555f0ef75810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f0ef6a1d0 0x555f0ef7d2f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 --2- 172.21.15.22:0/361860516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0ef698b0 0x555f0ef7cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4fd57fa640 0 client.16638 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 >> 172.21.15.22:0/361860516 conn(0x555f0ef65e40 msgr2=0x555f0ef60b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 shutdown_connections 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 1 -- 172.21.15.22:0/361860516 wait complete. 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff6119740 20 client.16638 trim_cache size 0 max 16384 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 msgr2=0x7f4fd80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 0x7f4fd80a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4021000 tx=0x7f4fe401e000 comp rx=0 tx=0).stop 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 msgr2=0x7f4fec1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:32.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d770 tx=0x7f4fe800dc30 comp rx=0 tx=0).stop 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 shutdown_connections 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4fd80a2cf0 0x7f4fd80a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.207+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fec106f10 0x7f4fec19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.208+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fec102790 0x7f4fec198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.208+0000 7f4ff3d40640 1 --2- 172.21.15.22:0/519698949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fec101de0 0x7f4fec1984f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.208+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 >> 172.21.15.22:0/519698949 conn(0x7f4fec0fd8c0 msgr2=0x7f4fec0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.208+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 shutdown_connections 2024-09-11T22:36:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:32.208+0000 7f4ff3d40640 1 -- 172.21.15.22:0/519698949 wait complete. 2024-09-11T22:36:33.156 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:36:33.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:36:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:33.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:33 smithi022 ceph-mon[30966]: pgmap v231: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 -- 172.21.15.22:0/2780849390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11741036c0 msgr2=0x7f117410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 --2- 172.21.15.22:0/2780849390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11741036c0 0x7f117410bbb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1168009900 tx=0x7f116802a480 comp rx=0 tx=0).stop 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 -- 172.21.15.22:0/2780849390 shutdown_connections 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 --2- 172.21.15.22:0/2780849390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 0x7f117410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 --2- 172.21.15.22:0/2780849390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11741036c0 0x7f117410bbb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 --2- 172.21.15.22:0/2780849390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1174102da0 0x7f1174103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 -- 172.21.15.22:0/2780849390 >> 172.21.15.22:0/2780849390 conn(0x7f11740fc7a0 msgr2=0x7f11740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 -- 172.21.15.22:0/2780849390 shutdown_connections 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.854+0000 7f11791bc640 1 -- 172.21.15.22:0/2780849390 wait complete. 2024-09-11T22:36:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 Processor -- start 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 -- start start 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11741036c0 0x7f1174100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 0x7f1174101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1174112080 con 0x7f1174102da0 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1174111f00 con 0x7f11741036c0 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f11791bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1174112200 con 0x7f117410c180 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f1172d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f1172d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54062/0 (socket says 172.21.15.22:54062) 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.855+0000 7f1172d9d640 1 -- 172.21.15.22:0/2137074947 learned_addr learned my addr 172.21.15.22:0/2137074947 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f117259c640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11741036c0 0x7f1174100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:33.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f117359e640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 0x7f1174101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 -- 172.21.15.22:0/2137074947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 msgr2=0x7f1174101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 0x7f1174101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 -- 172.21.15.22:0/2137074947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11741036c0 msgr2=0x7f1174100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11741036c0 0x7f1174100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 -- 172.21.15.22:0/2137074947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11741a6990 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f1172d9d640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f116400d950 tx=0x7f116400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164017030 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1164004020 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164004a00 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11741a6c80 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.856+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11741a7140 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.858+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1174103180 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.859+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1164004ba0 con 0x7f1174102da0 2024-09-11T22:36:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.860+0000 7f115bfff640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 0x7f115c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.860+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f11640cedf0 con 0x7f1174102da0 2024-09-11T22:36:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.860+0000 7f117259c640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 0x7f115c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.860+0000 7f117259c640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 0x7f115c0a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1168009230 tx=0x7f11680058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:33.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:33.864+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f116409b9d0 con 0x7f1174102da0 2024-09-11T22:36:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:33 smithi169 ceph-mon[35628]: pgmap v231: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:33 smithi045 ceph-mon[35556]: pgmap v231: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.078+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1174101f30 con 0x7f1174102da0 2024-09-11T22:36:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.079+0000 7f115bfff640 1 -- 172.21.15.22:0/2137074947 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f116409b2d0 con 0x7f1174102da0 2024-09-11T22:36:34.080 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:36:34.080 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:36:34.080 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 msgr2=0x7f115c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 0x7f115c0a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1168009230 tx=0x7f11680058d0 comp rx=0 tx=0).stop 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 msgr2=0x7f1174100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f116400d950 tx=0x7f116400de10 comp rx=0 tx=0).stop 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 shutdown_connections 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f115c0a2cf0 0x7f115c0a51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:34.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f117410c180 0x7f1174101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11741036c0 0x7f1174100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 --2- 172.21.15.22:0/2137074947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1174102da0 0x7f1174100a00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 >> 172.21.15.22:0/2137074947 conn(0x7f11740fc7a0 msgr2=0x7f11740fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 shutdown_connections 2024-09-11T22:36:34.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:34.081+0000 7f11791bc640 1 -- 172.21.15.22:0/2137074947 wait complete. 2024-09-11T22:36:34.785 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:34 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2137074947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:34.804 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:34 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2137074947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:34.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:36:34.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:34 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2137074947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2910239753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 msgr2=0x7f31c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2910239753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c81021c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009900 tx=0x7f31b802a410 comp rx=0 tx=0).stop 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2910239753 shutdown_connections 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2910239753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2910239753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 0x7f31c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2910239753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c81021c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2910239753 >> 172.21.15.22:0/2910239753 conn(0x7f31c80fd8c0 msgr2=0x7f31c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2910239753 shutdown_connections 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2910239753 wait complete. 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.672+0000 7f31ce9e4640 1 Processor -- start 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 -- start start 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 0x7f31c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8112120 con 0x7f31c8101de0 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111fa0 con 0x7f31c8102790 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ce9e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81122a0 con 0x7f31c8106f10 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49720/0 (socket says 172.21.15.22:49720) 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 -- 172.21.15.22:0/2545876967 learned_addr learned my addr 172.21.15.22:0/2545876967 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31bffff640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 0x7f31c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 -- 172.21.15.22:0/2545876967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 msgr2=0x7f31c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 -- 172.21.15.22:0/2545876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 msgr2=0x7f31c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 0x7f31c8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31c7fff640 1 -- 172.21.15.22:0/2545876967 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c81a6a20 con 0x7f31c8101de0 2024-09-11T22:36:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.673+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31c5ffb640 1 -- 172.21.15.22:0/2545876967 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b803f030 con 0x7f31c8101de0 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31c5ffb640 1 -- 172.21.15.22:0/2545876967 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b8003d00 con 0x7f31c8101de0 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c81a6cb0 con 0x7f31c8101de0 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31c5ffb640 1 -- 172.21.15.22:0/2545876967 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8035070 con 0x7f31c8101de0 2024-09-11T22:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.674+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a7190 con 0x7f31c8101de0 2024-09-11T22:36:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.676+0000 7f31c5ffb640 1 -- 172.21.15.22:0/2545876967 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f31b8042030 con 0x7f31c8101de0 2024-09-11T22:36:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.676+0000 7f31d0dbd740 1 Processor -- start 2024-09-11T22:36:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.676+0000 7f31d0dbd740 1 -- start start 2024-09-11T22:36:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c61370 0x565214c63760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x565214bbc2f0 con 0x565214c57b40 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565214b63cf0 con 0x565214c565d0 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565214bb82b0 con 0x565214c61370 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49726/0 (socket says 172.21.15.22:49726) 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 -- 172.21.15.22:0/3093168570 learned_addr learned my addr 172.21.15.22:0/3093168570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31c5ffb640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 0x7f31b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31c7fff640 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31bffff640 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c61370 0x565214c63760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 0x7f31b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 -- 172.21.15.22:0/3093168570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c61370 msgr2=0x565214c63760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c61370 0x565214c63760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 -- 172.21.15.22:0/3093168570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 msgr2=0x565214c56a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c56a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31ccf81640 1 -- 172.21.15.22:0/3093168570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565214b483a0 con 0x565214c57b40 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.677+0000 7f31c5ffb640 1 -- 172.21.15.22:0/2545876967 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f31b80ef9e0 con 0x7f31c8101de0 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31ccf81640 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f31c000cbf0 tx=0x7f31c0007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81550b4be75f3687 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31be7fc640 1 -- 172.21.15.22:0/3093168570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0015070 con 0x565214c57b40 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31be7fc640 1 -- 172.21.15.22:0/3093168570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31c0016040 con 0x565214c57b40 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31be7fc640 1 -- 172.21.15.22:0/3093168570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c001e020 con 0x565214c57b40 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 0x7f31b40a5230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31c001f000 tx=0x7f31c001b000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31d0dbd740 1 -- 172.21.15.22:0/3093168570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 msgr2=0x565214c56090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.678+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f31c000cbf0 tx=0x7f31c0007680 comp rx=0 tx=0).stop 2024-09-11T22:36:35.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- 172.21.15.22:0/3093168570 shutdown_connections 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c61370 0x565214c63760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/3093168570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c57b40 0x565214c56090 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- 172.21.15.22:0/3093168570 >> 172.21.15.22:0/3093168570 conn(0x565214c1f310 msgr2=0x565214c52c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- 172.21.15.22:0/3093168570 shutdown_connections 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- 172.21.15.22:0/3093168570 wait complete. 2024-09-11T22:36:35.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- start start 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 Processor -- start 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c5dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c5e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x565214c64070 con 0x565214c565d0 2024-09-11T22:36:35.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565214b77060 con 0x565214c61370 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.679+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565214c641f0 con 0x565214c57b40 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31d0dbd740 10 client.0 _ll_register_callbacks cb 0x5652148ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49738/0 (socket says 172.21.15.22:49738) 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 -- 172.21.15.22:0/1297768091 learned_addr learned my addr 172.21.15.22:0/1297768091 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31ccf81640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c5e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31bffff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c5dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 -- 172.21.15.22:0/1297768091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 msgr2=0x565214c5dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c5dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 -- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 msgr2=0x565214c5e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c5e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 -- 172.21.15.22:0/1297768091 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521492d3c0 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31bffff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c5dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31c7fff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b8890 tx=0x7f31b8032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5505bcd2834b75c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8049030 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f31b803bcb0 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31c0016040 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.680+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f31b80bb820 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 10 client.16656 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565214c6faa0 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31c0016040 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f31b80ed370 con 0x565214c565d0 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 10 client.16656 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:35.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 20 client.16656 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214c70e40 0x565214c73270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 4 client.16656 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565214bc9860 con 0x565214c70e40 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.681+0000 7f31bffff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214c70e40 0x565214c73270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31a77fe640 10 client.16656 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31bffff640 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214c70e40 0x565214c73270 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7e9d883d36c0d0 server_cookie=fd8fd17563c582b1 in_seq=0 out_seq=0 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31a77fe640 1 -- 172.21.15.22:0/1297768091 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565214bc9860 con 0x565214c70e40 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31a77fe640 10 client.16656 handle_command_reply: tid=0 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31d0dbd740 1 client.16656 shutdown 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 msgr2=0x565214c60d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.682+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b8890 tx=0x7f31b8032e90 comp rx=0 tx=0).stop 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 shutdown_connections 2024-09-11T22:36:35.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214c70e40 0x565214c73270 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c5e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c5dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/1297768091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c60d00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 >> 172.21.15.22:0/1297768091 conn(0x565214c1f310 msgr2=0x565214c58930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31a77fe640 0 client.16656 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 shutdown_connections 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 1 -- 172.21.15.22:0/1297768091 wait complete. 2024-09-11T22:36:35.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.683+0000 7f31d0dbd740 20 client.16656 trim_cache size 0 max 16384 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.695+0000 7f31d0dbd740 1 Processor -- start 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 -- start start 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c59120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c59660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81adab0 con 0x565214c565d0 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b0310 con 0x565214c61370 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ae100 con 0x565214c57b40 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49752/0 (socket says 172.21.15.22:49752) 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 -- 172.21.15.22:0/2101173120 learned_addr learned my addr 172.21.15.22:0/2101173120 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c59660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 -- 172.21.15.22:0/2101173120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 msgr2=0x565214c59120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c59120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 -- 172.21.15.22:0/2101173120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 msgr2=0x565214c59660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c59660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 -- 172.21.15.22:0/2101173120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565214c563f0 con 0x565214c565d0 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f31b80bbe50 tx=0x7f31b80ba3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ef9476fa3b91a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.696+0000 7f31bdffb640 1 -- 172.21.15.22:0/2101173120 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8049070 con 0x565214c565d0 2024-09-11T22:36:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31bdffb640 1 -- 172.21.15.22:0/2101173120 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b80bc5c0 con 0x565214c565d0 2024-09-11T22:36:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31bdffb640 1 -- 172.21.15.22:0/2101173120 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b80c4900 con 0x565214c565d0 2024-09-11T22:36:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2101173120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 msgr2=0x565214c6d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f31b80bbe50 tx=0x7f31b80ba3d0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2101173120 shutdown_connections 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c61370 0x565214c59660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c59120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2101173120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c565d0 0x565214c6d310 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2101173120 >> 172.21.15.22:0/2101173120 conn(0x565214c1f310 msgr2=0x565214c52700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2101173120 shutdown_connections 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.697+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2101173120 wait complete. 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 -- start start 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 Processor -- start 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c65730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81ae7d0 con 0x565214c61370 2024-09-11T22:36:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81afc40 con 0x565214c565d0 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81aeea0 con 0x565214c57b40 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31d0dbd740 10 client.0 _ll_register_callbacks cb 0x7f31b8032f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31ccf81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31ccf81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49754/0 (socket says 172.21.15.22:49754) 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:60438/0 (socket says 172.21.15.22:60438) 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.698+0000 7f31ccf81640 1 -- 172.21.15.22:0/2272740461 learned_addr learned my addr 172.21.15.22:0/2272740461 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31bffff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c65730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 -- 172.21.15.22:0/2272740461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 msgr2=0x565214c65730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c65730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 -- 172.21.15.22:0/2272740461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 msgr2=0x565214c65c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 -- 172.21.15.22:0/2272740461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565214cdab40 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31ccf81640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31bffff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c65730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31c7fff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005ab0 tx=0x7f31b80b7b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7f3ce8ccf42d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8049070 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f31b80c48a0 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b80bc5c0 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f31b80bbec0 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31d0dbd740 10 client.26177 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.699+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565214cdbe00 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b80bc5c0 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f31b809ace0 con 0x565214c565d0 2024-09-11T22:36:35.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 10 client.26177 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 10 client.26177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 20 client.26177 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214cdc2d0 0x565214cde6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 4 client.26177 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565214bc3d70 con 0x565214cdc2d0 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31bffff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214cdc2d0 0x565214cde6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31bffff640 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214cdc2d0 0x565214cde6c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e0ff6a8dbf1157 server_cookie=1d693152d4a61ad0 in_seq=0 out_seq=0 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.700+0000 7f31a77fe640 10 client.26177 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31a77fe640 1 -- 172.21.15.22:0/2272740461 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565214bc3d70 con 0x565214cdc2d0 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31a77fe640 10 client.26177 handle_command_reply: tid=0 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 client.26177 shutdown 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 msgr2=0x565214c651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005ab0 tx=0x7f31b80b7b30 comp rx=0 tx=0).stop 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 shutdown_connections 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x565214cdc2d0 0x565214cde6c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x565214c61370 0x565214c65c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565214c57b40 0x565214c65730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31a77fe640 0 client.26177 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 --2- 172.21.15.22:0/2272740461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565214c565d0 0x565214c651f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 >> 172.21.15.22:0/2272740461 conn(0x565214c1f310 msgr2=0x565214c5f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 shutdown_connections 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 1 -- 172.21.15.22:0/2272740461 wait complete. 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31d0dbd740 20 client.26177 trim_cache size 0 max 16384 2024-09-11T22:36:35.707 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 msgr2=0x7f31b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 0x7f31b40a5230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31c001f000 tx=0x7f31c001b000 comp rx=0 tx=0).stop 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 msgr2=0x7f31c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.701+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8032c70 comp rx=0 tx=0).stop 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 shutdown_connections 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f31b40a2d70 0x7f31b40a5230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31c8106f10 0x7f31c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c8102790 0x7f31c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 --2- 172.21.15.22:0/2545876967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8101de0 0x7f31c80744f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:35.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 >> 172.21.15.22:0/2545876967 conn(0x7f31c80fd8c0 msgr2=0x7f31c80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:35.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 shutdown_connections 2024-09-11T22:36:35.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:35.702+0000 7f31ce9e4640 1 -- 172.21.15.22:0/2545876967 wait complete. 2024-09-11T22:36:35.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:35 smithi022 ceph-mon[30966]: pgmap v232: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:35 smithi169 ceph-mon[35628]: pgmap v232: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:35 smithi045 ceph-mon[35556]: pgmap v232: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:36:37.502 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:36:37.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:36:37.775 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:37.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:37 smithi022 ceph-mon[30966]: pgmap v233: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:37 smithi169 ceph-mon[35628]: pgmap v233: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:37 smithi045 ceph-mon[35556]: pgmap v233: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:36:38.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 -- 172.21.15.22:0/3615753845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc0102d30 msgr2=0x7f3bc0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 --2- 172.21.15.22:0/3615753845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc0102d30 0x7f3bc0103110 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009cd0 tx=0x7f3bb002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 -- 172.21.15.22:0/3615753845 shutdown_connections 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 --2- 172.21.15.22:0/3615753845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc01082a0 0x7f3bc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 --2- 172.21.15.22:0/3615753845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 --2- 172.21.15.22:0/3615753845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc0102d30 0x7f3bc0103110 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 -- 172.21.15.22:0/3615753845 >> 172.21.15.22:0/3615753845 conn(0x7f3bc00fc7d0 msgr2=0x7f3bc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 -- 172.21.15.22:0/3615753845 shutdown_connections 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 -- 172.21.15.22:0/3615753845 wait complete. 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.206+0000 7f3bc7338640 1 Processor -- start 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 -- start start 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc0102d30 0x7f3bc0198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01121e0 con 0x7f3bc01082a0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0112060 con 0x7f3bc0102d30 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc7338640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0112360 con 0x7f3bc01036e0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49770/0 (socket says 172.21.15.22:49770) 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 -- 172.21.15.22:0/1492663058 learned_addr learned my addr 172.21.15.22:0/1492663058 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc0102d30 0x7f3bc0198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 -- 172.21.15.22:0/1492663058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 msgr2=0x7f3bc0198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 -- 172.21.15.22:0/1492663058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc0102d30 msgr2=0x7f3bc0198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc0102d30 0x7f3bc0198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 -- 172.21.15.22:0/1492663058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc019d6b0 con 0x7f3bc01082a0 2024-09-11T22:36:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.207+0000 7f3bc58d5640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d950 tx=0x7f3bb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.208+0000 7f3bbe7fc640 1 -- 172.21.15.22:0/1492663058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8017030 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.208+0000 7f3bbe7fc640 1 -- 172.21.15.22:0/1492663058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb8004020 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.208+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc019d9a0 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.208+0000 7f3bbe7fc640 1 -- 172.21.15.22:0/1492663058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8003cf0 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.208+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc01a5280 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.210+0000 7f3bbe7fc640 1 -- 172.21.15.22:0/1492663058 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3bb801a070 con 0x7f3bc01082a0 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.210+0000 7f3bc9711740 1 Processor -- start 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 -- start start 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc856f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc864130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644fc7bc280 con 0x5644fc857480 2024-09-11T22:36:38.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5644fc763b10 con 0x5644fc861d40 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc9711740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644fc7b8240 con 0x5644fc856b60 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49778/0 (socket says 172.21.15.22:49778) 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2206503637 learned_addr learned my addr 172.21.15.22:0/2206503637 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bbe7fc640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 0x7f3ba80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc864130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc856f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc58d5640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 0x7f3ba80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2206503637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 msgr2=0x5644fc856f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc856f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2206503637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 msgr2=0x5644fc864130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc864130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2206503637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644fc7701f0 con 0x5644fc857480 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.211+0000 7f3bbe7fc640 1 -- 172.21.15.22:0/1492663058 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f3bb80cebd0 con 0x7f3bc01082a0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.212+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0031040 tx=0x7f3bb0009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852667e3244584bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.212+0000 7f3bc58d5640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 0x7f3ba80a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80cc3f0 tx=0x7f3bb8084460 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.212+0000 7f3ba77fe640 1 -- 172.21.15.22:0/2206503637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00316b0 con 0x5644fc857480 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.212+0000 7f3ba77fe640 1 -- 172.21.15.22:0/2206503637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb0036040 con 0x5644fc857480 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.212+0000 7f3ba77fe640 1 -- 172.21.15.22:0/2206503637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0004370 con 0x5644fc857480 2024-09-11T22:36:38.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 -- 172.21.15.22:0/2206503637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 msgr2=0x5644fc861800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0031040 tx=0x7f3bb0009380 comp rx=0 tx=0).stop 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 -- 172.21.15.22:0/2206503637 shutdown_connections 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc864130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc861800 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2206503637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc856f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 -- 172.21.15.22:0/2206503637 >> 172.21.15.22:0/2206503637 conn(0x5644fc8530f0 msgr2=0x5644fc8534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 -- 172.21.15.22:0/2206503637 shutdown_connections 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.213+0000 7f3bc9711740 1 -- 172.21.15.22:0/2206503637 wait complete. 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 -- start start 2024-09-11T22:36:38.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 Processor -- start 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc85ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc85f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644fc864910 con 0x5644fc857480 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5644fc776f10 con 0x5644fc861d40 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644fc864a90 con 0x5644fc856b60 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc9711740 10 client.0 _ll_register_callbacks cb 0x5644fc73fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc50d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc50d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49784/0 (socket says 172.21.15.22:49784) 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2728722409 learned_addr learned my addr 172.21.15.22:0/2728722409 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.214+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc85ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc85f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2728722409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 msgr2=0x5644fc85ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc85ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 msgr2=0x5644fc85f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc85f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 -- 172.21.15.22:0/2728722409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644fc52d6a0 con 0x5644fc857480 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc85ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3bb002a920 tx=0x7f3bb0031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b056c017dd629102 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3ba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb004e070 con 0x5644fc857480 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f3bb0031bd0 con 0x5644fc857480 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb0036040 con 0x5644fc857480 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3bb005a050 con 0x5644fc857480 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc9711740 10 client.16674 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:38.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.215+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5644fc8704e0 con 0x5644fc857480 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb0036040 con 0x5644fc857480 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb0030070 con 0x5644fc857480 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 10 client.16674 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 20 client.16674 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc871a30 0x5644fc873e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 4 client.16674 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:38.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644fc7c97f0 con 0x5644fc871a30 2024-09-11T22:36:38.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc871a30 0x5644fc873e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc871a30 0x5644fc873e60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7655837076fc51a5 server_cookie=90548b85fbd84653 in_seq=0 out_seq=0 2024-09-11T22:36:38.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.216+0000 7f3ba4ff9640 10 client.16674 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2728722409 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644fc7c97f0 con 0x5644fc871a30 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3ba4ff9640 10 client.16674 handle_command_reply: tid=0 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 client.16674 shutdown 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 msgr2=0x5644fc85f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3bb002a920 tx=0x7f3bb0031740 comp rx=0 tx=0).stop 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 shutdown_connections 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc871a30 0x5644fc873e60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc861d40 0x5644fc85f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc857480 0x5644fc85f120 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2728722409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc85ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 >> 172.21.15.22:0/2728722409 conn(0x5644fc8530f0 msgr2=0x5644fc852270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.217+0000 7f3ba4ff9640 0 client.16674 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.218+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 shutdown_connections 2024-09-11T22:36:38.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.218+0000 7f3bc9711740 1 -- 172.21.15.22:0/2728722409 wait complete. 2024-09-11T22:36:38.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.218+0000 7f3bc9711740 20 client.16674 trim_cache size 0 max 16384 2024-09-11T22:36:38.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 Processor -- start 2024-09-11T22:36:38.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 -- start start 2024-09-11T22:36:38.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc86a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc861d40 0x5644fc86a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01aba00 con 0x5644fc856b60 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01ae260 con 0x5644fc857480 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc9711740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01ac050 con 0x5644fc861d40 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49790/0 (socket says 172.21.15.22:49790) 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2252426888 learned_addr learned my addr 172.21.15.22:0/2252426888 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc86a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2252426888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc861d40 msgr2=0x5644fc86a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc861d40 0x5644fc86a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.235+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2252426888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 msgr2=0x5644fc86a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc86a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2252426888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644fc85fbb0 con 0x5644fc856b60 2024-09-11T22:36:38.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00fedb0 tx=0x7f3bb4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c759aad7825b05c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3ba6ffd640 1 -- 172.21.15.22:0/2252426888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4013df0 con 0x5644fc856b60 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3ba6ffd640 1 -- 172.21.15.22:0/2252426888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb4005490 con 0x5644fc856b60 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.236+0000 7f3ba6ffd640 1 -- 172.21.15.22:0/2252426888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40217d0 con 0x5644fc856b60 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- 172.21.15.22:0/2252426888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 msgr2=0x5644fc8595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00fedb0 tx=0x7f3bb4009b60 comp rx=0 tx=0).stop 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- 172.21.15.22:0/2252426888 shutdown_connections 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc861d40 0x5644fc86a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc86a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2252426888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc856b60 0x5644fc8595c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- 172.21.15.22:0/2252426888 >> 172.21.15.22:0/2252426888 conn(0x5644fc8530f0 msgr2=0x5644fc85dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- 172.21.15.22:0/2252426888 shutdown_connections 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- 172.21.15.22:0/2252426888 wait complete. 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 -- start start 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.237+0000 7f3bc9711740 1 Processor -- start 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc879300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc879840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01ac720 con 0x5644fc861d40 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01adb90 con 0x5644fc857480 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01acdf0 con 0x5644fc856b60 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc9711740 10 client.0 _ll_register_callbacks cb 0x7f3bb4009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49802/0 (socket says 172.21.15.22:49802) 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2349167131 learned_addr learned my addr 172.21.15.22:0/2349167131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc879300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc879840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2349167131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 msgr2=0x5644fc879300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc879300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 msgr2=0x5644fc879840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc879840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 -- 172.21.15.22:0/2349167131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644fc8d80f0 con 0x5644fc861d40 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc879840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3bc48d3640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4013fd0 tx=0x7f3bb4004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8eafd2e53a8a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.238+0000 7f3ba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb402e040 con 0x5644fc861d40 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f3bb4037470 con 0x5644fc861d40 2024-09-11T22:36:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb4005490 con 0x5644fc861d40 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3bb4037670 con 0x5644fc861d40 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 10 client.16680 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5644fc8e06c0 con 0x5644fc861d40 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bb4005490 con 0x5644fc861d40 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f3bb4034040 con 0x5644fc861d40 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 10 client.16680 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 20 client.16680 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc8e0d60 0x5644fc8e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 4 client.16680 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.239+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5644fc7c3d00 con 0x5644fc8e0d60 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.240+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc8e0d60 0x5644fc8e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:38.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.240+0000 7f3ba4ff9640 10 client.16680 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:38.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.240+0000 7f3bc50d4640 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc8e0d60 0x5644fc8e3180 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bddc1f5885c164b server_cookie=61c3adf86497de36 in_seq=0 out_seq=0 2024-09-11T22:36:38.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3ba4ff9640 1 -- 172.21.15.22:0/2349167131 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5644fc7c3d00 con 0x5644fc8e0d60 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3ba4ff9640 10 client.16680 handle_command_reply: tid=0 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 client.16680 shutdown 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 msgr2=0x5644fc8d7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4013fd0 tx=0x7f3bb4004f30 comp rx=0 tx=0).stop 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 shutdown_connections 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5644fc8e0d60 0x5644fc8e3180 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644fc861d40 0x5644fc8d7a50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644fc857480 0x5644fc879840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3ba4ff9640 0 client.16680 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 --2- 172.21.15.22:0/2349167131 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644fc856b60 0x5644fc879300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 >> 172.21.15.22:0/2349167131 conn(0x5644fc8530f0 msgr2=0x5644fc85eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 shutdown_connections 2024-09-11T22:36:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 1 -- 172.21.15.22:0/2349167131 wait complete. 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.241+0000 7f3bc9711740 20 client.16680 trim_cache size 0 max 16384 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "ea54b88c-9cbd-4177-becc-482c2a4d085c", 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:36:38.247 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 msgr2=0x7f3ba80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 0x7f3ba80a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80cc3f0 tx=0x7f3bb8084460 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 msgr2=0x7f3bc019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d950 tx=0x7f3bb800de10 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 shutdown_connections 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ba80a2d70 0x7f3ba80a5230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bc01082a0 0x7f3bc019cfd0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3bc01036e0 0x7f3bc0198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 --2- 172.21.15.22:0/1492663058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bc0102d30 0x7f3bc0198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 >> 172.21.15.22:0/1492663058 conn(0x7f3bc00fc7d0 msgr2=0x7f3bc0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:38.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 shutdown_connections 2024-09-11T22:36:38.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:38.242+0000 7f3bc7338640 1 -- 172.21.15.22:0/1492663058 wait complete. 2024-09-11T22:36:39.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:36:39.362 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: pgmap v234: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:39.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:39 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:36:39.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 -- 172.21.15.22:0/2638481715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 msgr2=0x7fcb1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 --2- 172.21.15.22:0/2638481715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb1010d950 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009cd0 tx=0x7fcb0802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 -- 172.21.15.22:0/2638481715 shutdown_connections 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 --2- 172.21.15.22:0/2638481715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb1010d950 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 --2- 172.21.15.22:0/2638481715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 --2- 172.21.15.22:0/2638481715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 0x7fcb10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 -- 172.21.15.22:0/2638481715 >> 172.21.15.22:0/2638481715 conn(0x7fcb100fc7a0 msgr2=0x7fcb100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.805+0000 7fcb184a6640 1 -- 172.21.15.22:0/2638481715 shutdown_connections 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.806+0000 7fcb184a6640 1 -- 172.21.15.22:0/2638481715 wait complete. 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 Processor -- start 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 -- start start 2024-09-11T22:36:39.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb101984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 0x7fcb1019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101120c0 con 0x7fcb10101420 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10111f40 con 0x7fcb10100a80 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb184a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10112240 con 0x7fcb10106a80 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49816/0 (socket says 172.21.15.22:49816) 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 -- 172.21.15.22:0/3891724873 learned_addr learned my addr 172.21.15.22:0/3891724873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb16242640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb101984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb16a43640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 0x7fcb1019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 -- 172.21.15.22:0/3891724873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 msgr2=0x7fcb1019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 0x7fcb1019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 -- 172.21.15.22:0/3891724873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 msgr2=0x7fcb101984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb101984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.807+0000 7fcb15a41640 1 -- 172.21.15.22:0/3891724873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1019d470 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb16242640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb101984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb15a41640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000e9f0 tx=0x7fcb0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb077fe640 1 -- 172.21.15.22:0/3891724873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000cd80 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb077fe640 1 -- 172.21.15.22:0/3891724873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb00010930 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1019d760 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb077fe640 1 -- 172.21.15.22:0/3891724873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00018b00 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.808+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb101a5040 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.810+0000 7fcb077fe640 1 -- 172.21.15.22:0/3891724873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcb00018ca0 con 0x7fcb10101420 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb077fe640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 0x7fcafc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 Processor -- start 2024-09-11T22:36:39.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb16242640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 0x7fcafc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb077fe640 1 -- 172.21.15.22:0/3891724873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcb000cf8e0 con 0x7fcb10101420 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 -- start start 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd41880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd4c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555cebca72e0 con 0x555cebd4c680 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555cebc4ece0 con 0x555cebd41dc0 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555cebca32a0 con 0x555cebd414a0 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.811+0000 7fcb16242640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 0x7fcafc0a5230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005fd0 tx=0x7fcb0c005850 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49820/0 (socket says 172.21.15.22:49820) 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 -- 172.21.15.22:0/3524189584 learned_addr learned my addr 172.21.15.22:0/3524189584 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:39.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb15a41640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd4c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16242640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd41880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 -- 172.21.15.22:0/3524189584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 msgr2=0x555cebd41880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd41880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 -- 172.21.15.22:0/3524189584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 msgr2=0x555cebd4c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd4c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 -- 172.21.15.22:0/3524189584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cebc33440 con 0x555cebd4c680 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb15a41640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd4c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb16a43640 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb08035000 tx=0x7fcb08004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2deb90e2d17734e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb04ff9640 1 -- 172.21.15.22:0/3524189584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08031630 con 0x555cebd4c680 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb04ff9640 1 -- 172.21.15.22:0/3524189584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb08036040 con 0x555cebd4c680 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.812+0000 7fcb04ff9640 1 -- 172.21.15.22:0/3524189584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080043a0 con 0x555cebd4c680 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 -- 172.21.15.22:0/3524189584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 msgr2=0x555cebd4ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb08035000 tx=0x7fcb08004aa0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 -- 172.21.15.22:0/3524189584 shutdown_connections 2024-09-11T22:36:39.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd4ea70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd4c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/3524189584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd41880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 -- 172.21.15.22:0/3524189584 >> 172.21.15.22:0/3524189584 conn(0x555cebd3da30 msgr2=0x555cebd3de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 -- 172.21.15.22:0/3524189584 shutdown_connections 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.813+0000 7fcb1a87f740 1 -- 172.21.15.22:0/3524189584 wait complete. 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 -- start start 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 Processor -- start 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd4bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555cebd4f250 con 0x555cebd41dc0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555cebc62050 con 0x555cebd4c680 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555cebd4f3d0 con 0x555cebd414a0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb1a87f740 10 client.0 _ll_register_callbacks cb 0x555cebca2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49834/0 (socket says 172.21.15.22:49834) 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb15a41640 1 -- 172.21.15.22:0/1729718335 learned_addr learned my addr 172.21.15.22:0/1729718335 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.814+0000 7fcb16a43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb16242640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd4bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 -- 172.21.15.22:0/1729718335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 msgr2=0x555cebd4bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd4bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 -- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 msgr2=0x555cebd49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd49750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 -- 172.21.15.22:0/1729718335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ceba183c0 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb16242640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb15a41640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcb000cd0b0 tx=0x7fcb0009c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff5e6feb2553fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00010ce0 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcb0009b270 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb08036040 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcb0009b470 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb1a87f740 10 client.16692 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555cebd5ac70 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.815+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb08036040 con 0x555cebd41dc0 2024-09-11T22:36:39.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fcb000a4ce0 con 0x555cebd41dc0 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 10 client.16692 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 20 client.16692 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebd5c130 0x555cebd5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 4 client.16692 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cebcb4850 con 0x555cebd5c130 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb16242640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebd5c130 0x555cebd5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcaf9ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.816+0000 7fcb16242640 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebd5c130 0x555cebd5e520 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eec4237762dc2e18 server_cookie=2fb353990d9e2974 in_seq=0 out_seq=0 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/1729718335 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cebcb4850 con 0x555cebd5c130 2024-09-11T22:36:39.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcaf9ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 client.16692 shutdown 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 msgr2=0x555cebd49210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcb000cd0b0 tx=0x7fcb0009c660 comp rx=0 tx=0).stop 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 shutdown_connections 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebd5c130 0x555cebd5e520 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd41dc0 0x555cebd49210 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcaf9ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/1729718335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.817+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 >> 172.21.15.22:0/1729718335 conn(0x555cebd3da30 msgr2=0x555cebd43710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.818+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 shutdown_connections 2024-09-11T22:36:39.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.818+0000 7fcb1a87f740 1 -- 172.21.15.22:0/1729718335 wait complete. 2024-09-11T22:36:39.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.818+0000 7fcb1a87f740 20 client.16692 trim_cache size 0 max 16384 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 Processor -- start 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 -- start start 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd41dc0 0x555cebd63da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ab900 con 0x555cebd414a0 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ae160 con 0x555cebd4c680 2024-09-11T22:36:39.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101abf50 con 0x555cebd41dc0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49850/0 (socket says 172.21.15.22:49850) 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 -- 172.21.15.22:0/527973704 learned_addr learned my addr 172.21.15.22:0/527973704 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb15a41640 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd41dc0 0x555cebd63da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16a43640 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 -- 172.21.15.22:0/527973704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd41dc0 msgr2=0x555cebd63da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd41dc0 0x555cebd63da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 -- 172.21.15.22:0/527973704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 msgr2=0x555cebd642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.835+0000 7fcb16242640 1 -- 172.21.15.22:0/527973704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cebd47760 con 0x555cebd414a0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb16242640 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x555cebd5ece0 tx=0x7fcb0c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a9dcb2450c3bab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcafbfff640 1 -- 172.21.15.22:0/527973704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c02f070 con 0x555cebd414a0 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcafbfff640 1 -- 172.21.15.22:0/527973704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb0c004230 con 0x555cebd414a0 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcafbfff640 1 -- 172.21.15.22:0/527973704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c029870 con 0x555cebd414a0 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 -- 172.21.15.22:0/527973704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 msgr2=0x555cebd584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x555cebd5ece0 tx=0x7fcb0c015000 comp rx=0 tx=0).stop 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 -- 172.21.15.22:0/527973704 shutdown_connections 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd4c680 0x555cebd642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd41dc0 0x555cebd63da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/527973704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd414a0 0x555cebd584b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 -- 172.21.15.22:0/527973704 >> 172.21.15.22:0/527973704 conn(0x555cebd3da30 msgr2=0x555cebd48300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 -- 172.21.15.22:0/527973704 shutdown_connections 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.836+0000 7fcb1a87f740 1 -- 172.21.15.22:0/527973704 wait complete. 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 -- start start 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 Processor -- start 2024-09-11T22:36:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd54b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ac620 con 0x555cebd4c680 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ada90 con 0x555cebd41dc0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101accf0 con 0x555cebd414a0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb1a87f740 10 client.0 _ll_register_callbacks cb 0x7fcb00009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb16a43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb16242640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd54b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb15a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:60540/0 (socket says 172.21.15.22:60540) 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.837+0000 7fcb15a41640 1 -- 172.21.15.22:0/2454467714 learned_addr learned my addr 172.21.15.22:0/2454467714 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 -- 172.21.15.22:0/2454467714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 msgr2=0x555cebd54b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd54b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 -- 172.21.15.22:0/2454467714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 msgr2=0x555cebd523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 -- 172.21.15.22:0/2454467714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cebd52970 con 0x555cebd41dc0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb16a43640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb16242640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd54b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb15a41640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb00098280 tx=0x7fcb00010660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abbe9a0eadf0b10c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0009b780 con 0x555cebd41dc0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mon.2 v2:172.21.15.45:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fcb00097d80 con 0x555cebd41dc0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb0c004230 con 0x555cebd41dc0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcb0009b960 con 0x555cebd41dc0 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb1a87f740 10 client.26210 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.838+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555cebdc6b40 con 0x555cebd41dc0 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mon.2 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb0c004230 con 0x555cebd41dc0 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mon.2 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fcb000a4ce0 con 0x555cebd41dc0 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 10 client.26210 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 10 client.26210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 20 client.26210 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebdc7260 0x555cebdc9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 4 client.26210 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555cebcaed60 con 0x555cebdc7260 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb16242640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebdc7260 0x555cebdc9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcb16242640 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebdc7260 0x555cebdc9680 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6601f557fd1ea451 server_cookie=524e470658fa3667 in_seq=0 out_seq=0 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.839+0000 7fcaf9ffb640 10 client.26210 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcaf9ffb640 1 -- 172.21.15.22:0/2454467714 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555cebcaed60 con 0x555cebdc7260 2024-09-11T22:36:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcaf9ffb640 10 client.26210 handle_command_reply: tid=0 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 client.26210 shutdown 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 msgr2=0x555cebd51e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb00098280 tx=0x7fcb00010660 comp rx=0 tx=0).stop 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 shutdown_connections 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555cebdc7260 0x555cebdc9680 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555cebd4c680 0x555cebd523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555cebd41dc0 0x555cebd51e70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 --2- 172.21.15.22:0/2454467714 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555cebd414a0 0x555cebd54b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcaf9ffb640 0 client.26210 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 >> 172.21.15.22:0/2454467714 conn(0x555cebd3da30 msgr2=0x555cebd4aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 shutdown_connections 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 1 -- 172.21.15.22:0/2454467714 wait complete. 2024-09-11T22:36:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb1a87f740 20 client.26210 trim_cache size 0 max 16384 2024-09-11T22:36:39.848 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:39.848 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:36:39.848 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:36:39.848 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 msgr2=0x7fcafc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 0x7fcafc0a5230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005fd0 tx=0x7fcb0c005850 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 msgr2=0x7fcb10198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.840+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000e9f0 tx=0x7fcb0000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 shutdown_connections 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcafc0a2d70 0x7fcafc0a5230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb10106a80 0x7fcb1019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb10101420 0x7fcb10198a00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 --2- 172.21.15.22:0/3891724873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb10100a80 0x7fcb101984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 >> 172.21.15.22:0/3891724873 conn(0x7fcb100fc7a0 msgr2=0x7fcb100fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 shutdown_connections 2024-09-11T22:36:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:39.841+0000 7fcb184a6640 1 -- 172.21.15.22:0/3891724873 wait complete. 2024-09-11T22:36:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:36:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:36:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: pgmap v234: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:39 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:36:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:36:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:36:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:39.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: pgmap v234: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:39.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:39 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:36:40.618 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:36:40.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:36:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:41.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 -- 172.21.15.22:0/1260712994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c100a80 msgr2=0x7fec4c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:41.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 --2- 172.21.15.22:0/1260712994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c100a80 0x7fec4c100ee0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fec34009930 tx=0x7fec3402a420 comp rx=0 tx=0).stop 2024-09-11T22:36:41.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 -- 172.21.15.22:0/1260712994 shutdown_connections 2024-09-11T22:36:41.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 --2- 172.21.15.22:0/1260712994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c101420 0x7fec4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 --2- 172.21.15.22:0/1260712994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c100a80 0x7fec4c100ee0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 --2- 172.21.15.22:0/1260712994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c106a80 0x7fec4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 -- 172.21.15.22:0/1260712994 >> 172.21.15.22:0/1260712994 conn(0x7fec4c0fc7a0 msgr2=0x7fec4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 -- 172.21.15.22:0/1260712994 shutdown_connections 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.370+0000 7fec5238d640 1 -- 172.21.15.22:0/1260712994 wait complete. 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 Processor -- start 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 -- start start 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c100a80 0x7fec4c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c101420 0x7fec4c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c110fa0 con 0x7fec4c106a80 2024-09-11T22:36:41.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c110e20 con 0x7fec4c101420 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5238d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c111120 con 0x7fec4c100a80 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5092a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5092a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49882/0 (socket says 172.21.15.22:49882) 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.371+0000 7fec5092a640 1 -- 172.21.15.22:0/3110330459 learned_addr learned my addr 172.21.15.22:0/3110330459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec4bfff640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c100a80 0x7fec4c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec43fff640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c101420 0x7fec4c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 -- 172.21.15.22:0/3110330459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c100a80 msgr2=0x7fec4c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c100a80 0x7fec4c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 -- 172.21.15.22:0/3110330459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c101420 msgr2=0x7fec4c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c101420 0x7fec4c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 -- 172.21.15.22:0/3110330459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c19d470 con 0x7fec4c106a80 2024-09-11T22:36:41.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5092a640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fec4400cad0 tx=0x7fec4400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:41.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4400ad60 con 0x7fec4c106a80 2024-09-11T22:36:41.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c19d760 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec44004b20 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4400f6b0 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.372+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c1a5040 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.373+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4c100ee0 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.374+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fec44004cd0 con 0x7fec4c106a80 2024-09-11T22:36:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.375+0000 7fec49ffb640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 0x7fec380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:41.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.376+0000 7fec4bfff640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 0x7fec380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:41.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.376+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fec440cf6e0 con 0x7fec4c106a80 2024-09-11T22:36:41.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.376+0000 7fec4bfff640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 0x7fec380a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00ab60 tx=0x7fec3c00a2d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:41.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.380+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec44014030 con 0x7fec4c106a80 2024-09-11T22:36:41.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.592+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec4c10a080 con 0x7fec4c106a80 2024-09-11T22:36:41.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:41 smithi022 ceph-mon[30966]: pgmap v235: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.593+0000 7fec49ffb640 1 -- 172.21.15.22:0/3110330459 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7fec4409c320 con 0x7fec4c106a80 2024-09-11T22:36:41.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:36:41.594 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:36:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 msgr2=0x7fec380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 0x7fec380a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00ab60 tx=0x7fec3c00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 msgr2=0x7fec4c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fec4400cad0 tx=0x7fec4400ced0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 shutdown_connections 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fec380a2cf0 0x7fec380a51b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec4c106a80 0x7fec4c19cd90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4c101420 0x7fec4c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 --2- 172.21.15.22:0/3110330459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec4c100a80 0x7fec4c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 >> 172.21.15.22:0/3110330459 conn(0x7fec4c0fc7a0 msgr2=0x7fec4c06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 shutdown_connections 2024-09-11T22:36:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:41.595+0000 7fec5238d640 1 -- 172.21.15.22:0/3110330459 wait complete. 2024-09-11T22:36:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:41 smithi169 ceph-mon[35628]: pgmap v235: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:41.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:41 smithi045 ceph-mon[35556]: pgmap v235: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:42.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:36:42.594 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:42.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:42 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3110330459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:42.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:42 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3110330459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:42.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:42 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3110330459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:36:43.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/674092639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08102790 msgr2=0x7f5d081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/674092639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08102790 0x7f5d081067e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009900 tx=0x7f5cf802a410 comp rx=0 tx=0).stop 2024-09-11T22:36:43.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/674092639 shutdown_connections 2024-09-11T22:36:43.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/674092639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/674092639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08102790 0x7f5d081067e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/674092639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d08101de0 0x7f5d081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/674092639 >> 172.21.15.22:0/674092639 conn(0x7f5d080fd8c0 msgr2=0x7f5d080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/674092639 shutdown_connections 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/674092639 wait complete. 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 Processor -- start 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.173+0000 7f5d0f4f7640 1 -- start start 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d08102790 0x7f5d08198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08112090 con 0x7f5d08101de0 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08111f10 con 0x7f5d08106f10 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0f4f7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08112210 con 0x7f5d08102790 2024-09-11T22:36:43.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49904/0 (socket says 172.21.15.22:49904) 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 -- 172.21.15.22:0/1890746234 learned_addr learned my addr 172.21.15.22:0/1890746234 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0da94640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 -- 172.21.15.22:0/1890746234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d08102790 msgr2=0x7f5d08198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d08102790 0x7f5d08198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 -- 172.21.15.22:0/1890746234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 msgr2=0x7f5d0819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 -- 172.21.15.22:0/1890746234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0819d4c0 con 0x7f5d08101de0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0da94640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5d0d293640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400d950 tx=0x7f5d0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.174+0000 7f5cfe7fc640 1 -- 172.21.15.22:0/1890746234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04017070 con 0x7f5d08101de0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.175+0000 7f5cfe7fc640 1 -- 172.21.15.22:0/1890746234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d04009c30 con 0x7f5d08101de0 2024-09-11T22:36:43.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.175+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0819d7b0 con 0x7f5d08101de0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.175+0000 7f5cfe7fc640 1 -- 172.21.15.22:0/1890746234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400f740 con 0x7f5d08101de0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.175+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d081a5090 con 0x7f5d08101de0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5cfe7fc640 1 -- 172.21.15.22:0/1890746234 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5d04010a80 con 0x7f5d08101de0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 Processor -- start 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 -- start start 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601e7ae42f0 con 0x5601e7b7e5d0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5601e7a8bcf0 con 0x5601e7b7fb40 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.177+0000 7f5d118d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5601e7ae02b0 con 0x5601e7b89370 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49910/0 (socket says 172.21.15.22:49910) 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0da94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 -- 172.21.15.22:0/209041302 learned_addr learned my addr 172.21.15.22:0/209041302 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5cfe7fc640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 0x7f5cf40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 -- 172.21.15.22:0/209041302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 msgr2=0x5601e7b8b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b8b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0da94640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 0x7f5cf40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 -- 172.21.15.22:0/209041302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 msgr2=0x5601e7b7e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b7e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 -- 172.21.15.22:0/209041302 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e7a703a0 con 0x5601e7b7e5d0 2024-09-11T22:36:43.192 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5cfe7fc640 1 -- 172.21.15.22:0/1890746234 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f5d040cea70 con 0x7f5d08101de0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.178+0000 7f5d0d293640 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5d040cc150 tx=0x7f5d0405b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850098d3c062bb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d0da94640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 0x7f5cf40a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d00005fd0 tx=0x7f5d00004ab0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5cf37fe640 1 -- 172.21.15.22:0/209041302 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0409ad80 con 0x5601e7b7e5d0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5cf37fe640 1 -- 172.21.15.22:0/209041302 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d040bb080 con 0x5601e7b7e5d0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5cf37fe640 1 -- 172.21.15.22:0/209041302 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04016ab0 con 0x5601e7b7e5d0 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 -- 172.21.15.22:0/209041302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 msgr2=0x5601e7b7ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5d040cc150 tx=0x7f5d0405b050 comp rx=0 tx=0).stop 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 -- 172.21.15.22:0/209041302 shutdown_connections 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b7ea10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 --2- 172.21.15.22:0/209041302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b7e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 -- 172.21.15.22:0/209041302 >> 172.21.15.22:0/209041302 conn(0x5601e7b47310 msgr2=0x5601e7b7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 -- 172.21.15.22:0/209041302 shutdown_connections 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.179+0000 7f5d118d0740 1 -- 172.21.15.22:0/209041302 wait complete. 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 -- start start 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 Processor -- start 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7fb40 0x5601e7b86000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7b865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5601e7b8c010 con 0x5601e7b7e5d0 2024-09-11T22:36:43.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5601e7a9f060 con 0x5601e7b89370 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5601e7b8c190 con 0x5601e7b7fb40 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d118d0740 10 client.0 _ll_register_callbacks cb 0x5601e77f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49924/0 (socket says 172.21.15.22:49924) 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.180+0000 7f5d0d293640 1 -- 172.21.15.22:0/97944325 learned_addr learned my addr 172.21.15.22:0/97944325 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0da94640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7b865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 -- 172.21.15.22:0/97944325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7fb40 msgr2=0x5601e7b86000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7fb40 0x5601e7b86000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 -- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 msgr2=0x5601e7b865d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7b865d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 -- 172.21.15.22:0/97944325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e78553c0 con 0x5601e7b7e5d0 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0da94640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7b865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:43.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d0d293640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5d040058c0 tx=0x7f5d0409ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c7bebe305b0f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5cf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04020050 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f5d040cc460 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d040bb080 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d04015940 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d118d0740 10 client.16716 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5601e7b97a90 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.181+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d040bb080 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f5d04097620 con 0x5601e7b7e5d0 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 10 client.16716 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 20 client.16716 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:43.196 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7b98de0 0x5601e7b9b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 4 client.16716 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601e7af1860 con 0x5601e7b98de0 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7b98de0 0x5601e7b9b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7b98de0 0x5601e7b9b1d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3d89c5074d03ef server_cookie=d1583c832a7bee17 in_seq=0 out_seq=0 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.182+0000 7f5cf0ff9640 10 client.16716 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/97944325 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601e7af1860 con 0x5601e7b98de0 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5cf0ff9640 10 client.16716 handle_command_reply: tid=0 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 client.16716 shutdown 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 msgr2=0x5601e7b88d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5d040058c0 tx=0x7f5d0409ad80 comp rx=0 tx=0).stop 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 shutdown_connections 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7b98de0 0x5601e7b9b1d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7b865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5cf0ff9640 0 client.16716 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7fb40 0x5601e7b86000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 --2- 172.21.15.22:0/97944325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b88d50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.183+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 >> 172.21.15.22:0/97944325 conn(0x5601e7b47310 msgr2=0x5601e7b80930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.184+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 shutdown_connections 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.184+0000 7f5d118d0740 1 -- 172.21.15.22:0/97944325 wait complete. 2024-09-11T22:36:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.184+0000 7f5d118d0740 20 client.16716 trim_cache size 0 max 16384 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 Processor -- start 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 -- start start 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 0x5601e7b81120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7ba0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ab8f0 con 0x5601e7b7fb40 2024-09-11T22:36:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ae150 con 0x5601e7b89370 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d118d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081abf40 con 0x5601e7b7e5d0 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d0ca92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d0ca92640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49930/0 (socket says 172.21.15.22:49930) 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d0ca92640 1 -- 172.21.15.22:0/3158461911 learned_addr learned my addr 172.21.15.22:0/3158461911 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.197+0000 7f5d0d293640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 0x5601e7b81120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0da94640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7ba0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 -- 172.21.15.22:0/3158461911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 msgr2=0x5601e7b81120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 0x5601e7b81120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 -- 172.21.15.22:0/3158461911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 msgr2=0x5601e7ba0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7ba0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 -- 172.21.15.22:0/3158461911 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e7b84570 con 0x5601e7b7fb40 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0d293640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 0x5601e7b81120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:43.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0da94640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7ba0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80315e0 tx=0x7f5cf8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6de0fe77e57dec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5cf2ffd640 1 -- 172.21.15.22:0/3158461911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8035040 con 0x5601e7b7fb40 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5cf2ffd640 1 -- 172.21.15.22:0/3158461911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cf8048070 con 0x5601e7b7fb40 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.198+0000 7f5cf2ffd640 1 -- 172.21.15.22:0/3158461911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8004b80 con 0x5601e7b7fb40 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- 172.21.15.22:0/3158461911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 msgr2=0x5601e7b81660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80315e0 tx=0x7f5cf8009810 comp rx=0 tx=0).stop 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- 172.21.15.22:0/3158461911 shutdown_connections 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b89370 0x5601e7ba0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7fb40 0x5601e7b81660 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3158461911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b7e5d0 0x5601e7b81120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- 172.21.15.22:0/3158461911 >> 172.21.15.22:0/3158461911 conn(0x5601e7b47310 msgr2=0x5601e7b79d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- 172.21.15.22:0/3158461911 shutdown_connections 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- 172.21.15.22:0/3158461911 wait complete. 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 -- start start 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.199+0000 7f5d118d0740 1 Processor -- start 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b83680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b83bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ac610 con 0x5601e7b7e5d0 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081ada80 con 0x5601e7b7fb40 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d081acce0 con 0x5601e7b89370 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 10 client.0 _ll_register_callbacks cb 0x7f5d00009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:43.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49934/0 (socket says 172.21.15.22:49934) 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 -- 172.21.15.22:0/3463156918 learned_addr learned my addr 172.21.15.22:0/3463156918 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0da94640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b83bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b83680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 -- 172.21.15.22:0/3463156918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 msgr2=0x5601e7b83bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b83bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 -- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 msgr2=0x5601e7b83680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b83680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 -- 172.21.15.22:0/3463156918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e7c02930 con 0x5601e7b7e5d0 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b83680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:43.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d0d293640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d040af3e0 tx=0x7f5d0409f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483e8974626ba9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5cf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04020070 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f5d040cc460 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.200+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf8048070 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d0409a910 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 10 client.16722 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5601e7c02930 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cf8048070 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f5d04097620 con 0x5601e7b7e5d0 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 10 client.16722 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 20 client.16722 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7c03e90 0x5601e7c062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 4 client.16722 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601e7aebd70 con 0x5601e7c03e90 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.201+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7c03e90 0x5601e7c062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d0ca92640 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7c03e90 0x5601e7c062b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e095cbc792aab0b server_cookie=1fdd43866f83bab7 in_seq=0 out_seq=0 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5cf0ff9640 10 client.16722 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5cf0ff9640 1 -- 172.21.15.22:0/3463156918 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601e7aebd70 con 0x5601e7c03e90 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5cf0ff9640 10 client.16722 handle_command_reply: tid=0 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 client.16722 shutdown 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 msgr2=0x5601e7b83140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d040af3e0 tx=0x7f5d0409f3e0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 shutdown_connections 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5601e7c03e90 0x5601e7c062b0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5601e7b89370 0x5601e7b83bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5601e7b7fb40 0x5601e7b83680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 --2- 172.21.15.22:0/3463156918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5601e7b7e5d0 0x5601e7b83140 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 >> 172.21.15.22:0/3463156918 conn(0x5601e7b47310 msgr2=0x5601e7b87860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.202+0000 7f5cf0ff9640 0 client.16722 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 shutdown_connections 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d118d0740 1 -- 172.21.15.22:0/3463156918 wait complete. 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d118d0740 20 client.16722 trim_cache size 0 max 16384 2024-09-11T22:36:43.211 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:36:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 msgr2=0x7f5cf40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 0x7f5cf40a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d00005fd0 tx=0x7f5d00004ab0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 msgr2=0x7f5d08198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400d950 tx=0x7f5d0400de10 comp rx=0 tx=0).stop 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 shutdown_connections 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f5cf40a2cf0 0x7f5cf40a51b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d08106f10 0x7f5d0819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d08102790 0x7f5d08198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 --2- 172.21.15.22:0/1890746234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d08101de0 0x7f5d08198510 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.203+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 >> 172.21.15.22:0/1890746234 conn(0x7f5d080fd8c0 msgr2=0x7f5d080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.204+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 shutdown_connections 2024-09-11T22:36:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:43.204+0000 7f5d0f4f7640 1 -- 172.21.15.22:0/1890746234 wait complete. 2024-09-11T22:36:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:43 smithi022 ceph-mon[30966]: pgmap v236: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:43.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:43 smithi169 ceph-mon[35628]: pgmap v236: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:43 smithi045 ceph-mon[35556]: pgmap v236: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:44.981 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:36:44.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:36:45.255 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:45.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:45 smithi022 ceph-mon[30966]: pgmap v237: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 -- 172.21.15.22:0/2494242855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944101bc0 msgr2=0x7f194410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 --2- 172.21.15.22:0/2494242855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944101bc0 0x7f194410d910 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f193c009900 tx=0x7f193c02a410 comp rx=0 tx=0).stop 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 -- 172.21.15.22:0/2494242855 shutdown_connections 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 --2- 172.21.15.22:0/2494242855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944101bc0 0x7f194410d910 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 --2- 172.21.15.22:0/2494242855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101240 0x7f1944101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 --2- 172.21.15.22:0/2494242855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944105a90 0x7f1944105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 -- 172.21.15.22:0/2494242855 >> 172.21.15.22:0/2494242855 conn(0x7f1944077210 msgr2=0x7f19440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 -- 172.21.15.22:0/2494242855 shutdown_connections 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.731+0000 7f194bcfa640 1 -- 172.21.15.22:0/2494242855 wait complete. 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 Processor -- start 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 -- start start 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 0x7f1944197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101bc0 0x7f1944197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1944111090 con 0x7f1944105a90 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1944110f10 con 0x7f1944101bc0 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194bcfa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1944111210 con 0x7f1944101240 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34590/0 (socket says 172.21.15.22:34590) 2024-09-11T22:36:45.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194a297640 1 -- 172.21.15.22:0/4284765436 learned_addr learned my addr 172.21.15.22:0/4284765436 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f1949295640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101bc0 0x7f1944197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f1949a96640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 0x7f1944197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194a297640 1 -- 172.21.15.22:0/4284765436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 msgr2=0x7f1944197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.732+0000 7f194a297640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 0x7f1944197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194a297640 1 -- 172.21.15.22:0/4284765436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101bc0 msgr2=0x7f1944197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194a297640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101bc0 0x7f1944197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194a297640 1 -- 172.21.15.22:0/4284765436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194419c3e0 con 0x7f1944105a90 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f1949a96640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 0x7f1944197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194a297640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f193c004770 tx=0x7f193c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f193affd640 1 -- 172.21.15.22:0/4284765436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c03f030 con 0x7f1944105a90 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f193affd640 1 -- 172.21.15.22:0/4284765436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f193c005500 con 0x7f1944105a90 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194419c670 con 0x7f1944105a90 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f193affd640 1 -- 172.21.15.22:0/4284765436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c035070 con 0x7f1944105a90 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.733+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19441a3fb0 con 0x7f1944105a90 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.735+0000 7f193affd640 1 -- 172.21.15.22:0/4284765436 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f193c042030 con 0x7f1944105a90 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 Processor -- start 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 -- start start 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f193affd640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 0x7f19300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c71d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d2320 0x5587c71dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5587c7137280 con 0x5587c71def50 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587c70deb10 con 0x5587c71d2320 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194e0d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5587c7133240 con 0x5587c71d1a00 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f1949295640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 0x7f19300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f193affd640 1 -- 172.21.15.22:0/4284765436 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f193c0ef980 con 0x7f1944105a90 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34604/0 (socket says 172.21.15.22:34604) 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f194a297640 1 -- 172.21.15.22:0/2335862053 learned_addr learned my addr 172.21.15.22:0/2335862053 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f1949295640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d2320 0x5587c71dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.736+0000 7f1949a96640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c71d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 -- 172.21.15.22:0/2335862053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 msgr2=0x5587c71d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c71d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 -- 172.21.15.22:0/2335862053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d2320 msgr2=0x5587c71dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d2320 0x5587c71dea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 -- 172.21.15.22:0/2335862053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c70eb1f0 con 0x5587c71def50 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f1949a96640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c71d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f1949295640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 0x7f19300a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f19340058a0 tx=0x7f19340128d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f194a297640 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b82c0 tx=0x7f193c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f927fbea7b7ba2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f192ffff640 1 -- 172.21.15.22:0/2335862053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c049040 con 0x5587c71def50 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f192ffff640 1 -- 172.21.15.22:0/2335862053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f193c0047a0 con 0x5587c71def50 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.737+0000 7f192ffff640 1 -- 172.21.15.22:0/2335862053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0ba1f0 con 0x5587c71def50 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- 172.21.15.22:0/2335862053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 msgr2=0x5587c71e1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b82c0 tx=0x7f193c02a410 comp rx=0 tx=0).stop 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- 172.21.15.22:0/2335862053 shutdown_connections 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71def50 0x5587c71e1340 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d2320 0x5587c71dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 --2- 172.21.15.22:0/2335862053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c71d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- 172.21.15.22:0/2335862053 >> 172.21.15.22:0/2335862053 conn(0x5587c71ce0f0 msgr2=0x5587c71ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- 172.21.15.22:0/2335862053 shutdown_connections 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- 172.21.15.22:0/2335862053 wait complete. 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 -- start start 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.738+0000 7f194e0d3740 1 Processor -- start 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71dbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71def50 0x5587c71dc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5587c71e18e0 con 0x5587c71d2320 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587c70f1f10 con 0x5587c71d1a00 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5587c71e1a60 con 0x5587c71def50 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f194e0d3740 10 client.0 _ll_register_callbacks cb 0x5587c70baa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34610/0 (socket says 172.21.15.22:34610) 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 -- 172.21.15.22:0/1249282025 learned_addr learned my addr 172.21.15.22:0/1249282025 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949a96640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71dbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 -- 172.21.15.22:0/1249282025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71def50 msgr2=0x5587c71dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71def50 0x5587c71dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 -- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 msgr2=0x5587c71dbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71dbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 -- 172.21.15.22:0/1249282025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c6ea86a0 con 0x5587c71d2320 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f1949295640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f193400e980 tx=0x7f1934004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e067debc068433 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.739+0000 7f192d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193400fd50 con 0x5587c71d2320 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f193401f3f0 con 0x5587c71d2320 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193c0047a0 con 0x5587c71d2320 2024-09-11T22:36:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f193401f5f0 con 0x5587c71d2320 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 10 client.16734 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5587c71ed4a0 con 0x5587c71d2320 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f193c0047a0 con 0x5587c71d2320 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f193402e020 con 0x5587c71d2320 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 10 client.16734 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 20 client.16734 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71ee900 0x5587c71f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 4 client.16734 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587c71447f0 con 0x5587c71ee900 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.740+0000 7f1949a96640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71ee900 0x5587c71f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.741+0000 7f1949a96640 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71ee900 0x5587c71f0d80 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9a2a6f6647838f4 server_cookie=29819d7153090389 in_seq=0 out_seq=0 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.741+0000 7f192d7fa640 10 client.16734 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f192d7fa640 1 -- 172.21.15.22:0/1249282025 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587c71447f0 con 0x5587c71ee900 2024-09-11T22:36:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f192d7fa640 10 client.16734 handle_command_reply: tid=0 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 client.16734 shutdown 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 msgr2=0x5587c71dc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f193400e980 tx=0x7f1934004730 comp rx=0 tx=0).stop 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 shutdown_connections 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71ee900 0x5587c71f0d80 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71def50 0x5587c71dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71dc3c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1249282025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71dbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f192d7fa640 0 client.16734 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 >> 172.21.15.22:0/1249282025 conn(0x5587c71ce0f0 msgr2=0x5587c71d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 shutdown_connections 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 1 -- 172.21.15.22:0/1249282025 wait complete. 2024-09-11T22:36:45.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.742+0000 7f194e0d3740 20 client.16734 trim_cache size 0 max 16384 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.759+0000 7f194e0d3740 1 Processor -- start 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.759+0000 7f194e0d3740 1 -- start start 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71ce0f0 0x5587c71ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19441a9630 con 0x5587c71d2320 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f19441abe90 con 0x5587c71d1a00 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194e0d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19441a9c80 con 0x5587c71ce0f0 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34616/0 (socket says 172.21.15.22:34616) 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 -- 172.21.15.22:0/932252825 learned_addr learned my addr 172.21.15.22:0/932252825 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f1949a96640 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71ce0f0 0x5587c71ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f1949295640 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 -- 172.21.15.22:0/932252825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71ce0f0 msgr2=0x5587c71ddce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71ce0f0 0x5587c71ddce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 -- 172.21.15.22:0/932252825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 msgr2=0x5587c71f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 -- 172.21.15.22:0/932252825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587c71dae30 con 0x5587c71d2320 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f194a297640 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f193c031580 tx=0x7f193c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f54a57b5f39e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f192f7fe640 1 -- 172.21.15.22:0/932252825 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c049070 con 0x5587c71d2320 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f192f7fe640 1 -- 172.21.15.22:0/932252825 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f193c0bc560 con 0x5587c71d2320 2024-09-11T22:36:45.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.760+0000 7f192f7fe640 1 -- 172.21.15.22:0/932252825 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c0042e0 con 0x5587c71d2320 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- 172.21.15.22:0/932252825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 msgr2=0x5587c71f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f193c031580 tx=0x7f193c005770 comp rx=0 tx=0).stop 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- 172.21.15.22:0/932252825 shutdown_connections 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c71f6b90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71d1a00 0x5587c71f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 --2- 172.21.15.22:0/932252825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71ce0f0 0x5587c71ddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- 172.21.15.22:0/932252825 >> 172.21.15.22:0/932252825 conn(0x5587c71d7870 msgr2=0x5587c71dd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- 172.21.15.22:0/932252825 shutdown_connections 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- 172.21.15.22:0/932252825 wait complete. 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.761+0000 7f194e0d3740 1 -- start start 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 Processor -- start 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71ce0f0 0x5587c7254610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c7254b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19441aa350 con 0x5587c71d2320 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f19441ab7c0 con 0x5587c71ce0f0 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19441aaa20 con 0x5587c71d1a00 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194e0d3740 10 client.0 _ll_register_callbacks cb 0x7f193400e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34624/0 (socket says 172.21.15.22:34624) 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 -- 172.21.15.22:0/1337625511 learned_addr learned my addr 172.21.15.22:0/1337625511 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f1949a96640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71ce0f0 0x5587c7254610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f1949295640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c7254b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 -- 172.21.15.22:0/1337625511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 msgr2=0x5587c7254b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c7254b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 -- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71ce0f0 msgr2=0x5587c7254610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71ce0f0 0x5587c7254610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.762+0000 7f194a297640 1 -- 172.21.15.22:0/1337625511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587c7251660 con 0x5587c71d2320 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194a297640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b8830 tx=0x7f193c031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fd58c081a87b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c049070 con 0x5587c71d2320 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7f193c0ed310 con 0x5587c71d2320 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193c0bc560 con 0x5587c71d2320 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f193c0047a0 con 0x5587c71d2320 2024-09-11T22:36:45.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 10 client.16740 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5587c71e6030 con 0x5587c71d2320 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f193c0bc560 con 0x5587c71d2320 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f193c0bc0c0 con 0x5587c71d2320 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 10 client.16740 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 20 client.16740 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71def50 0x5587c71e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 4 client.16740 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.763+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5587c713ed00 con 0x5587c71def50 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.764+0000 7f1949a96640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71def50 0x5587c71e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.764+0000 7f1949a96640 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71def50 0x5587c71e63f0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c11d1b153748e9a5 server_cookie=bc4d6ca30cfb9e75 in_seq=0 out_seq=0 2024-09-11T22:36:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.764+0000 7f192d7fa640 10 client.16740 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f192d7fa640 1 -- 172.21.15.22:0/1337625511 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5587c713ed00 con 0x5587c71def50 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f192d7fa640 10 client.16740 handle_command_reply: tid=0 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 client.16740 shutdown 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 msgr2=0x5587c7255090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f193c0b8830 tx=0x7f193c031b20 comp rx=0 tx=0).stop 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 shutdown_connections 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5587c71def50 0x5587c71e63f0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5587c71d2320 0x5587c7255090 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5587c71d1a00 0x5587c7254b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 --2- 172.21.15.22:0/1337625511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587c71ce0f0 0x5587c7254610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f192d7fa640 0 client.16740 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:45.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 >> 172.21.15.22:0/1337625511 conn(0x5587c71d7870 msgr2=0x5587c71cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 shutdown_connections 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.765+0000 7f194e0d3740 1 -- 172.21.15.22:0/1337625511 wait complete. 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194e0d3740 20 client.16740 trim_cache size 0 max 16384 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "2427cd20-e16c-4feb-bade-ceb11eaddd41", 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:36:45.774 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 msgr2=0x7f19300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 0x7f19300a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f19340058a0 tx=0x7f19340128d0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 msgr2=0x7f194419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f193c004770 tx=0x7f193c004c00 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 shutdown_connections 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19300a2cf0 0x7f19300a51b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1944105a90 0x7f194419bd00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1944101bc0 0x7f1944197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 --2- 172.21.15.22:0/4284765436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1944101240 0x7f1944197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 >> 172.21.15.22:0/4284765436 conn(0x7f1944077210 msgr2=0x7f19441037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 shutdown_connections 2024-09-11T22:36:45.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:45.766+0000 7f194bcfa640 1 -- 172.21.15.22:0/4284765436 wait complete. 2024-09-11T22:36:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:45 smithi169 ceph-mon[35628]: pgmap v237: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:45.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:45 smithi045 ceph-mon[35556]: pgmap v237: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:46.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:36:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:46 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:36:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:46 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:46 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:36:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:46 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:46.751 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:36:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:46 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:36:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:46 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:46 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:36:46.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:46 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:46 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:36:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:46 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:46.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:46 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:36:46.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:46 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:36:47.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 -- 172.21.15.22:0/701345236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34101de0 msgr2=0x7fbf341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 --2- 172.21.15.22:0/701345236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34101de0 0x7fbf341021c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009900 tx=0x7fbf3002a410 comp rx=0 tx=0).stop 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 -- 172.21.15.22:0/701345236 shutdown_connections 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 --2- 172.21.15.22:0/701345236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34106f10 0x7fbf3410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 --2- 172.21.15.22:0/701345236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34102790 0x7fbf341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 --2- 172.21.15.22:0/701345236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34101de0 0x7fbf341021c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 -- 172.21.15.22:0/701345236 >> 172.21.15.22:0/701345236 conn(0x7fbf340fd8c0 msgr2=0x7fbf340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 -- 172.21.15.22:0/701345236 shutdown_connections 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.186+0000 7fbf3b620640 1 -- 172.21.15.22:0/701345236 wait complete. 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.187+0000 7fbf3b620640 1 Processor -- start 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.187+0000 7fbf3b620640 1 -- start start 2024-09-11T22:36:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 0x7fbf34198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 0x7fbf34198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341120d0 con 0x7fbf34106f10 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34111f50 con 0x7fbf34101de0 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf3b620640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34112250 con 0x7fbf34102790 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34636/0 (socket says 172.21.15.22:34636) 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 -- 172.21.15.22:0/3663764035 learned_addr learned my addr 172.21.15.22:0/3663764035 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 0x7fbf34198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 0x7fbf34198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 -- 172.21.15.22:0/3663764035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 msgr2=0x7fbf34198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 0x7fbf34198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 -- 172.21.15.22:0/3663764035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 msgr2=0x7fbf34198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 0x7fbf34198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 -- 172.21.15.22:0/3663764035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3419d4c0 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 0x7fbf34198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 0x7fbf34198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf39bbd640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00b970 tx=0x7fbf2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf2a7fc640 1 -- 172.21.15.22:0/3663764035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c019070 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.188+0000 7fbf2a7fc640 1 -- 172.21.15.22:0/3663764035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf2c00cb40 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.189+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3419d7b0 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.189+0000 7fbf2a7fc640 1 -- 172.21.15.22:0/3663764035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c007700 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.189+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf341a5090 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.191+0000 7fbf2a7fc640 1 -- 172.21.15.22:0/3663764035 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbf2c01c070 con 0x7fbf34106f10 2024-09-11T22:36:47.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.191+0000 7fbf3d9f9740 1 Processor -- start 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.191+0000 7fbf3d9f9740 1 -- start start 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.191+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 0x56199e8b9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf2a7fc640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 0x7fbf200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56199e8102e0 con 0x56199e8aa3a0 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199e7b7ce0 con 0x56199e8aacc0 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56199e80c2a0 con 0x56199e8b9a90 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34638/0 (socket says 172.21.15.22:34638) 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf39bbd640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 0x7fbf200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3995139564 learned_addr learned my addr 172.21.15.22:0/3995139564 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf2a7fc640 1 -- 172.21.15.22:0/3663764035 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fbf2c0ce9c0 con 0x7fbf34106f10 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 0x56199e8b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3995139564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 msgr2=0x56199e8bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3995139564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 msgr2=0x56199e8b9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 0x56199e8b9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3995139564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199e79c440 con 0x56199e8aa3a0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 0x56199e8b9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf39bbd640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 0x7fbf200a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0cc2f0 tx=0x7fbf2c00e040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400cd50 tx=0x7fbf2400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414c1ef8d3db66e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.192+0000 7fbf1f7fe640 1 -- 172.21.15.22:0/3995139564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24014070 con 0x56199e8aa3a0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf1f7fe640 1 -- 172.21.15.22:0/3995139564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf240047a0 con 0x56199e8aa3a0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf1f7fe640 1 -- 172.21.15.22:0/3995139564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24010940 con 0x56199e8aa3a0 2024-09-11T22:36:47.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3995139564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 msgr2=0x56199e8aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400cd50 tx=0x7fbf2400e720 comp rx=0 tx=0).stop 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3995139564 shutdown_connections 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aacc0 0x56199e8b9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3995139564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8aa780 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3995139564 >> 172.21.15.22:0/3995139564 conn(0x56199e8a6a30 msgr2=0x56199e8a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3995139564 shutdown_connections 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.193+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3995139564 wait complete. 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 -- start start 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 Processor -- start 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8b9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56199e8bc6c0 con 0x56199e8aacc0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199e7cb050 con 0x56199e8aa3a0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56199e8bc840 con 0x56199e8b9a90 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf3d9f9740 10 client.0 _ll_register_callbacks cb 0x56199e80b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf393bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf393bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34654/0 (socket says 172.21.15.22:34654) 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf393bc640 1 -- 172.21.15.22:0/1563150383 learned_addr learned my addr 172.21.15.22:0/1563150383 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.194+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 -- 172.21.15.22:0/1563150383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 msgr2=0x56199e8b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 -- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 msgr2=0x56199e8b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8b9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 -- 172.21.15.22:0/1563150383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199e5813c0 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf393bc640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbf300096c0 tx=0x7fbf300040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246c2f616384fdb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30035070 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf240047a0 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fbf300035f0 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbf300037f0 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf3d9f9740 10 client.16752 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56199e8c8140 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.195+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf240047a0 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fbf3004b070 con 0x56199e8aacc0 2024-09-11T22:36:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 10 client.16752 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 20 client.16752 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e8c95a0 0x56199e8cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 4 client.16752 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56199e81d850 con 0x56199e8c95a0 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e8c95a0 0x56199e8cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e8c95a0 0x56199e8cb9e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c404aaa18cad50bd server_cookie=fc4a93fe174dd7fe in_seq=0 out_seq=0 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.196+0000 7fbf1cff9640 10 client.16752 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf1cff9640 1 -- 172.21.15.22:0/1563150383 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56199e81d850 con 0x56199e8c95a0 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf1cff9640 10 client.16752 handle_command_reply: tid=0 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 client.16752 shutdown 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 msgr2=0x56199e8b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbf300096c0 tx=0x7fbf300040e0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 shutdown_connections 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e8c95a0 0x56199e8cb9e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8b9a90 0x56199e8b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aacc0 0x56199e8b66c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1563150383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 >> 172.21.15.22:0/1563150383 conn(0x56199e8a6a30 msgr2=0x56199e8ac760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.197+0000 7fbf1cff9640 0 client.16752 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.198+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 shutdown_connections 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.198+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1563150383 wait complete. 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.198+0000 7fbf3d9f9740 20 client.16752 trim_cache size 0 max 16384 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 Processor -- start 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 -- start start 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341a9630 con 0x56199e8b9a90 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341abe90 con 0x56199e8aa3a0 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341a9c80 con 0x56199e8aacc0 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34656/0 (socket says 172.21.15.22:34656) 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 -- 172.21.15.22:0/1033613053 learned_addr learned my addr 172.21.15.22:0/1033613053 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf393bc640 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 -- 172.21.15.22:0/1033613053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 msgr2=0x56199e8d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 -- 172.21.15.22:0/1033613053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 msgr2=0x56199e8c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.215+0000 7fbf38bbb640 1 -- 172.21.15.22:0/1033613053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199e8b9780 con 0x56199e8b9a90 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf240105b0 tx=0x7fbf240105e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc99fa308fca639 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf1effd640 1 -- 172.21.15.22:0/1033613053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24014030 con 0x56199e8b9a90 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf1effd640 1 -- 172.21.15.22:0/1033613053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf24010b50 con 0x56199e8b9a90 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf1effd640 1 -- 172.21.15.22:0/1033613053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240269a0 con 0x56199e8b9a90 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1033613053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 msgr2=0x56199e8d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf240105b0 tx=0x7fbf240105e0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1033613053 shutdown_connections 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8b9a90 0x56199e8d17f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/1033613053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8aa3a0 0x56199e8c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1033613053 >> 172.21.15.22:0/1033613053 conn(0x56199e8a6a30 msgr2=0x56199e8b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1033613053 shutdown_connections 2024-09-11T22:36:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.216+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/1033613053 wait complete. 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 -- start start 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 Processor -- start 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8b9a90 0x56199e933280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341aa350 con 0x56199e8aa3a0 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341ab7c0 con 0x56199e8b9a90 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341aaa20 con 0x56199e8aacc0 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf3d9f9740 10 client.0 _ll_register_callbacks cb 0x7fbf30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf38bbb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34672/0 (socket says 172.21.15.22:34672) 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.217+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3061981652 learned_addr learned my addr 172.21.15.22:0/3061981652 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3061981652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 msgr2=0x56199e8be0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8be0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8b9a90 msgr2=0x56199e933280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8b9a90 0x56199e933280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 -- 172.21.15.22:0/3061981652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199e8be970 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf38bbb640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400caa0 tx=0x7fbf24010510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691ff0793b4b220d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24014070 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8484+0+0 (secure 0 0 0) 0x7fbf24010850 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24010b50 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbf24026920 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf3d9f9740 10 client.16758 fetch_fsmap learned FSMap version 22 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56199e9348b0 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.218+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf24010b50 con 0x56199e8aa3a0 2024-09-11T22:36:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fbf2400f550 con 0x56199e8aa3a0 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 10 client.16758 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 20 client.16758 populate_metadata read hostname 'smithi022' 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e934d20 0x56199e937110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 4 client.16758 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56199e817d60 con 0x56199e934d20 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e934d20 0x56199e937110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf393bc640 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e934d20 0x56199e937110 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3124163fabd1a28f server_cookie=4281db7bacdc375 in_seq=0 out_seq=0 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf1cff9640 10 client.16758 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf1cff9640 1 -- 172.21.15.22:0/3061981652 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56199e817d60 con 0x56199e934d20 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf1cff9640 10 client.16758 handle_command_reply: tid=0 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.219+0000 7fbf3d9f9740 1 client.16758 shutdown 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 msgr2=0x56199e8bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400caa0 tx=0x7fbf24010510 comp rx=0 tx=0).stop 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "2427cd20-e16c-4feb-bade-ceb11eaddd41": { 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "2427cd20-e16c-4feb-bade-ceb11eaddd41", 2024-09-11T22:36:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 shutdown_connections 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56199e934d20 0x56199e937110 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199e8b9a90 0x56199e933280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56199e8aacc0 0x56199e8be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 --2- 172.21.15.22:0/3061981652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56199e8aa3a0 0x56199e8bdb80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 >> 172.21.15.22:0/3061981652 conn(0x56199e8a6a30 msgr2=0x56199e8a5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf1cff9640 0 client.16758 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 shutdown_connections 2024-09-11T22:36:47.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 1 -- 172.21.15.22:0/3061981652 wait complete. 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3d9f9740 20 client.16758 trim_cache size 0 max 16384 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 msgr2=0x7fbf200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 0x7fbf200a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0cc2f0 tx=0x7fbf2c00e040 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 msgr2=0x7fbf3419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00b970 tx=0x7fbf2c00be30 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 shutdown_connections 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fbf200a2cf0 0x7fbf200a51b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf34106f10 0x7fbf3419cde0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf34102790 0x7fbf34198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 --2- 172.21.15.22:0/3663764035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf34101de0 0x7fbf34198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 >> 172.21.15.22:0/3663764035 conn(0x7fbf340fd8c0 msgr2=0x7fbf340fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 shutdown_connections 2024-09-11T22:36:47.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:36:47.220+0000 7fbf3b620640 1 -- 172.21.15.22:0/3663764035 wait complete. 2024-09-11T22:36:47.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:47 smithi022 ceph-mon[30966]: pgmap v238: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:47.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:47 smithi169 ceph-mon[35628]: pgmap v238: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:47 smithi045 ceph-mon[35556]: pgmap v238: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:47.936 INFO:tasks.cephfs.filesystem:scrub status for tag:2427cd20-e16c-4feb-bade-ceb11eaddd41 - {'path': '/', 'tag': '2427cd20-e16c-4feb-bade-ceb11eaddd41', 'options': 'recursive,force'} 2024-09-11T22:36:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:49 smithi022 ceph-mon[30966]: pgmap v239: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2024-09-11T22:36:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:49 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:36:49.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:49 smithi169 ceph-mon[35628]: pgmap v239: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2024-09-11T22:36:49.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:49 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:36:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:49 smithi045 ceph-mon[35556]: pgmap v239: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2024-09-11T22:36:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:49 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:36:51.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:51 smithi022 ceph-mon[30966]: pgmap v240: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:51 smithi169 ceph-mon[35628]: pgmap v240: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:51 smithi045 ceph-mon[35556]: pgmap v240: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:53 smithi022 ceph-mon[30966]: pgmap v241: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:53 smithi169 ceph-mon[35628]: pgmap v241: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:53 smithi045 ceph-mon[35556]: pgmap v241: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:55 smithi022 ceph-mon[30966]: pgmap v242: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:55 smithi169 ceph-mon[35628]: pgmap v242: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:55 smithi045 ceph-mon[35556]: pgmap v242: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:57 smithi169 ceph-mon[35628]: pgmap v243: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:57.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:57 smithi022 ceph-mon[30966]: pgmap v243: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:57 smithi045 ceph-mon[35556]: pgmap v243: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:36:59.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:36:59 smithi022 ceph-mon[30966]: pgmap v244: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:59.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:36:59 smithi169 ceph-mon[35628]: pgmap v244: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:36:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:36:59 smithi045 ceph-mon[35556]: pgmap v244: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:01 smithi022 ceph-mon[30966]: pgmap v245: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:01.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:01 smithi169 ceph-mon[35628]: pgmap v245: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:01 smithi045 ceph-mon[35556]: pgmap v245: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:03.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:03 smithi022 ceph-mon[30966]: pgmap v246: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:03.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:03 smithi169 ceph-mon[35628]: pgmap v246: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:03 smithi045 ceph-mon[35556]: pgmap v246: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:05.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:05 smithi022 ceph-mon[30966]: pgmap v247: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:05 smithi169 ceph-mon[35628]: pgmap v247: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:05 smithi045 ceph-mon[35556]: pgmap v247: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:07.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:07 smithi022 ceph-mon[30966]: pgmap v248: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:37:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:07 smithi169 ceph-mon[35628]: pgmap v248: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:37:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:07 smithi045 ceph-mon[35556]: pgmap v248: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:37:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:09 smithi022 ceph-mon[30966]: pgmap v249: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:09 smithi169 ceph-mon[35628]: pgmap v249: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:09 smithi045 ceph-mon[35556]: pgmap v249: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:37:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:10 smithi022 ceph-mon[30966]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:37:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:10 smithi169 ceph-mon[35628]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:37:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:10 smithi045 ceph-mon[35556]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:37:11.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:11 smithi022 ceph-mon[30966]: pgmap v251: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:11.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:11 smithi169 ceph-mon[35628]: pgmap v251: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:11.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:11 smithi045 ceph-mon[35556]: pgmap v251: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:13.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:13 smithi022 ceph-mon[30966]: pgmap v252: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:13 smithi169 ceph-mon[35628]: pgmap v252: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:13 smithi045 ceph-mon[35556]: pgmap v252: 97 pgs: 97 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:15 smithi022 ceph-mon[30966]: pgmap v253: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:37:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:15 smithi169 ceph-mon[35628]: pgmap v253: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:15.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:37:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:15 smithi045 ceph-mon[35556]: pgmap v253: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:15.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:15.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:15.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:15.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:37:17.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:17 smithi022 ceph-mon[30966]: pgmap v254: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:17.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:17 smithi169 ceph-mon[35628]: pgmap v254: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:17.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:17 smithi045 ceph-mon[35556]: pgmap v254: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:17.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:37:18.212 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 -- 172.21.15.22:0/945598840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b00106f20 msgr2=0x7f0b0010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 --2- 172.21.15.22:0/945598840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b00106f20 0x7f0b0010eaa0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009900 tx=0x7f0af802a410 comp rx=0 tx=0).stop 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 -- 172.21.15.22:0/945598840 shutdown_connections 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 --2- 172.21.15.22:0/945598840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b00106f20 0x7f0b0010eaa0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 --2- 172.21.15.22:0/945598840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b001027a0 0x7f0b001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 --2- 172.21.15.22:0/945598840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00101df0 0x7f0b001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 -- 172.21.15.22:0/945598840 >> 172.21.15.22:0/945598840 conn(0x7f0b000fd8f0 msgr2=0x7f0b000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 -- 172.21.15.22:0/945598840 shutdown_connections 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.683+0000 7f0b0593a640 1 -- 172.21.15.22:0/945598840 wait complete. 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 Processor -- start 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 -- start start 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00101df0 0x7f0b001985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 0x7f0b0019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001120a0 con 0x7f0b001027a0 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00111f20 con 0x7f0b00106f20 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.684+0000 7f0b0593a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00112220 con 0x7f0b00101df0 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50942/0 (socket says 172.21.15.22:50942) 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 -- 172.21.15.22:0/1260519569 learned_addr learned my addr 172.21.15.22:0/1260519569 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afeffd640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00101df0 0x7f0b001985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 0x7f0b0019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 -- 172.21.15.22:0/1260519569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00101df0 msgr2=0x7f0b001985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00101df0 0x7f0b001985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 -- 172.21.15.22:0/1260519569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 msgr2=0x7f0b0019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 0x7f0b0019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 -- 172.21.15.22:0/1260519569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0019d570 con 0x7f0b001027a0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 0x7f0b0019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800ea80 tx=0x7f0ae800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0b04938640 1 -- 172.21.15.22:0/1260519569 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800ce40 con 0x7f0b001027a0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0019d860 con 0x7f0b001027a0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001a5140 con 0x7f0b001027a0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0b04938640 1 -- 172.21.15.22:0/1260519569 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ae8004b20 con 0x7f0b001027a0 2024-09-11T22:37:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.685+0000 7f0b04938640 1 -- 172.21.15.22:0/1260519569 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae801f060 con 0x7f0b001027a0 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.688+0000 7f0b04938640 1 -- 172.21.15.22:0/1260519569 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0ae8011760 con 0x7f0b001027a0 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.688+0000 7f0b04938640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 0x7f0aec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b04938640 1 -- 172.21.15.22:0/1260519569 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f0ae80cf4e0 con 0x7f0b001027a0 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0afeffd640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 0x7f0aec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 Processor -- start 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0afeffd640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 0x7f0aec0a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005d00 tx=0x7f0af000b410 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 -- start start 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b9aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559259af32e0 con 0x559259b8ddc0 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559259a9ace0 con 0x559259b98680 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0b07d13740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559259aef2a0 con 0x559259b8d4a0 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.689+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50946/0 (socket says 172.21.15.22:50946) 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3750267721 learned_addr learned my addr 172.21.15.22:0/3750267721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afeffd640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b9aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3750267721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 msgr2=0x559259b8d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b8d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3750267721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 msgr2=0x559259b9aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b9aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3750267721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559259a7f440 con 0x559259b8ddc0 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b9aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8097e80 tx=0x7f0ae809c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad39dba2ae206359 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0af5ffb640 1 -- 172.21.15.22:0/3750267721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80cced0 con 0x559259b8ddc0 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0af5ffb640 1 -- 172.21.15.22:0/3750267721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ae8098090 con 0x559259b8ddc0 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.690+0000 7f0af5ffb640 1 -- 172.21.15.22:0/3750267721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae809b160 con 0x559259b8ddc0 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 -- 172.21.15.22:0/3750267721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 msgr2=0x559259b98140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8097e80 tx=0x7f0ae809c260 comp rx=0 tx=0).stop 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 -- 172.21.15.22:0/3750267721 shutdown_connections 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b9aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b98140 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3750267721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b8d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 -- 172.21.15.22:0/3750267721 >> 172.21.15.22:0/3750267721 conn(0x559259b89a30 msgr2=0x559259b89e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 -- 172.21.15.22:0/3750267721 shutdown_connections 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.691+0000 7f0b07d13740 1 -- 172.21.15.22:0/3750267721 wait complete. 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 -- start start 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 Processor -- start 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b97fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559259b9b250 con 0x559259b8ddc0 2024-09-11T22:37:18.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559259aae050 con 0x559259b98680 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559259b9b3d0 con 0x559259b8d4a0 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0b07d13740 10 client.0 _ll_register_callbacks cb 0x559259aee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50960/0 (socket says 172.21.15.22:50960) 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0afe7fc640 1 -- 172.21.15.22:0/2384149337 learned_addr learned my addr 172.21.15.22:0/2384149337 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.692+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b97fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 -- 172.21.15.22:0/2384149337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 msgr2=0x559259b97fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b97fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 -- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 msgr2=0x559259b957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 -- 172.21.15.22:0/2384149337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592598643c0 con 0x559259b8ddc0 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0ae809b960 tx=0x7f0ae809b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe96d3a6c604ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0adeffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ba300 con 0x559259b8ddc0 2024-09-11T22:37:18.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f0ae80cf040 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ae8098090 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0ae80cf240 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0b07d13740 10 client.16770 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559259ba6c50 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.693+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ae8098090 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x559259b8ddc0 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 10 client.16770 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 20 client.16770 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:18.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259baa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 4 client.16770 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559259b00850 con 0x559259ba7fa0 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259baa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0adeffd640 10 client.16770 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.694+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259baa390 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89b3507d9007d591 server_cookie=7ba4de359b5fa4af in_seq=0 out_seq=0 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0adeffd640 1 -- 172.21.15.22:0/2384149337 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559259b00850 con 0x559259ba7fa0 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0adeffd640 10 client.16770 handle_command_reply: tid=0 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 client.16770 shutdown 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 msgr2=0x559259b95290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0ae809b960 tx=0x7f0ae809b160 comp rx=0 tx=0).stop 2024-09-11T22:37:18.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 shutdown_connections 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259baa390 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0adeffd640 0 client.16770 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b98680 0x559259b957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.695+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8ddc0 0x559259b95290 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.696+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2384149337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8d4a0 0x559259b97fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.696+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 >> 172.21.15.22:0/2384149337 conn(0x559259b89a30 msgr2=0x559259b8f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.696+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 shutdown_connections 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.696+0000 7f0b07d13740 1 -- 172.21.15.22:0/2384149337 wait complete. 2024-09-11T22:37:18.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.696+0000 7f0b07d13740 20 client.16770 trim_cache size 0 max 16384 2024-09-11T22:37:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 Processor -- start 2024-09-11T22:37:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 -- start start 2024-09-11T22:37:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8ddc0 0x559259bad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b98680 0x559259bad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000c6e0 con 0x559259b8d4a0 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000ef40 con 0x559259b8ddc0 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0b07d13740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000cd30 con 0x559259b98680 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8ddc0 0x559259bad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50962/0 (socket says 172.21.15.22:50962) 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 -- 172.21.15.22:0/2982654286 learned_addr learned my addr 172.21.15.22:0/2982654286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b98680 0x559259bad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 -- 172.21.15.22:0/2982654286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b98680 msgr2=0x559259bad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b98680 0x559259bad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 -- 172.21.15.22:0/2982654286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8ddc0 msgr2=0x559259bad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8ddc0 0x559259bad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.727+0000 7f0afeffd640 1 -- 172.21.15.22:0/2982654286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559259b94240 con 0x559259b8d4a0 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.728+0000 7f0afeffd640 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005e00 tx=0x7f0af0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d158257aa059f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.728+0000 7f0af57fa640 1 -- 172.21.15.22:0/2982654286 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0020600 con 0x559259b8d4a0 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.728+0000 7f0af57fa640 1 -- 172.21.15.22:0/2982654286 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0af0020ca0 con 0x559259b8d4a0 2024-09-11T22:37:18.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.728+0000 7f0af57fa640 1 -- 172.21.15.22:0/2982654286 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af001e420 con 0x559259b8d4a0 2024-09-11T22:37:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- 172.21.15.22:0/2982654286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 msgr2=0x559259b93b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005e00 tx=0x7f0af0013000 comp rx=0 tx=0).stop 2024-09-11T22:37:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- 172.21.15.22:0/2982654286 shutdown_connections 2024-09-11T22:37:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b98680 0x559259bad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8ddc0 0x559259bad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 --2- 172.21.15.22:0/2982654286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b8d4a0 0x559259b93b60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- 172.21.15.22:0/2982654286 >> 172.21.15.22:0/2982654286 conn(0x559259b89a30 msgr2=0x559259b88b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- 172.21.15.22:0/2982654286 shutdown_connections 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- 172.21.15.22:0/2982654286 wait complete. 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 -- start start 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.729+0000 7f0b07d13740 1 Processor -- start 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8d4a0 0x559259c0b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 0x559259c0b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000d400 con 0x559259b98680 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000e870 con 0x559259b8d4a0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae000dad0 con 0x559259b8ddc0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0b07d13740 10 client.0 _ll_register_callbacks cb 0x7f0ae809c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50972/0 (socket says 172.21.15.22:50972) 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0aff7fe640 1 -- 172.21.15.22:0/3703516390 learned_addr learned my addr 172.21.15.22:0/3703516390 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 0x559259c0b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afeffd640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8d4a0 0x559259c0b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8d4a0 msgr2=0x559259c0b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8d4a0 0x559259c0b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3703516390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 msgr2=0x559259bad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0afe7fc640 1 -- 172.21.15.22:0/3703516390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559259b8dbf0 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.730+0000 7f0aff7fe640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0afe7fc640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 0x559259c0b950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8005a70 tx=0x7f0ae809ad90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c957f1f2360618 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae809a8e0 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af0020ca0 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f0ae8098090 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0ae80860b0 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 10 client.25999 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559259c12a30 con 0x559259b8ddc0 2024-09-11T22:37:18.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0af0020ca0 con 0x559259b8ddc0 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0ae8086250 con 0x559259b8ddc0 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 10 client.25999 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 10 client.25999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 20 client.25999 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259c14f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 4 client.25999 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.731+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559259afad60 con 0x559259ba7fa0 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0afeffd640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259c14f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0adeffd640 10 client.25999 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0afeffd640 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259c14f00 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a12f4ec5d2314 server_cookie=bbdee736dec2c8cc in_seq=0 out_seq=0 2024-09-11T22:37:18.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0adeffd640 1 -- 172.21.15.22:0/3703516390 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559259afad60 con 0x559259ba7fa0 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0adeffd640 10 client.25999 handle_command_reply: tid=0 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0b07d13740 1 client.25999 shutdown 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.732+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 msgr2=0x559259c0b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 0x559259c0b950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8005a70 tx=0x7f0ae809ad90 comp rx=0 tx=0).stop 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 shutdown_connections 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x559259ba7fa0 0x559259c14f00 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559259b98680 0x559259bad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559259b8ddc0 0x559259c0b950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0adeffd640 0 client.25999 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 --2- 172.21.15.22:0/3703516390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559259b8d4a0 0x559259c0b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 >> 172.21.15.22:0/3703516390 conn(0x559259b89a30 msgr2=0x559259b88a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 shutdown_connections 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 1 -- 172.21.15.22:0/3703516390 wait complete. 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b07d13740 20 client.25999 trim_cache size 0 max 16384 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:37:18.740 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 msgr2=0x7f0aec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 0x7f0aec0a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005d00 tx=0x7f0af000b410 comp rx=0 tx=0).stop 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 msgr2=0x7f0b00198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800ea80 tx=0x7f0ae800ef40 comp rx=0 tx=0).stop 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 shutdown_connections 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f0aec0a2cf0 0x7f0aec0a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b00106f20 0x7f0b0019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b001027a0 0x7f0b00198b00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 --2- 172.21.15.22:0/1260519569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00101df0 0x7f0b001985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:18.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.733+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 >> 172.21.15.22:0/1260519569 conn(0x7f0b000fd8f0 msgr2=0x7f0b000fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:18.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.734+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 shutdown_connections 2024-09-11T22:37:18.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:18.734+0000 7f0b0593a640 1 -- 172.21.15.22:0/1260519569 wait complete. 2024-09-11T22:37:19.528 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:37:19.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:37:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:19 smithi022 ceph-mon[30966]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:37:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:19 smithi022 ceph-mon[30966]: pgmap v256: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-11T22:37:19.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:19 smithi169 ceph-mon[35628]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:37:19.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:19 smithi169 ceph-mon[35628]: pgmap v256: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-11T22:37:19.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:19 smithi045 ceph-mon[35556]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:37:19.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:19 smithi045 ceph-mon[35556]: pgmap v256: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-11T22:37:19.796 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.242+0000 7f19e77a2640 1 -- 172.21.15.22:0/1403175637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 msgr2=0x7f19e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.242+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1403175637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0103120 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009900 tx=0x7f19d002a480 comp rx=0 tx=0).stop 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 -- 172.21.15.22:0/1403175637 shutdown_connections 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1403175637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e010c170 0x7f19e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1403175637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e0103660 0x7f19e010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1403175637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0103120 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 -- 172.21.15.22:0/1403175637 >> 172.21.15.22:0/1403175637 conn(0x7f19e00fc7a0 msgr2=0x7f19e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:20.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 -- 172.21.15.22:0/1403175637 shutdown_connections 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 -- 172.21.15.22:0/1403175637 wait complete. 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 Processor -- start 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.243+0000 7f19e77a2640 1 -- start start 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 0x7f19e0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 0x7f19e019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0112090 con 0x7f19e0102d40 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0111f10 con 0x7f19e010c170 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e77a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0112210 con 0x7f19e0103660 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51004/0 (socket says 172.21.15.22:51004) 2024-09-11T22:37:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 -- 172.21.15.22:0/1006604615 learned_addr learned my addr 172.21.15.22:0/1006604615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e4d3d640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 0x7f19e0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e5d3f640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 0x7f19e019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 -- 172.21.15.22:0/1006604615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 msgr2=0x7f19e0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 0x7f19e0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 -- 172.21.15.22:0/1006604615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 msgr2=0x7f19e019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 0x7f19e019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 -- 172.21.15.22:0/1006604615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e019d4c0 con 0x7f19e0102d40 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e4d3d640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 0x7f19e0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e5d3f640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 0x7f19e019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19e553e640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f19d0006010 tx=0x7f19d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.244+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d003f030 con 0x7f19e0102d40 2024-09-11T22:37:20.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.245+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e019d750 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.245+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19d0003d00 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.245+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0035070 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.245+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a5090 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.246+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e0103120 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.247+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f19d0042030 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.247+0000 7f19d67fc640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 0x7f19cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.248+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f19d00efd80 con 0x7f19e0102d40 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.248+0000 7f19e4d3d640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 0x7f19cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.248+0000 7f19e4d3d640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 0x7f19cc0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005d90 tx=0x7f19dc005d20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:20.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.251+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19d00bca80 con 0x7f19e0102d40 2024-09-11T22:37:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.461+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19e0107210 con 0x7f19e0102d40 2024-09-11T22:37:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.462+0000 7f19d67fc640 1 -- 172.21.15.22:0/1006604615 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f19d00bc380 con 0x7f19e0102d40 2024-09-11T22:37:20.463 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:37:20.463 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:37:20.463 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 msgr2=0x7f19cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 0x7f19cc0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19dc005d90 tx=0x7f19dc005d20 comp rx=0 tx=0).stop 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 msgr2=0x7f19e0198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f19d0006010 tx=0x7f19d00042f0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 shutdown_connections 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f19cc0a2cf0 0x7f19cc0a51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e010c170 0x7f19e019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f19e0103660 0x7f19e0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 --2- 172.21.15.22:0/1006604615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19e0102d40 0x7f19e0198510 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 >> 172.21.15.22:0/1006604615 conn(0x7f19e00fc7a0 msgr2=0x7f19e00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 shutdown_connections 2024-09-11T22:37:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:20.464+0000 7f19e77a2640 1 -- 172.21.15.22:0/1006604615 wait complete. 2024-09-11T22:37:20.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:20 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1006604615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:37:20.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:20 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1006604615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:37:20.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:20 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1006604615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:37:21.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:37:21.401 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:21.768 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:21 smithi022 ceph-mon[30966]: pgmap v257: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.852+0000 7fea54e0c640 1 -- 172.21.15.22:0/1662378188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50106f10 msgr2=0x7fea5010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.852+0000 7fea54e0c640 1 --2- 172.21.15.22:0/1662378188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50106f10 0x7fea5010ea90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fea48009ca0 tx=0x7fea4802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.852+0000 7fea54e0c640 1 -- 172.21.15.22:0/1662378188 shutdown_connections 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 --2- 172.21.15.22:0/1662378188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50106f10 0x7fea5010ea90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 --2- 172.21.15.22:0/1662378188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 0x7fea501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 --2- 172.21.15.22:0/1662378188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50101de0 0x7fea501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 -- 172.21.15.22:0/1662378188 >> 172.21.15.22:0/1662378188 conn(0x7fea500fd8c0 msgr2=0x7fea500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 -- 172.21.15.22:0/1662378188 shutdown_connections 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 -- 172.21.15.22:0/1662378188 wait complete. 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 Processor -- start 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.853+0000 7fea54e0c640 1 -- start start 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 0x7fea501989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50106f10 0x7fea5019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea50112090 con 0x7fea50101de0 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea50111f10 con 0x7fea50102790 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea50112210 con 0x7fea50106f10 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51026/0 (socket says 172.21.15.22:51026) 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 -- 172.21.15.22:0/831820721 learned_addr learned my addr 172.21.15.22:0/831820721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:21.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 0x7fea501989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50106f10 0x7fea5019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 -- 172.21.15.22:0/831820721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50106f10 msgr2=0x7fea5019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50106f10 0x7fea5019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 -- 172.21.15.22:0/831820721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 msgr2=0x7fea501989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 0x7fea501989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 -- 172.21.15.22:0/831820721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5019d460 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea4e59c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c970 tx=0x7fea4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea477fe640 1 -- 172.21.15.22:0/831820721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40007bb0 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5019d750 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea477fe640 1 -- 172.21.15.22:0/831820721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea40007d50 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea477fe640 1 -- 172.21.15.22:0/831820721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4000f4b0 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.854+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea501a5030 con 0x7fea50101de0 2024-09-11T22:37:21.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.857+0000 7fea477fe640 1 -- 172.21.15.22:0/831820721 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fea400046c0 con 0x7fea50101de0 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.857+0000 7fea571e5740 1 Processor -- start 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.857+0000 7fea571e5740 1 -- start start 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.857+0000 7fea571e5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002666af50 0x5600266694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.857+0000 7fea571e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea571e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560026674780 0x560026676b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea571e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5600265cb2f0 con 0x5600266699e0 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea571e5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560026572cf0 con 0x56002666af50 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea571e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5600265c72b0 con 0x560026674780 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea477fe640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 0x7fea3c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51034/0 (socket says 172.21.15.22:51034) 2024-09-11T22:37:21.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 -- 172.21.15.22:0/2926336023 learned_addr learned my addr 172.21.15.22:0/2926336023 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002666af50 0x5600266694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea477fe640 1 -- 172.21.15.22:0/831820721 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea400cf140 con 0x7fea50101de0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 0x7fea3c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560026674780 0x560026676b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 -- 172.21.15.22:0/2926336023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560026674780 msgr2=0x560026676b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560026674780 0x560026676b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 -- 172.21.15.22:0/2926336023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002666af50 msgr2=0x5600266694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002666af50 0x5600266694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 -- 172.21.15.22:0/2926336023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600265573a0 con 0x5600266699e0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fea40007590 tx=0x7fea4006d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a210ddd5fa67554a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea44ff9640 1 -- 172.21.15.22:0/2926336023 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4001d030 con 0x5600266699e0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea44ff9640 1 -- 172.21.15.22:0/2926336023 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea4009fa30 con 0x5600266699e0 2024-09-11T22:37:21.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea44ff9640 1 -- 172.21.15.22:0/2926336023 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea400baa40 con 0x5600266699e0 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.858+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 0x7fea3c0a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea48006010 tx=0x7fea4802a8c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 -- 172.21.15.22:0/2926336023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 msgr2=0x560026669e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fea40007590 tx=0x7fea4006d6f0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 -- 172.21.15.22:0/2926336023 shutdown_connections 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560026674780 0x560026676b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026669e20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 --2- 172.21.15.22:0/2926336023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56002666af50 0x5600266694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 -- 172.21.15.22:0/2926336023 >> 172.21.15.22:0/2926336023 conn(0x56002662e310 msgr2=0x560026666070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 -- 172.21.15.22:0/2926336023 shutdown_connections 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.859+0000 7fea571e5740 1 -- 172.21.15.22:0/2926336023 wait complete. 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 -- start start 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 Processor -- start 2024-09-11T22:37:21.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026671470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x560026671c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560026677420 con 0x5600266699e0 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560026586060 con 0x560026674780 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5600266775a0 con 0x56002666af50 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea571e5740 10 client.0 _ll_register_callbacks cb 0x5600262d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51046/0 (socket says 172.21.15.22:51046) 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 -- 172.21.15.22:0/247223435 learned_addr learned my addr 172.21.15.22:0/247223435 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026671470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x560026671c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 -- 172.21.15.22:0/247223435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 msgr2=0x560026671470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026671470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 -- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 msgr2=0x560026671c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x560026671c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.860+0000 7fea4e59c640 1 -- 172.21.15.22:0/247223435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002633c3c0 con 0x5600266699e0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026671470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x560026671c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea4e59c640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fea4009b6c0 tx=0x7fea40098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b154a101928d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4001d070 con 0x5600266699e0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea400a4070 con 0x5600266699e0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea4009fa30 con 0x5600266699e0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea400ba9a0 con 0x5600266699e0 2024-09-11T22:37:21.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 10 client.16794 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560026682f10 con 0x5600266699e0 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea4009fa30 con 0x5600266699e0 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea400b1ce0 con 0x5600266699e0 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 10 client.16794 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 20 client.16794 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560026684260 0x560026686650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 4 client.16794 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.861+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600265d8860 con 0x560026684260 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.862+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560026684260 0x560026686650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.862+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560026684260 0x560026686650 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aea549a3109ee9c server_cookie=fc6f68c97ad73bd1 in_seq=0 out_seq=0 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.862+0000 7fea35ffb640 10 client.16794 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:21.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea35ffb640 1 -- 172.21.15.22:0/247223435 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600265d8860 con 0x560026684260 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea35ffb640 10 client.16794 handle_command_reply: tid=0 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 client.16794 shutdown 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 msgr2=0x5600266741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fea4009b6c0 tx=0x7fea40098040 comp rx=0 tx=0).stop 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 shutdown_connections 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x560026684260 0x560026686650 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x560026671c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026671470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea35ffb640 0 client.16794 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 --2- 172.21.15.22:0/247223435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x5600266741c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 >> 172.21.15.22:0/247223435 conn(0x56002662e310 msgr2=0x56002666bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 shutdown_connections 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 1 -- 172.21.15.22:0/247223435 wait complete. 2024-09-11T22:37:21.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.863+0000 7fea571e5740 20 client.16794 trim_cache size 0 max 16384 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 Processor -- start 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 -- start start 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600266699e0 0x56002667ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x56002666ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea501a96d0 con 0x56002666af50 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea501abf30 con 0x560026674780 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea571e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea501a9d20 con 0x5600266699e0 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51054/0 (socket says 172.21.15.22:51054) 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4dd9b640 1 -- 172.21.15.22:0/1457847940 learned_addr learned my addr 172.21.15.22:0/1457847940 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x56002666ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4e59c640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600266699e0 0x56002667ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.876+0000 7fea4dd9b640 1 -- 172.21.15.22:0/1457847940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600266699e0 msgr2=0x56002667ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600266699e0 0x56002667ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4dd9b640 1 -- 172.21.15.22:0/1457847940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 msgr2=0x56002666ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x56002666ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4dd9b640 1 -- 172.21.15.22:0/1457847940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560026671f70 con 0x56002666af50 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x56002666ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x560026670d00 tx=0x7fea3800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c035b0430ca7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea37fff640 1 -- 172.21.15.22:0/1457847940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3801f070 con 0x56002666af50 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea37fff640 1 -- 172.21.15.22:0/1457847940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea38003c40 con 0x56002666af50 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea37fff640 1 -- 172.21.15.22:0/1457847940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3801b5b0 con 0x56002666af50 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea571e5740 1 -- 172.21.15.22:0/1457847940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 msgr2=0x56002666c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.877+0000 7fea571e5740 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x560026670d00 tx=0x7fea3800b390 comp rx=0 tx=0).stop 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- 172.21.15.22:0/1457847940 shutdown_connections 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x56002666ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56002666af50 0x56002666c530 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- 172.21.15.22:0/1457847940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600266699e0 0x56002667ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- 172.21.15.22:0/1457847940 >> 172.21.15.22:0/1457847940 conn(0x56002662e310 msgr2=0x56002667f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- 172.21.15.22:0/1457847940 shutdown_connections 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- 172.21.15.22:0/1457847940 wait complete. 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- start start 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 Processor -- start 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026687ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x5600266edba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea501aa3f0 con 0x5600266699e0 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea501ab860 con 0x560026674780 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea501aaac0 con 0x56002666af50 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea571e5740 10 client.0 _ll_register_callbacks cb 0x7fea4000a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea4e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51056/0 (socket says 172.21.15.22:51056) 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.878+0000 7fea4e59c640 1 -- 172.21.15.22:0/2369548340 learned_addr learned my addr 172.21.15.22:0/2369548340 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026687ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x5600266edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 -- 172.21.15.22:0/2369548340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 msgr2=0x560026687ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026687ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 -- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 msgr2=0x5600266edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x5600266edba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 -- 172.21.15.22:0/2369548340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600266ee0e0 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026687ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4ed9d640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x5600266edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea4e59c640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fea40097b90 tx=0x7fea400979d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ec08161e5eb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4004e070 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fea4009a640 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea38003c40 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea4001d070 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea571e5740 10 client.16800 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5600266ef340 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.879+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea38003c40 con 0x5600266699e0 2024-09-11T22:37:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fea400a0bc0 con 0x5600266699e0 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 10 client.16800 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 20 client.16800 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5600266ef810 0x5600266f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 4 client.16800 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600265d2d70 con 0x5600266ef810 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5600266ef810 0x5600266f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea4dd9b640 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5600266ef810 0x5600266f1c20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a012ea3ff358e63d server_cookie=5f91b63a3060050a in_seq=0 out_seq=0 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.880+0000 7fea35ffb640 10 client.16800 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea35ffb640 1 -- 172.21.15.22:0/2369548340 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600265d2d70 con 0x5600266ef810 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea35ffb640 10 client.16800 handle_command_reply: tid=0 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 client.16800 shutdown 2024-09-11T22:37:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 msgr2=0x560026687ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fea40097b90 tx=0x7fea400979d0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 shutdown_connections 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5600266ef810 0x5600266f1c20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea35ffb640 0 client.16800 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560026674780 0x5600266edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56002666af50 0x560026687ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 --2- 172.21.15.22:0/2369548340 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600266699e0 0x560026687ab0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 >> 172.21.15.22:0/2369548340 conn(0x56002662e310 msgr2=0x560026680050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 shutdown_connections 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 1 -- 172.21.15.22:0/2369548340 wait complete. 2024-09-11T22:37:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.881+0000 7fea571e5740 20 client.16800 trim_cache size 0 max 16384 2024-09-11T22:37:21.899 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:37:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 msgr2=0x7fea3c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 0x7fea3c0a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fea48006010 tx=0x7fea4802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 msgr2=0x7fea501984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c970 tx=0x7fea4000ce30 comp rx=0 tx=0).stop 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 shutdown_connections 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fea3c0a2cf0 0x7fea3c0a51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea50106f10 0x7fea5019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea50102790 0x7fea501989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 --2- 172.21.15.22:0/831820721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea50101de0 0x7fea501984b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 >> 172.21.15.22:0/831820721 conn(0x7fea500fd8c0 msgr2=0x7fea500feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 shutdown_connections 2024-09-11T22:37:21.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:21.882+0000 7fea54e0c640 1 -- 172.21.15.22:0/831820721 wait complete. 2024-09-11T22:37:21.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:21 smithi169 ceph-mon[35628]: pgmap v257: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:21 smithi045 ceph-mon[35556]: pgmap v257: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:23.687 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:37:23.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:37:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:23 smithi022 ceph-mon[30966]: pgmap v258: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:23 smithi169 ceph-mon[35628]: pgmap v258: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:23 smithi045 ceph-mon[35556]: pgmap v258: 97 pgs: 97 active+clean; 11 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T22:37:23.962 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2727493025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 msgr2=0x7f74c410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2727493025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c410e600 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ca0 tx=0x7f74bc02a950 comp rx=0 tx=0).stop 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2727493025 shutdown_connections 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2727493025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c410e600 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2727493025 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c41036c0 0x7f74c410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2727493025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 0x7f74c4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2727493025 >> 172.21.15.22:0/2727493025 conn(0x7f74c40fc7a0 msgr2=0x7f74c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2727493025 shutdown_connections 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2727493025 wait complete. 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 Processor -- start 2024-09-11T22:37:24.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.402+0000 7f74cbe4d640 1 -- start start 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 0x7f74c4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c41036c0 0x7f74c4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41120e0 con 0x7f74c410c180 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f74c4111f60 con 0x7f74c4102da0 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74cbe4d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74c4112260 con 0x7f74c41036c0 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52056/0 (socket says 172.21.15.22:52056) 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 -- 172.21.15.22:0/2923490419 learned_addr learned my addr 172.21.15.22:0/2923490419 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74c9be9640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 0x7f74c4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 -- 172.21.15.22:0/2923490419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c41036c0 msgr2=0x7f74c4100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c41036c0 0x7f74c4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 -- 172.21.15.22:0/2923490419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 msgr2=0x7f74c4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 0x7f74c4100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 -- 172.21.15.22:0/2923490419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c41a69a0 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74ca3ea640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005cc0 tx=0x7f74bc02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74baffd640 1 -- 172.21.15.22:0/2923490419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc034040 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.403+0000 7f74baffd640 1 -- 172.21.15.22:0/2923490419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74bc030940 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.404+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c41a6c30 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.404+0000 7f74baffd640 1 -- 172.21.15.22:0/2923490419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0456e0 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.404+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c41a7110 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74baffd640 1 -- 172.21.15.22:0/2923490419 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f74bc037020 con 0x7f74c410c180 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 Processor -- start 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 -- start start 2024-09-11T22:37:24.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fce3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b86fc49280 con 0x55b86fce4480 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b86fbf0b10 con 0x55b86fceed40 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.406+0000 7f74ce226740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b86fc45240 con 0x55b86fce3b60 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74baffd640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 0x7f74b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52062/0 (socket says 172.21.15.22:52062) 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 -- 172.21.15.22:0/260188982 learned_addr learned my addr 172.21.15.22:0/260188982 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c93e8640 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c93e8640 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fce3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74ca3ea640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 0x7f74b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74baffd640 1 -- 172.21.15.22:0/2923490419 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f74bc0f03c0 con 0x7f74c410c180 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 -- 172.21.15.22:0/260188982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 msgr2=0x55b86fce3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fce3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 -- 172.21.15.22:0/260188982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 msgr2=0x55b86fcf1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 -- 172.21.15.22:0/260188982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86fbfd1f0 con 0x55b86fce4480 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74c9be9640 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009b60 tx=0x7f74c000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33bd2d86c3387b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74ca3ea640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 0x7f74b00a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b8e70 tx=0x7f74bc0b1ea0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.407+0000 7f74affff640 1 -- 172.21.15.22:0/260188982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0016070 con 0x55b86fce4480 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74affff640 1 -- 172.21.15.22:0/260188982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74c0009e50 con 0x55b86fce4480 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74affff640 1 -- 172.21.15.22:0/260188982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0011490 con 0x55b86fce4480 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 -- 172.21.15.22:0/260188982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 msgr2=0x55b86fcee800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009b60 tx=0x7f74c000e6c0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 -- 172.21.15.22:0/260188982 shutdown_connections 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce4480 0x55b86fcee800 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 --2- 172.21.15.22:0/260188982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fce3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 -- 172.21.15.22:0/260188982 >> 172.21.15.22:0/260188982 conn(0x55b86fce00f0 msgr2=0x55b86fce04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 -- 172.21.15.22:0/260188982 shutdown_connections 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.408+0000 7f74ce226740 1 -- 172.21.15.22:0/260188982 wait complete. 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 -- start start 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 Processor -- start 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fcebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fcec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b86fcf1910 con 0x55b86fceed40 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b86fc03f10 con 0x55b86fce4480 2024-09-11T22:37:24.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b86fcf1a90 con 0x55b86fce3b60 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74ce226740 10 client.0 _ll_register_callbacks cb 0x55b86fbcca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52064/0 (socket says 172.21.15.22:52064) 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74c93e8640 1 -- 172.21.15.22:0/1761156456 learned_addr learned my addr 172.21.15.22:0/1761156456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.409+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fcec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fcebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 -- 172.21.15.22:0/1761156456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 msgr2=0x55b86fcebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fcebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 -- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 msgr2=0x55b86fcec0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fcec0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 -- 172.21.15.22:0/1761156456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86f9ba6a0 con 0x55b86fceed40 2024-09-11T22:37:24.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fcec0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f74b4015870 tx=0x7f74b4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653d9b31ca3ae0e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b401d060 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f74b4008b80 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74c0009e50 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f74b4012040 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ce226740 10 client.16812 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b86fcfd510 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.410+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74c0009e50 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f74b4014760 con 0x55b86fceed40 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 10 client.16812 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:24.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 20 client.16812 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fcfe9d0 0x55b86fd00dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 4 client.16812 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b86fc567f0 con 0x55b86fcfe9d0 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fcfe9d0 0x55b86fd00dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fcfe9d0 0x55b86fd00dc0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c3e6177361418b server_cookie=e66a0b4fde74b1f6 in_seq=0 out_seq=0 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.411+0000 7f74ad7fa640 10 client.16812 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1761156456 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b86fc567f0 con 0x55b86fcfe9d0 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ad7fa640 10 client.16812 handle_command_reply: tid=0 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 client.16812 shutdown 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 msgr2=0x55b86fcec600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f74b4015870 tx=0x7f74b4009f90 comp rx=0 tx=0).stop 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 shutdown_connections 2024-09-11T22:37:24.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fcfe9d0 0x55b86fd00dc0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fceed40 0x55b86fcec600 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fcec0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ad7fa640 0 client.16812 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 --2- 172.21.15.22:0/1761156456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce3b60 0x55b86fcebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 >> 172.21.15.22:0/1761156456 conn(0x55b86fce00f0 msgr2=0x55b86fcdf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 shutdown_connections 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.412+0000 7f74ce226740 1 -- 172.21.15.22:0/1761156456 wait complete. 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.413+0000 7f74ce226740 20 client.16812 trim_cache size 0 max 16384 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 Processor -- start 2024-09-11T22:37:24.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 -- start start 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fced9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fceed40 0x55b86fd06650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41adaa0 con 0x55b86fce3b60 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41b0300 con 0x55b86fce4480 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74ce226740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41ae0f0 con 0x55b86fceed40 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52070/0 (socket says 172.21.15.22:52070) 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 -- 172.21.15.22:0/1226846588 learned_addr learned my addr 172.21.15.22:0/1226846588 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fced9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 -- 172.21.15.22:0/1226846588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fceed40 msgr2=0x55b86fd06650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fceed40 0x55b86fd06650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 -- 172.21.15.22:0/1226846588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 msgr2=0x55b86fced9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fced9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c93e8640 1 -- 172.21.15.22:0/1226846588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86fd01420 con 0x55b86fce3b60 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.430+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fced9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f74b4014b30 tx=0x7f74b4015540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ae6e7a5af86f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74af7fe640 1 -- 172.21.15.22:0/1226846588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b402e070 con 0x55b86fce3b60 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74af7fe640 1 -- 172.21.15.22:0/1226846588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74b4014830 con 0x55b86fce3b60 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74af7fe640 1 -- 172.21.15.22:0/1226846588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004a30 con 0x55b86fce3b60 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 -- 172.21.15.22:0/1226846588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 msgr2=0x55b86fce65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f74b4014b30 tx=0x7f74b4015540 comp rx=0 tx=0).stop 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 -- 172.21.15.22:0/1226846588 shutdown_connections 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fceed40 0x55b86fd06650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fce4480 0x55b86fced9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 --2- 172.21.15.22:0/1226846588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fce65c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 -- 172.21.15.22:0/1226846588 >> 172.21.15.22:0/1226846588 conn(0x55b86fce00f0 msgr2=0x55b86fced2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 -- 172.21.15.22:0/1226846588 shutdown_connections 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.431+0000 7f74ce226740 1 -- 172.21.15.22:0/1226846588 wait complete. 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 -- start start 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 Processor -- start 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 0x55b86fcf28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41ae7c0 con 0x55b86fce3b60 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41afc30 con 0x55b86fceed40 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74c41aee90 con 0x55b86fce4480 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74ce226740 10 client.0 _ll_register_callbacks cb 0x7f74b4001820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74c93e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52078/0 (socket says 172.21.15.22:52078) 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.432+0000 7f74c93e8640 1 -- 172.21.15.22:0/1356330441 learned_addr learned my addr 172.21.15.22:0/1356330441 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 0x55b86fcf28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 -- 172.21.15.22:0/1356330441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 msgr2=0x55b86fcf28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 0x55b86fcf28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 -- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 msgr2=0x55b86fcf2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 -- 172.21.15.22:0/1356330441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86fcdff20 con 0x55b86fce3b60 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 0x55b86fcf28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74c93e8640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009de0 tx=0x7f74b4001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979abfad02d3560f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:24.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b402e070 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f74b40047d0 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74b4014830 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f74b4014e20 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ce226740 10 client.16818 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55b86fd69510 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74b4014830 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.433+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f74b403e020 con 0x55b86fce3b60 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 10 client.16818 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 20 client.16818 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fd69ac0 0x55b86fd6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:24.469 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:37:24.469 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:37:24.469 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "9c22fd4e-3f4d-4a73-9b9d-3a31a3065f76", 2024-09-11T22:37:24.469 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:37:24.469 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 4 client.16818 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b86fc50d00 con 0x55b86fd69ac0 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fd69ac0 0x55b86fd6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74ad7fa640 10 client.16818 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.434+0000 7f74c9be9640 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fd69ac0 0x55b86fd6beb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65341296e695aa3 server_cookie=775de24c0bf210a7 in_seq=0 out_seq=0 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ad7fa640 1 -- 172.21.15.22:0/1356330441 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b86fc50d00 con 0x55b86fd69ac0 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ad7fa640 10 client.16818 handle_command_reply: tid=0 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ce226740 1 client.16818 shutdown 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 msgr2=0x55b86fcf7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009de0 tx=0x7f74b4001280 comp rx=0 tx=0).stop 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.435+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 shutdown_connections 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55b86fd69ac0 0x55b86fd6beb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b86fceed40 0x55b86fcf2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b86fce4480 0x55b86fcf28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 --2- 172.21.15.22:0/1356330441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b86fce3b60 0x55b86fcf7570 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ad7fa640 0 client.16818 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 >> 172.21.15.22:0/1356330441 conn(0x55b86fce00f0 msgr2=0x55b86fcec360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 shutdown_connections 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 1 -- 172.21.15.22:0/1356330441 wait complete. 2024-09-11T22:37:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74ce226740 20 client.16818 trim_cache size 0 max 16384 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 msgr2=0x7f74b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 0x7f74b00a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b8e70 tx=0x7f74bc0b1ea0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 msgr2=0x7f74c4101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.436+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005cc0 tx=0x7f74bc02f790 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 shutdown_connections 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f74b00a2cf0 0x7f74b00a51b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74c410c180 0x7f74c4101480 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74c41036c0 0x7f74c4100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 --2- 172.21.15.22:0/2923490419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c4102da0 0x7f74c4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 >> 172.21.15.22:0/2923490419 conn(0x7f74c40fc7a0 msgr2=0x7f74c40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 shutdown_connections 2024-09-11T22:37:24.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:24.437+0000 7f74cbe4d640 1 -- 172.21.15.22:0/2923490419 wait complete. 2024-09-11T22:37:25.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:37:25.485 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:25.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:25 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:37:25.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:25 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:25 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:37:25.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:25 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.781 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:25 smithi022 ceph-mon[30966]: pgmap v259: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:25 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:37:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:25 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:25 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:37:25.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:25 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:25 smithi169 ceph-mon[35628]: pgmap v259: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:25 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:37:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:25 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:25 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:37:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:25 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:37:25.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:25 smithi045 ceph-mon[35556]: pgmap v259: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 -- 172.21.15.22:0/4184090991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102570 msgr2=0x7f27b81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/4184090991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102570 0x7f27b81029b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009900 tx=0x7f27a802a480 comp rx=0 tx=0).stop 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 -- 172.21.15.22:0/4184090991 shutdown_connections 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/4184090991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102ef0 0x7f27b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/4184090991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102570 0x7f27b81029b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/4184090991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 -- 172.21.15.22:0/4184090991 >> 172.21.15.22:0/4184090991 conn(0x7f27b80fc7d0 msgr2=0x7f27b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 -- 172.21.15.22:0/4184090991 shutdown_connections 2024-09-11T22:37:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.028+0000 7f27bfbf9640 1 -- 172.21.15.22:0/4184090991 wait complete. 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 Processor -- start 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 -- start start 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102570 0x7f27b8197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81110a0 con 0x7f27b8102ef0 2024-09-11T22:37:26.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8110f20 con 0x7f27b8102570 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bfbf9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8111220 con 0x7f27b8100e20 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27be196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bd995640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27be196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52090/0 (socket says 172.21.15.22:52090) 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27be196640 1 -- 172.21.15.22:0/29658984 learned_addr learned my addr 172.21.15.22:0/29658984 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.029+0000 7f27bd194640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102570 0x7f27b8197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 -- 172.21.15.22:0/29658984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102570 msgr2=0x7f27b8197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102570 0x7f27b8197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 -- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 msgr2=0x7f27b819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 -- 172.21.15.22:0/29658984 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b819c770 con 0x7f27b8100e20 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27be196640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bd995640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b81971e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005fd0 tx=0x7f27b400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27aeffd640 1 -- 172.21.15.22:0/29658984 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400cd80 con 0x7f27b8100e20 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27aeffd640 1 -- 172.21.15.22:0/29658984 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27b4004b20 con 0x7f27b8100e20 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b819ca60 con 0x7f27b8100e20 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27aeffd640 1 -- 172.21.15.22:0/29658984 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b40117a0 con 0x7f27b8100e20 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.030+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b819cf20 con 0x7f27b8100e20 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 Processor -- start 2024-09-11T22:37:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 -- start start 2024-09-11T22:37:26.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27aeffd640 1 -- 172.21.15.22:0/29658984 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f27b4004cd0 con 0x7f27b8100e20 2024-09-11T22:37:26.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72ad4a0 0x563ca72ad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72addc0 0x563ca72b8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563ca72132e0 con 0x563ca72b8680 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563ca71bace0 con 0x563ca72addc0 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ca720f2a0 con 0x563ca72ad4a0 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27bd194640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27bd194640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52104/0 (socket says 172.21.15.22:52104) 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27bd194640 1 -- 172.21.15.22:0/2122755681 learned_addr learned my addr 172.21.15.22:0/2122755681 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.033+0000 7f27bd995640 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72addc0 0x563ca72b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27be196640 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72ad4a0 0x563ca72ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 -- 172.21.15.22:0/2122755681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72ad4a0 msgr2=0x563ca72ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72ad4a0 0x563ca72ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 -- 172.21.15.22:0/2122755681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72addc0 msgr2=0x563ca72b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72addc0 0x563ca72b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 -- 172.21.15.22:0/2122755681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca719f440 con 0x563ca72b8680 2024-09-11T22:37:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27bd194640 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009900 tx=0x7f27a8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f953278a1f491f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27aeffd640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 0x7f27a40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27be196640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 0x7f27a40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27a3fff640 1 -- 172.21.15.22:0/2122755681 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8040070 con 0x563ca72b8680 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27aeffd640 1 -- 172.21.15.22:0/29658984 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27b40cf8e0 con 0x7f27b8100e20 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27a3fff640 1 -- 172.21.15.22:0/2122755681 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a80319a0 con 0x563ca72b8680 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.034+0000 7f27a3fff640 1 -- 172.21.15.22:0/2122755681 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8035040 con 0x563ca72b8680 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2122755681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 msgr2=0x563ca72baa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009900 tx=0x7f27a8005c00 comp rx=0 tx=0).stop 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27be196640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 0x7f27a40a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27b0011630 tx=0x7f27b000b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2122755681 shutdown_connections 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72baa70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72addc0 0x563ca72b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2122755681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72ad4a0 0x563ca72ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2122755681 >> 172.21.15.22:0/2122755681 conn(0x563ca72a9a30 msgr2=0x563ca72a9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2122755681 shutdown_connections 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.035+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2122755681 wait complete. 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 -- start start 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 Processor -- start 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563ca72bb250 con 0x563ca72ad4a0 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563ca71ce050 con 0x563ca72b8680 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563ca72bb3d0 con 0x563ca72addc0 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27c1fd2740 10 client.0 _ll_register_callbacks cb 0x563ca720e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.036+0000 7f27bd995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52120/0 (socket says 172.21.15.22:52120) 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 -- 172.21.15.22:0/1658139833 learned_addr learned my addr 172.21.15.22:0/1658139833 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27be196640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd194640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 -- 172.21.15.22:0/1658139833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 msgr2=0x563ca72b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 -- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 msgr2=0x563ca72b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 -- 172.21.15.22:0/1658139833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca6f843c0 con 0x563ca72ad4a0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd194640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27bd995640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f27b400efd0 tx=0x7f27b4005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ce83e05b2f0cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b401f070 con 0x563ca72ad4a0 2024-09-11T22:37:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27b40a4800 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a80319a0 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f27b409ba10 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27c1fd2740 10 client.16830 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.037+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563ca72c6b40 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a80319a0 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f27b400f040 con 0x563ca72ad4a0 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 10 client.16830 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 20 client.16830 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca72c7f50 0x563ca72ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 4 client.16830 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ca7220850 con 0x563ca72c7f50 2024-09-11T22:37:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.038+0000 7f27bd194640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca72c7f50 0x563ca72ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.039+0000 7f27bd194640 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca72c7f50 0x563ca72ca380 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a656c4cc7bd7475 server_cookie=12f0c5afaec2484f in_seq=0 out_seq=0 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.039+0000 7f27a17fa640 10 client.16830 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.039+0000 7f27a17fa640 1 -- 172.21.15.22:0/1658139833 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ca7220850 con 0x563ca72c7f50 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.039+0000 7f27a17fa640 10 client.16830 handle_command_reply: tid=0 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.039+0000 7f27c1fd2740 1 client.16830 shutdown 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 msgr2=0x563ca72b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f27b400efd0 tx=0x7f27b4005820 comp rx=0 tx=0).stop 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 shutdown_connections 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca72c7f50 0x563ca72ca380 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/1658139833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72b7e90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27a17fa640 0 client.16830 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 >> 172.21.15.22:0/1658139833 conn(0x563ca72a9a30 msgr2=0x563ca72af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 shutdown_connections 2024-09-11T22:37:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 1 -- 172.21.15.22:0/1658139833 wait complete. 2024-09-11T22:37:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.040+0000 7f27c1fd2740 20 client.16830 trim_cache size 0 max 16384 2024-09-11T22:37:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 Processor -- start 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 -- start start 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b1eb0 con 0x563ca72ad4a0 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b4710 con 0x563ca72b8680 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b2500 con 0x563ca72addc0 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27bd995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27bd995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52136/0 (socket says 172.21.15.22:52136) 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.057+0000 7f27bd995640 1 -- 172.21.15.22:0/2678283514 learned_addr learned my addr 172.21.15.22:0/2678283514 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27be196640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd194640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 -- 172.21.15.22:0/2678283514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 msgr2=0x563ca72cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 -- 172.21.15.22:0/2678283514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 msgr2=0x563ca72d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 -- 172.21.15.22:0/2678283514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca72adbf0 con 0x563ca72ad4a0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27be196640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd194640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27bd995640 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f27b409a180 tx=0x7f27b400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1775c08c0aee27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27a37fe640 1 -- 172.21.15.22:0/2678283514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b401f070 con 0x563ca72ad4a0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27a37fe640 1 -- 172.21.15.22:0/2678283514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27b409bed0 con 0x563ca72ad4a0 2024-09-11T22:37:26.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.058+0000 7f27a37fe640 1 -- 172.21.15.22:0/2678283514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b409b830 con 0x563ca72ad4a0 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2678283514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 msgr2=0x563ca72a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f27b409a180 tx=0x7f27b400cf20 comp rx=0 tx=0).stop 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2678283514 shutdown_connections 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72b8680 0x563ca72d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/2678283514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72ad4a0 0x563ca72a8a60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2678283514 >> 172.21.15.22:0/2678283514 conn(0x563ca72a9a30 msgr2=0x563ca72a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2678283514 shutdown_connections 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- 172.21.15.22:0/2678283514 wait complete. 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 -- start start 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 Processor -- start 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.059+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72ad4a0 0x563ca72c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b2bd0 con 0x563ca72b8680 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b4040 con 0x563ca72ad4a0 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b32a0 con 0x563ca72addc0 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27c1fd2740 10 client.0 _ll_register_callbacks cb 0x7f27b40d5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52150/0 (socket says 172.21.15.22:52150) 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 -- 172.21.15.22:0/4079998258 learned_addr learned my addr 172.21.15.22:0/4079998258 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27bd194640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27bd995640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72ad4a0 0x563ca72c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 -- 172.21.15.22:0/4079998258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 msgr2=0x563ca72bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 -- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72ad4a0 msgr2=0x563ca72c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72ad4a0 0x563ca72c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 -- 172.21.15.22:0/4079998258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca72beb40 con 0x563ca72b8680 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27bd194640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27be196640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f27b0010ab0 tx=0x7f27b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7824c3b80ac97eab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.060+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b002d060 con 0x563ca72b8680 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f27b001eb70 con 0x563ca72b8680 2024-09-11T22:37:26.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b409bed0 con 0x563ca72b8680 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f27b001ed70 con 0x563ca72b8680 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 10 client.16836 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563ca7332a70 con 0x563ca72b8680 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27b409bed0 con 0x563ca72b8680 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f27b0027070 con 0x563ca72b8680 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 10 client.16836 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 20 client.16836 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca73331f0 0x563ca7335610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 4 client.16836 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ca721ad60 con 0x563ca73331f0 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.061+0000 7f27bd995640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca73331f0 0x563ca7335610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:26.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27bd995640 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca73331f0 0x563ca7335610 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e495c56abb2d07 server_cookie=b209943cdda2d472 in_seq=0 out_seq=0 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27a17fa640 10 client.16836 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27a17fa640 1 -- 172.21.15.22:0/4079998258 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563ca721ad60 con 0x563ca73331f0 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27a17fa640 10 client.16836 handle_command_reply: tid=0 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 client.16836 shutdown 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 msgr2=0x563ca72be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f27b0010ab0 tx=0x7f27b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 shutdown_connections 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563ca73331f0 0x563ca7335610 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563ca72b8680 0x563ca72be4a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563ca72addc0 0x563ca72bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 --2- 172.21.15.22:0/4079998258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ca72ad4a0 0x563ca72c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 >> 172.21.15.22:0/4079998258 conn(0x563ca72a9a30 msgr2=0x563ca72a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27a17fa640 0 client.16836 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:26.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 shutdown_connections 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.062+0000 7f27c1fd2740 1 -- 172.21.15.22:0/4079998258 wait complete. 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27c1fd2740 20 client.16836 trim_cache size 0 max 16384 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "9c22fd4e-3f4d-4a73-9b9d-3a31a3065f76": { 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "9c22fd4e-3f4d-4a73-9b9d-3a31a3065f76", 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:37:26.070 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 msgr2=0x7f27a40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 0x7f27a40a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27b0011630 tx=0x7f27b000b390 comp rx=0 tx=0).stop 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 msgr2=0x7f27b81971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b81971e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005fd0 tx=0x7f27b400ee80 comp rx=0 tx=0).stop 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 shutdown_connections 2024-09-11T22:37:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f27a40a2cf0 0x7f27a40a51b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27b8102ef0 0x7f27b819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b8102570 0x7f27b8197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 --2- 172.21.15.22:0/29658984 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f27b8100e20 0x7f27b81971e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 >> 172.21.15.22:0/29658984 conn(0x7f27b80fc7d0 msgr2=0x7f27b8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 shutdown_connections 2024-09-11T22:37:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:26.063+0000 7f27bfbf9640 1 -- 172.21.15.22:0/29658984 wait complete. 2024-09-11T22:37:26.870 INFO:tasks.cephfs.filesystem:scrub status for tag:9c22fd4e-3f4d-4a73-9b9d-3a31a3065f76 - {'path': '/', 'tag': '9c22fd4e-3f4d-4a73-9b9d-3a31a3065f76', 'options': 'recursive,force'} 2024-09-11T22:37:27.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:27 smithi022 ceph-mon[30966]: pgmap v260: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:27.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:27 smithi169 ceph-mon[35628]: pgmap v260: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:27 smithi045 ceph-mon[35556]: pgmap v260: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:37:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:29 smithi022 ceph-mon[30966]: pgmap v261: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 4 op/s 2024-09-11T22:37:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:29 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:37:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:29 smithi169 ceph-mon[35628]: pgmap v261: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 4 op/s 2024-09-11T22:37:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:29 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:37:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:29 smithi045 ceph-mon[35556]: pgmap v261: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 101 B/s wr, 4 op/s 2024-09-11T22:37:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:29 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:37:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:31 smithi022 ceph-mon[30966]: pgmap v262: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:31 smithi169 ceph-mon[35628]: pgmap v262: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:31 smithi045 ceph-mon[35556]: pgmap v262: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:33.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:33 smithi022 ceph-mon[30966]: pgmap v263: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:33 smithi169 ceph-mon[35628]: pgmap v263: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:33 smithi045 ceph-mon[35556]: pgmap v263: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:35.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:35 smithi022 ceph-mon[30966]: pgmap v264: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:35 smithi169 ceph-mon[35628]: pgmap v264: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:35 smithi045 ceph-mon[35556]: pgmap v264: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:37 smithi022 ceph-mon[30966]: pgmap v265: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:37 smithi169 ceph-mon[35628]: pgmap v265: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:37 smithi045 ceph-mon[35556]: pgmap v265: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:37:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:39 smithi022 ceph-mon[30966]: pgmap v266: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:39.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:39 smithi169 ceph-mon[35628]: pgmap v266: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:39 smithi045 ceph-mon[35556]: pgmap v266: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:37:41.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:41 smithi022 ceph-mon[30966]: pgmap v267: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:41 smithi169 ceph-mon[35628]: pgmap v267: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:41.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:41 smithi045 ceph-mon[35556]: pgmap v267: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:43 smithi022 ceph-mon[30966]: pgmap v268: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:43.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:43 smithi169 ceph-mon[35628]: pgmap v268: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:43 smithi045 ceph-mon[35556]: pgmap v268: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:45.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:45 smithi022 ceph-mon[30966]: pgmap v269: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:45 smithi169 ceph-mon[35628]: pgmap v269: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:45.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:45 smithi045 ceph-mon[35556]: pgmap v269: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:47.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:47 smithi022 ceph-mon[30966]: pgmap v270: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:47.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:47 smithi169 ceph-mon[35628]: pgmap v270: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:47 smithi045 ceph-mon[35556]: pgmap v270: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:49 smithi022 ceph-mon[30966]: pgmap v271: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:49 smithi169 ceph-mon[35628]: pgmap v271: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:49 smithi045 ceph-mon[35556]: pgmap v271: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:51.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:51 smithi022 ceph-mon[30966]: pgmap v272: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:51 smithi169 ceph-mon[35628]: pgmap v272: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:51 smithi045 ceph-mon[35556]: pgmap v272: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:53 smithi022 ceph-mon[30966]: pgmap v273: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:53 smithi169 ceph-mon[35628]: pgmap v273: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:53 smithi045 ceph-mon[35556]: pgmap v273: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:55 smithi022 ceph-mon[30966]: pgmap v274: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:55 smithi169 ceph-mon[35628]: pgmap v274: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:55 smithi045 ceph-mon[35556]: pgmap v274: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:56.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:37:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 -- 172.21.15.22:0/1983296529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850100a80 msgr2=0x7fc850100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 --2- 172.21.15.22:0/1983296529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850100a80 0x7fc850100ee0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009930 tx=0x7fc83c02a420 comp rx=0 tx=0).stop 2024-09-11T22:37:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 -- 172.21.15.22:0/1983296529 shutdown_connections 2024-09-11T22:37:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 --2- 172.21.15.22:0/1983296529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850101420 0x7fc85010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 --2- 172.21.15.22:0/1983296529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850100a80 0x7fc850100ee0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 --2- 172.21.15.22:0/1983296529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc850106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 -- 172.21.15.22:0/1983296529 >> 172.21.15.22:0/1983296529 conn(0x7fc8500fc7a0 msgr2=0x7fc8500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 -- 172.21.15.22:0/1983296529 shutdown_connections 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.660+0000 7fc856bc7640 1 -- 172.21.15.22:0/1983296529 wait complete. 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 Processor -- start 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 -- start start 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850100a80 0x7fc850199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc8501a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc850110fe0 con 0x7fc850101420 2024-09-11T22:37:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc850110e60 con 0x7fc850100a80 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc856bc7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc850111160 con 0x7fc850106a80 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47410/0 (socket says 172.21.15.22:47410) 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 -- 172.21.15.22:0/2726668857 learned_addr learned my addr 172.21.15.22:0/2726668857 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc854963640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850100a80 0x7fc850199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 -- 172.21.15.22:0/2726668857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 msgr2=0x7fc8501a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc855164640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc8501a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc8501a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 -- 172.21.15.22:0/2726668857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850100a80 msgr2=0x7fc850199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850100a80 0x7fc850199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc84ffff640 1 -- 172.21.15.22:0/2726668857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501a4950 con 0x7fc850101420 2024-09-11T22:37:57.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.661+0000 7fc855164640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc8501a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009a50 tx=0x7fc83c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc84dffb640 1 -- 172.21.15.22:0/2726668857 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c03f030 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc84dffb640 1 -- 172.21.15.22:0/2726668857 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc83c003af0 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8501a4b20 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc84dffb640 1 -- 172.21.15.22:0/2726668857 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c035070 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.662+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8501a4fd0 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.664+0000 7fc84dffb640 1 -- 172.21.15.22:0/2726668857 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc83c042030 con 0x7fc850101420 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 Processor -- start 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 -- start start 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc84dffb640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 0x7fc8400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cc1adc42e0 con 0x55cc1ae6da90 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc1ad6bce0 con 0x55cc1ae5e380 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc858fa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc1adc02a0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc855164640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 0x7fc8400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc84dffb640 1 -- 172.21.15.22:0/2726668857 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc83c0efcb0 con 0x7fc850101420 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc854963640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc855164640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc854963640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:36996/0 (socket says 172.21.15.22:36996) 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc855164640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47420/0 (socket says 172.21.15.22:47420) 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc854963640 1 -- 172.21.15.22:0/3726279744 learned_addr learned my addr 172.21.15.22:0/3726279744 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.665+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 -- 172.21.15.22:0/3726279744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 msgr2=0x55cc1ae6d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 -- 172.21.15.22:0/3726279744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 msgr2=0x55cc1ae6fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 -- 172.21.15.22:0/3726279744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc1ad50440 con 0x55cc1ae5e380 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc855164640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 0x7fc8400a5230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc84800ad30 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc854963640 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc844009a70 tx=0x7fc844009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c0625d23f619d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc83affd640 1 -- 172.21.15.22:0/3726279744 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844017070 con 0x55cc1ae5e380 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc83affd640 1 -- 172.21.15.22:0/3726279744 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc844013470 con 0x55cc1ae5e380 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.666+0000 7fc83affd640 1 -- 172.21.15.22:0/3726279744 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844012610 con 0x55cc1ae5e380 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 -- 172.21.15.22:0/3726279744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 msgr2=0x55cc1ae5e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc844009a70 tx=0x7fc844009f30 comp rx=0 tx=0).stop 2024-09-11T22:37:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 -- 172.21.15.22:0/3726279744 shutdown_connections 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3726279744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae5e760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.667+0000 7fc858fa0740 1 -- 172.21.15.22:0/3726279744 >> 172.21.15.22:0/3726279744 conn(0x55cc1ae5aa30 msgr2=0x55cc1ae5ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- 172.21.15.22:0/3726279744 shutdown_connections 2024-09-11T22:37:57.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- 172.21.15.22:0/3726279744 wait complete. 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- start start 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 Processor -- start 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae6d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cc1ae70660 con 0x55cc1ae5eca0 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc1ad7f050 con 0x55cc1ae5e380 2024-09-11T22:37:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc1ae707e0 con 0x55cc1ae6da90 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.668+0000 7fc858fa0740 10 client.0 _ll_register_callbacks cb 0x55cc1adbf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47432/0 (socket says 172.21.15.22:47432) 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 -- 172.21.15.22:0/2619642510 learned_addr learned my addr 172.21.15.22:0/2619642510 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc854963640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae6d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc855164640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 -- 172.21.15.22:0/2619642510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 msgr2=0x55cc1ae6abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 -- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 msgr2=0x55cc1ae6d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae6d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 -- 172.21.15.22:0/2619642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc1ab353c0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc854963640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae6d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc84ffff640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0b8b60 tx=0x7fc83c0bbb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9439e3727821ba2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc82ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c049070 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc83c003ca0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc844013470 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.669+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc83c0c0540 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 10 client.16848 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cc1ae7c070 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc844013470 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc83c0ed640 con 0x55cc1ae5eca0 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 10 client.16848 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:57.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 20 client.16848 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1ae7d480 0x55cc1ae7f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 4 client.16848 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc1add1850 con 0x55cc1ae7d480 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.670+0000 7fc854963640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1ae7d480 0x55cc1ae7f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.671+0000 7fc854963640 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1ae7d480 0x55cc1ae7f8f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a996043eca1523 server_cookie=bab80061a1650f0c in_seq=0 out_seq=0 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.671+0000 7fc82ffff640 10 client.16848 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc82ffff640 1 -- 172.21.15.22:0/2619642510 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc1add1850 con 0x55cc1ae7d480 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc82ffff640 10 client.16848 handle_command_reply: tid=0 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 client.16848 shutdown 2024-09-11T22:37:57.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 msgr2=0x55cc1ae6a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0b8b60 tx=0x7fc83c0bbb70 comp rx=0 tx=0).stop 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 shutdown_connections 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1ae7d480 0x55cc1ae7f8f0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae6abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae6a690 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 --2- 172.21.15.22:0/2619642510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae6d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 >> 172.21.15.22:0/2619642510 conn(0x55cc1ae5aa30 msgr2=0x55cc1ae59b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc82ffff640 0 client.16848 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 shutdown_connections 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 1 -- 172.21.15.22:0/2619642510 wait complete. 2024-09-11T22:37:57.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.672+0000 7fc858fa0740 20 client.16848 trim_cache size 0 max 16384 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 Processor -- start 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 -- start start 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae79900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae85700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501a95c0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501abe20 con 0x55cc1ae5e380 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc858fa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501a9c10 con 0x55cc1ae6da90 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.689+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47444/0 (socket says 172.21.15.22:47444) 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 -- 172.21.15.22:0/3205542426 learned_addr learned my addr 172.21.15.22:0/3205542426 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc854963640 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae79900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc855164640 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae85700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 -- 172.21.15.22:0/3205542426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 msgr2=0x55cc1ae85700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae85700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 -- 172.21.15.22:0/3205542426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 msgr2=0x55cc1ae79900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae79900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 -- 172.21.15.22:0/3205542426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc1ae68be0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c0ba6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7624c9ff7a01e3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc83a7fc640 1 -- 172.21.15.22:0/3205542426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0d4020 con 0x55cc1ae5eca0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc83a7fc640 1 -- 172.21.15.22:0/3205542426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc83c0ed1f0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.690+0000 7fc83a7fc640 1 -- 172.21.15.22:0/3205542426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c049050 con 0x55cc1ae5eca0 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- 172.21.15.22:0/3205542426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 msgr2=0x55cc1ae851c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc83c000c00 tx=0x7fc83c0ba6a0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- 172.21.15.22:0/3205542426 shutdown_connections 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae6da90 0x55cc1ae85700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae851c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3205542426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae5e380 0x55cc1ae79900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- 172.21.15.22:0/3205542426 >> 172.21.15.22:0/3205542426 conn(0x55cc1ae5aa30 msgr2=0x55cc1ae65d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- 172.21.15.22:0/3205542426 shutdown_connections 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- 172.21.15.22:0/3205542426 wait complete. 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 -- start start 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.691+0000 7fc858fa0740 1 Processor -- start 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5e380 0x55cc1ae760b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 0x55cc1ae71970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501aa2e0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501ab750 con 0x55cc1ae6da90 2024-09-11T22:37:57.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8501aa9b0 con 0x55cc1ae5e380 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc858fa0740 10 client.0 _ll_register_callbacks cb 0x7fc83c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47452/0 (socket says 172.21.15.22:47452) 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 -- 172.21.15.22:0/3693621694 learned_addr learned my addr 172.21.15.22:0/3693621694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc855164640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 0x55cc1ae71970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 -- 172.21.15.22:0/3693621694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5e380 msgr2=0x55cc1ae760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc854963640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5e380 0x55cc1ae760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5e380 0x55cc1ae760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 -- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 msgr2=0x55cc1ae71970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 0x55cc1ae71970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 -- 172.21.15.22:0/3693621694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc1ae72060 con 0x55cc1ae5eca0 2024-09-11T22:37:57.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc855164640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 0x55cc1ae71970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc84ffff640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc83c038020 tx=0x7fc83c0ed3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3989ebb035a5877 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.692+0000 7fc82ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0d4030 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fc83c0c4970 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc83c0ed1f0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc83c049070 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 10 client.16854 fetch_fsmap learned FSMap version 22 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cc1ae72060 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc83c0ed1f0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fc83c0bb5e0 con 0x55cc1ae5eca0 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 10 client.16854 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:37:57.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 20 client.16854 populate_metadata read hostname 'smithi022' 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1aee8330 0x55cc1aeea720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 4 client.16854 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.693+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc1adcbd60 con 0x55cc1aee8330 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc854963640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1aee8330 0x55cc1aeea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc854963640 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1aee8330 0x55cc1aeea720 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4beeef3e377f3668 server_cookie=3c3ccdf686f96dd7 in_seq=0 out_seq=0 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc82ffff640 10 client.16854 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc82ffff640 1 -- 172.21.15.22:0/3693621694 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cc1adcbd60 con 0x55cc1aee8330 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc82ffff640 10 client.16854 handle_command_reply: tid=0 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 client.16854 shutdown 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 msgr2=0x55cc1ae71430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc83c038020 tx=0x7fc83c0ed3a0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 shutdown_connections 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55cc1aee8330 0x55cc1aeea720 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc1ae6da90 0x55cc1ae71970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cc1ae5eca0 0x55cc1ae71430 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc82ffff640 0 client.16854 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 --2- 172.21.15.22:0/3693621694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc1ae5e380 0x55cc1ae760b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 >> 172.21.15.22:0/3693621694 conn(0x55cc1ae5aa30 msgr2=0x55cc1ae6bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.694+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 shutdown_connections 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc858fa0740 1 -- 172.21.15.22:0/3693621694 wait complete. 2024-09-11T22:37:57.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc858fa0740 20 client.16854 trim_cache size 0 max 16384 2024-09-11T22:37:57.702 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:37:57.702 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:37:57.702 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:37:57.702 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 msgr2=0x7fc8400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 0x7fc8400a5230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc84800ad30 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 msgr2=0x7fc8501998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009a50 tx=0x7fc83c004270 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 shutdown_connections 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fc8400a2d70 0x7fc8400a5230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc850106a80 0x7fc8501a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc850101420 0x7fc8501998d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 --2- 172.21.15.22:0/2726668857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc850100a80 0x7fc850199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 >> 172.21.15.22:0/2726668857 conn(0x7fc8500fc7a0 msgr2=0x7fc8500fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:57.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 shutdown_connections 2024-09-11T22:37:57.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:57.695+0000 7fc856bc7640 1 -- 172.21.15.22:0/2726668857 wait complete. 2024-09-11T22:37:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:57 smithi022 ceph-mon[30966]: pgmap v275: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:57 smithi169 ceph-mon[35628]: pgmap v275: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:57 smithi045 ceph-mon[35556]: pgmap v275: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:37:58.445 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:37:58.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:37:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:37:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 -- 172.21.15.22:0/2040205864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 msgr2=0x7f77e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/2040205864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e4106e60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009930 tx=0x7f77e002a420 comp rx=0 tx=0).stop 2024-09-11T22:37:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 -- 172.21.15.22:0/2040205864 shutdown_connections 2024-09-11T22:37:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/2040205864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4101420 0x7f77e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/2040205864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4100a80 0x7f77e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/2040205864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e4106e60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 -- 172.21.15.22:0/2040205864 >> 172.21.15.22:0/2040205864 conn(0x7f77e40fc7a0 msgr2=0x7f77e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 -- 172.21.15.22:0/2040205864 shutdown_connections 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.298+0000 7f77eb7e4640 1 -- 172.21.15.22:0/2040205864 wait complete. 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 Processor -- start 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 -- start start 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4100a80 0x7f77e4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4101420 0x7f77e4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4110f60 con 0x7f77e4106a80 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4110de0 con 0x7f77e4101420 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77eb7e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77e41110e0 con 0x7f77e4100a80 2024-09-11T22:37:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77e9d81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77e9d81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47470/0 (socket says 172.21.15.22:47470) 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77e9d81640 1 -- 172.21.15.22:0/1933288471 learned_addr learned my addr 172.21.15.22:0/1933288471 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77e9580640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4100a80 0x7f77e4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.299+0000 7f77e8d7f640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4101420 0x7f77e4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 -- 172.21.15.22:0/1933288471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4100a80 msgr2=0x7f77e4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4100a80 0x7f77e4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 -- 172.21.15.22:0/1933288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4101420 msgr2=0x7f77e4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4101420 0x7f77e4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 -- 172.21.15.22:0/1933288471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e419d4c0 con 0x7f77e4106a80 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77e9d81640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00eaa0 tx=0x7f77dc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc004d20 con 0x7f77e4106a80 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e419d7b0 con 0x7f77e4106a80 2024-09-11T22:37:59.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77dc005020 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0116b0 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.300+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e40fcbd0 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.301+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e41021c0 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.302+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f77dc0051d0 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.303+0000 7f77da7fc640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 0x7f77d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.303+0000 7f77e9580640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 0x7f77d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.303+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f77dc0cf9e0 con 0x7f77e4106a80 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.303+0000 7f77e9580640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 0x7f77d00a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009900 tx=0x7f77e00058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:37:59.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.306+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77dc016030 con 0x7f77e4106a80 2024-09-11T22:37:59.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.517+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e4100ee0 con 0x7f77e4106a80 2024-09-11T22:37:59.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.517+0000 7f77da7fc640 1 -- 172.21.15.22:0/1933288471 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f77e4100ee0 con 0x7f77e4106a80 2024-09-11T22:37:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:37:59.521 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:37:59.522 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:37:59.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 msgr2=0x7f77d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:59.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 0x7f77d00a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009900 tx=0x7f77e00058d0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 msgr2=0x7f77e419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:37:59.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00eaa0 tx=0x7f77dc00eea0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 shutdown_connections 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f77d00a2cf0 0x7f77d00a51b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77e4106a80 0x7f77e419cde0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77e4101420 0x7f77e4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 --2- 172.21.15.22:0/1933288471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77e4100a80 0x7f77e4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 >> 172.21.15.22:0/1933288471 conn(0x7f77e40fc7a0 msgr2=0x7f77e406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 shutdown_connections 2024-09-11T22:37:59.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:37:59.520+0000 7f77eb7e4640 1 -- 172.21.15.22:0/1933288471 wait complete. 2024-09-11T22:37:59.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:59 smithi022 ceph-mon[30966]: pgmap v276: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:59.871 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:37:59 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1933288471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:37:59.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:59 smithi169 ceph-mon[35628]: pgmap v276: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:59.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:37:59 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1933288471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:37:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:59 smithi045 ceph-mon[35556]: pgmap v276: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:37:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:37:59 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1933288471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:00.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:38:00.479 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 -- 172.21.15.22:0/2965044318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24581049a0 msgr2=0x7f24581089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2965044318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24581049a0 0x7f24581089f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2448009900 tx=0x7f244802a410 comp rx=0 tx=0).stop 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 -- 172.21.15.22:0/2965044318 shutdown_connections 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2965044318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2458109120 0x7f2458110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2965044318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24581049a0 0x7f24581089f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2965044318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458103ff0 0x7f24581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 -- 172.21.15.22:0/2965044318 >> 172.21.15.22:0/2965044318 conn(0x7f24580ffab0 msgr2=0x7f2458101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 -- 172.21.15.22:0/2965044318 shutdown_connections 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.088+0000 7f245f7b9640 1 -- 172.21.15.22:0/2965044318 wait complete. 2024-09-11T22:38:01.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 Processor -- start 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 -- start start 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24581049a0 0x7f245819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458109120 0x7f245819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2458114260 con 0x7f2458103ff0 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f24581140e0 con 0x7f2458109120 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245f7b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24581143e0 con 0x7f24581049a0 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245d555640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245d555640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47498/0 (socket says 172.21.15.22:47498) 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245d555640 1 -- 172.21.15.22:0/2233329095 learned_addr learned my addr 172.21.15.22:0/2233329095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245cd54640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24581049a0 0x7f245819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.089+0000 7f245dd56640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458109120 0x7f245819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 -- 172.21.15.22:0/2233329095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24581049a0 msgr2=0x7f245819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24581049a0 0x7f245819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 -- 172.21.15.22:0/2233329095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458109120 msgr2=0x7f245819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458109120 0x7f245819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 -- 172.21.15.22:0/2233329095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245819f6d0 con 0x7f2458103ff0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245d555640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f245400d950 tx=0x7f245400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f244e7fc640 1 -- 172.21.15.22:0/2233329095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454017030 con 0x7f2458103ff0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f244e7fc640 1 -- 172.21.15.22:0/2233329095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2454004020 con 0x7f2458103ff0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245819f9c0 con 0x7f2458103ff0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f244e7fc640 1 -- 172.21.15.22:0/2233329095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454004a00 con 0x7f2458103ff0 2024-09-11T22:38:01.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.090+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24581a72a0 con 0x7f2458103ff0 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f244e7fc640 1 -- 172.21.15.22:0/2233329095 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f24540041d0 con 0x7f2458103ff0 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 Processor -- start 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 -- start start 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baeba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417baf8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.093+0000 7f2461b92740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56417ba512f0 con 0x56417baecb40 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f2461b92740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56417b9f8cf0 con 0x56417baf6370 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f244e7fc640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 0x7f24440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f2461b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56417ba4d2b0 con 0x56417baeb5d0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47508/0 (socket says 172.21.15.22:47508) 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 -- 172.21.15.22:0/3726495979 learned_addr learned my addr 172.21.15.22:0/3726495979 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245d555640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baeba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245cd54640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417baf8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 0x7f24440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f244e7fc640 1 -- 172.21.15.22:0/2233329095 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f24540cedc0 con 0x7f2458103ff0 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 -- 172.21.15.22:0/3726495979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 msgr2=0x56417baeba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baeba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 -- 172.21.15.22:0/3726495979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 msgr2=0x56417baf8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417baf8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 -- 172.21.15.22:0/3726495979 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417b9dd3a0 con 0x56417baecb40 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245d555640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.094+0000 7f245dd56640 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2450005f40 tx=0x7f2450012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd41743a75630 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f245dd56640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 0x7f24440a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f245001b000 tx=0x7f245001d000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f24437fe640 1 -- 172.21.15.22:0/3726495979 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450022070 con 0x56417baecb40 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f24437fe640 1 -- 172.21.15.22:0/3726495979 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2450011b30 con 0x56417baecb40 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f24437fe640 1 -- 172.21.15.22:0/3726495979 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245000f3c0 con 0x56417baecb40 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f2461b92740 1 -- 172.21.15.22:0/3726495979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 msgr2=0x56417baeb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f2461b92740 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2450005f40 tx=0x7f2450012e40 comp rx=0 tx=0).stop 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f2461b92740 1 -- 172.21.15.22:0/3726495979 shutdown_connections 2024-09-11T22:38:01.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.095+0000 7f2461b92740 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417baf8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 --2- 172.21.15.22:0/3726495979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baeb090 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 -- 172.21.15.22:0/3726495979 >> 172.21.15.22:0/3726495979 conn(0x56417bab4310 msgr2=0x56417bae7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 -- 172.21.15.22:0/3726495979 shutdown_connections 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 -- 172.21.15.22:0/3726495979 wait complete. 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 -- start start 2024-09-11T22:38:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.096+0000 7f2461b92740 1 Processor -- start 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 0x56417baf5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 0x56417baf3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56417baf9010 con 0x56417baecb40 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56417ba0c060 con 0x56417baeb5d0 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56417baf9190 con 0x56417baf6370 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2461b92740 10 client.0 _ll_register_callbacks cb 0x56417b75f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47522/0 (socket says 172.21.15.22:47522) 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 -- 172.21.15.22:0/3300061629 learned_addr learned my addr 172.21.15.22:0/3300061629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245d555640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 0x56417baf5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245dd56640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 0x56417baf3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 -- 172.21.15.22:0/3300061629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 msgr2=0x56417baf3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 0x56417baf3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 -- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 msgr2=0x56417baf5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 0x56417baf5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 -- 172.21.15.22:0/3300061629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417b7c23c0 con 0x56417baecb40 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245dd56640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 0x56417baf3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245d555640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 0x56417baf5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f245cd54640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f244802a930 tx=0x7f24480318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508e25ba8666b0a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2440ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448035040 con 0x56417baecb40 2024-09-11T22:38:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.097+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f2448004240 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2450011b30 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2448004440 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 10 client.16872 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56417bb04b30 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2450011b30 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f244804d020 con 0x56417baecb40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 10 client.16872 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 20 client.16872 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb05f40 0x56417bb08370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 4 client.16872 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56417ba5e860 con 0x56417bb05f40 2024-09-11T22:38:01.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.098+0000 7f245d555640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb05f40 0x56417bb08370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.099+0000 7f2440ff9640 10 client.16872 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.099+0000 7f245d555640 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb05f40 0x56417bb08370 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1dad844e5f19d2a server_cookie=e35d6b8487099d28 in_seq=0 out_seq=0 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.099+0000 7f2440ff9640 1 -- 172.21.15.22:0/3300061629 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56417ba5e860 con 0x56417bb05f40 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.099+0000 7f2440ff9640 10 client.16872 handle_command_reply: tid=0 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 client.16872 shutdown 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 msgr2=0x56417baf3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f244802a930 tx=0x7f24480318e0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 shutdown_connections 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb05f40 0x56417bb08370 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baf6370 0x56417baf3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf3080 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 --2- 172.21.15.22:0/3300061629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baeb5d0 0x56417baf5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 >> 172.21.15.22:0/3300061629 conn(0x56417bab4310 msgr2=0x56417baed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2440ff9640 0 client.16872 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 shutdown_connections 2024-09-11T22:38:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 1 -- 172.21.15.22:0/3300061629 wait complete. 2024-09-11T22:38:01.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.100+0000 7f2461b92740 20 client.16872 trim_cache size 0 max 16384 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 Processor -- start 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 -- start start 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baf1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bb0dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f24581ada60 con 0x56417baecb40 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f24581b02c0 con 0x56417baf6370 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f2461b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24581ae0b0 con 0x56417baeb5d0 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47528/0 (socket says 172.21.15.22:47528) 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.113+0000 7f245cd54640 1 -- 172.21.15.22:0/2431708842 learned_addr learned my addr 172.21.15.22:0/2431708842 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 -- 172.21.15.22:0/2431708842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 msgr2=0x56417baf1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245d555640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baf1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245dd56640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bb0dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baf1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 -- 172.21.15.22:0/2431708842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 msgr2=0x56417bb0dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bb0dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 -- 172.21.15.22:0/2431708842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417baee120 con 0x56417baecb40 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245d555640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baf1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:01.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245dd56640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bb0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f245cd54640 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2448005940 tx=0x7f244802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5ab9d2d353f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f2442ffd640 1 -- 172.21.15.22:0/2431708842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448035030 con 0x56417baecb40 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f2442ffd640 1 -- 172.21.15.22:0/2431708842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2448046680 con 0x56417baecb40 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.114+0000 7f2442ffd640 1 -- 172.21.15.22:0/2431708842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448004b20 con 0x56417baecb40 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- 172.21.15.22:0/2431708842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 msgr2=0x56417baf1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2448005940 tx=0x7f244802a410 comp rx=0 tx=0).stop 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- 172.21.15.22:0/2431708842 shutdown_connections 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bb0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf1e90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 --2- 172.21.15.22:0/2431708842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417baf1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- 172.21.15.22:0/2431708842 >> 172.21.15.22:0/2431708842 conn(0x56417bab4310 msgr2=0x56417baee310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- 172.21.15.22:0/2431708842 shutdown_connections 2024-09-11T22:38:01.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- 172.21.15.22:0/2431708842 wait complete. 2024-09-11T22:38:01.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 -- start start 2024-09-11T22:38:01.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.115+0000 7f2461b92740 1 Processor -- start 2024-09-11T22:38:01.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417bafe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bafa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f24581ae780 con 0x56417baecb40 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f24581afbf0 con 0x56417baf6370 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24581aee50 con 0x56417baeb5d0 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2461b92740 10 client.0 _ll_register_callbacks cb 0x7f2448009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47530/0 (socket says 172.21.15.22:47530) 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 -- 172.21.15.22:0/4190978690 learned_addr learned my addr 172.21.15.22:0/4190978690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245dd56640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bafa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245d555640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417bafe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 -- 172.21.15.22:0/4190978690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 msgr2=0x56417bafe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417bafe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 -- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 msgr2=0x56417bafa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bafa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 -- 172.21.15.22:0/4190978690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417bafa660 con 0x56417baecb40 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245dd56640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bafa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f245cd54640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f24480315e0 tx=0x7f24480314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a604f3de89ba46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2440ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.116+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448035030 con 0x56417baecb40 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f2448050ab0 con 0x56417baecb40 2024-09-11T22:38:01.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448046680 con 0x56417baecb40 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2448068050 con 0x56417baecb40 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 10 client.16878 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56417bb708d0 con 0x56417baecb40 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2448046680 con 0x56417baecb40 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f244805f070 con 0x56417baecb40 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 10 client.16878 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 20 client.16878 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb70f50 0x56417bb73370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 4 client.16878 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:38:01.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.117+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56417ba58d70 con 0x56417bb70f50 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f245d555640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb70f50 0x56417bb73370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f245d555640 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb70f50 0x56417bb73370 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd414d499f92200 server_cookie=49e333371ee34549 in_seq=0 out_seq=0 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2440ff9640 10 client.16878 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2440ff9640 1 -- 172.21.15.22:0/4190978690 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56417ba58d70 con 0x56417bb70f50 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2440ff9640 10 client.16878 handle_command_reply: tid=0 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 client.16878 shutdown 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 msgr2=0x56417baf9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f24480315e0 tx=0x7f24480314b0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 shutdown_connections 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56417bb70f50 0x56417bb73370 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56417baf6370 0x56417bafa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56417baecb40 0x56417baf9be0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2440ff9640 0 client.16878 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 --2- 172.21.15.22:0/4190978690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56417baeb5d0 0x56417bafe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 >> 172.21.15.22:0/4190978690 conn(0x56417bab4310 msgr2=0x56417baed110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.118+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 shutdown_connections 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f2461b92740 1 -- 172.21.15.22:0/4190978690 wait complete. 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f2461b92740 20 client.16878 trim_cache size 0 max 16384 2024-09-11T22:38:01.127 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 msgr2=0x7f24440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 0x7f24440a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f245001b000 tx=0x7f245001d000 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 msgr2=0x7f245819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f245400d950 tx=0x7f245400de10 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 shutdown_connections 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f24440a2cf0 0x7f24440a51b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458109120 0x7f245819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24581049a0 0x7f245819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 --2- 172.21.15.22:0/2233329095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2458103ff0 0x7f245819a720 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 >> 172.21.15.22:0/2233329095 conn(0x7f24580ffab0 msgr2=0x7f2458100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:01.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 shutdown_connections 2024-09-11T22:38:01.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:01.119+0000 7f245f7b9640 1 -- 172.21.15.22:0/2233329095 wait complete. 2024-09-11T22:38:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:01 smithi022 ceph-mon[30966]: pgmap v277: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:01.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:01 smithi169 ceph-mon[35628]: pgmap v277: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:01 smithi045 ceph-mon[35556]: pgmap v277: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:02.945 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:38:02.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:38:03.216 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:03.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:03 smithi022 ceph-mon[30966]: pgmap v278: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 -- 172.21.15.22:0/153656178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b01082a0 msgr2=0x7f62b010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 --2- 172.21.15.22:0/153656178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b01082a0 0x7f62b010ec40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009cd0 tx=0x7f62a802a910 comp rx=0 tx=0).stop 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 -- 172.21.15.22:0/153656178 shutdown_connections 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 --2- 172.21.15.22:0/153656178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b01082a0 0x7f62b010ec40 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 --2- 172.21.15.22:0/153656178 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 0x7f62b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 --2- 172.21.15.22:0/153656178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b0102d30 0x7f62b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 -- 172.21.15.22:0/153656178 >> 172.21.15.22:0/153656178 conn(0x7f62b00fc7d0 msgr2=0x7f62b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 -- 172.21.15.22:0/153656178 shutdown_connections 2024-09-11T22:38:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.678+0000 7f62b80c2640 1 -- 172.21.15.22:0/153656178 wait complete. 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 Processor -- start 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 -- start start 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 0x7f62b0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 0x7f62b0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0112220 con 0x7f62b0102d30 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01120a0 con 0x7f62b01082a0 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b80c2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01123a0 con 0x7f62b01036e0 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47542/0 (socket says 172.21.15.22:47542) 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 -- 172.21.15.22:0/181461257 learned_addr learned my addr 172.21.15.22:0/181461257 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b665f640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 0x7f62b0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b565d640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 0x7f62b0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 -- 172.21.15.22:0/181461257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 msgr2=0x7f62b0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 0x7f62b0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 -- 172.21.15.22:0/181461257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 msgr2=0x7f62b0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 0x7f62b0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 -- 172.21.15.22:0/181461257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b01a6b30 con 0x7f62b0102d30 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b665f640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 0x7f62b0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.679+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d950 tx=0x7f62ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.680+0000 7f62a6ffd640 1 -- 172.21.15.22:0/181461257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac017070 con 0x7f62b0102d30 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.680+0000 7f62a6ffd640 1 -- 172.21.15.22:0/181461257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62ac009c30 con 0x7f62b0102d30 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.680+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b01a6e20 con 0x7f62b0102d30 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.680+0000 7f62a6ffd640 1 -- 172.21.15.22:0/181461257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00f740 con 0x7f62b0102d30 2024-09-11T22:38:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.680+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b01a7320 con 0x7f62b0102d30 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.682+0000 7f62a6ffd640 1 -- 172.21.15.22:0/181461257 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f62ac010a80 con 0x7f62b0102d30 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.682+0000 7f62ba49b740 1 Processor -- start 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.682+0000 7f62ba49b740 1 -- start start 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2def40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2e9d40 0x5627cb2ec130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627cb244280 con 0x5627cb2deb60 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5627cb1ebb10 con 0x5627cb2e9d40 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62ba49b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5627cb240240 con 0x5627cb2df480 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62a6ffd640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 0x7f629c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b665f640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 0x7f629c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:57692/0 (socket says 172.21.15.22:57692) 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b5e5e640 1 -- 172.21.15.22:0/3476227229 learned_addr learned my addr 172.21.15.22:0/3476227229 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62a6ffd640 1 -- 172.21.15.22:0/181461257 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62ac0cf0f0 con 0x7f62b0102d30 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b565d640 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2e9d40 0x5627cb2ec130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.683+0000 7f62b665f640 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2def40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 -- 172.21.15.22:0/3476227229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2e9d40 msgr2=0x5627cb2ec130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2e9d40 0x5627cb2ec130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 -- 172.21.15.22:0/3476227229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 msgr2=0x5627cb2def40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2def40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 -- 172.21.15.22:0/3476227229 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cb1f81f0 con 0x5627cb2df480 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b665f640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 0x7f629c0a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005fe0 tx=0x7f62a8032cc0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06e610 tx=0x7f62ac06e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01774ecc79f8344 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f629bfff640 1 -- 172.21.15.22:0/3476227229 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac020070 con 0x5627cb2df480 2024-09-11T22:38:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f629bfff640 1 -- 172.21.15.22:0/3476227229 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62ac09bcd0 con 0x5627cb2df480 2024-09-11T22:38:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.684+0000 7f629bfff640 1 -- 172.21.15.22:0/3476227229 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a4240 con 0x5627cb2df480 2024-09-11T22:38:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- 172.21.15.22:0/3476227229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 msgr2=0x5627cb2e9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06e610 tx=0x7f62ac06e640 comp rx=0 tx=0).stop 2024-09-11T22:38:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- 172.21.15.22:0/3476227229 shutdown_connections 2024-09-11T22:38:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2e9d40 0x5627cb2ec130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2e9800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3476227229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2def40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- 172.21.15.22:0/3476227229 >> 172.21.15.22:0/3476227229 conn(0x5627cb2db0f0 msgr2=0x5627cb2db4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- 172.21.15.22:0/3476227229 shutdown_connections 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- 172.21.15.22:0/3476227229 wait complete. 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 -- start start 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.685+0000 7f62ba49b740 1 Processor -- start 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 0x5627cb2e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5627cb2ec910 con 0x5627cb2deb60 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5627cb1fef10 con 0x5627cb2df480 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5627cb2eca90 con 0x5627cb2e9d40 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62ba49b740 10 client.0 _ll_register_callbacks cb 0x5627cb1c7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47550/0 (socket says 172.21.15.22:47550) 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 -- 172.21.15.22:0/220021082 learned_addr learned my addr 172.21.15.22:0/220021082 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b665f640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b565d640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 0x5627cb2e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 -- 172.21.15.22:0/220021082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 msgr2=0x5627cb2e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 -- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 msgr2=0x5627cb2e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 0x5627cb2e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b5e5e640 1 -- 172.21.15.22:0/220021082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cafb56a0 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.686+0000 7f62b565d640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 0x5627cb2e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f62ac09fb40 tx=0x7f62ac097e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa98dd2ca961c932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac020070 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62ac0a3db0 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ac09bcd0 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f62ac0ccc90 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 10 client.16890 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5627cb2ec910 con 0x5627cb2deb60 2024-09-11T22:38:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62ac09bcd0 con 0x5627cb2deb60 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f62ac09aa90 con 0x5627cb2deb60 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 10 client.16890 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.687+0000 7f62ba49b740 20 client.16890 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb2f96f0 0x5627cb2fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62ba49b740 4 client.16890 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627cb2517f0 con 0x5627cb2f96f0 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62b565d640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb2f96f0 0x5627cb2fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62997fa640 10 client.16890 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.688+0000 7f62b565d640 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb2f96f0 0x5627cb2fbae0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f9a48cf9611352 server_cookie=844280fc433cd1c in_seq=0 out_seq=0 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62997fa640 1 -- 172.21.15.22:0/220021082 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627cb2517f0 con 0x5627cb2f96f0 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62997fa640 10 client.16890 handle_command_reply: tid=0 2024-09-11T22:38:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 client.16890 shutdown 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 msgr2=0x5627cb2e6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f62ac09fb40 tx=0x7f62ac097e70 comp rx=0 tx=0).stop 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 shutdown_connections 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb2f96f0 0x5627cb2fbae0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2df480 0x5627cb2e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 --2- 172.21.15.22:0/220021082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2deb60 0x5627cb2e6c50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62997fa640 0 client.16890 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.689+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 >> 172.21.15.22:0/220021082 conn(0x5627cb2db0f0 msgr2=0x5627cb2da270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.690+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 shutdown_connections 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.690+0000 7f62ba49b740 1 -- 172.21.15.22:0/220021082 wait complete. 2024-09-11T22:38:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.690+0000 7f62ba49b740 20 client.16890 trim_cache size 0 max 16384 2024-09-11T22:38:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 Processor -- start 2024-09-11T22:38:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 -- start start 2024-09-11T22:38:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb3012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01adba0 con 0x5627cb2df480 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01b0400 con 0x5627cb2deb60 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62ba49b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01ae1f0 con 0x5627cb2e9d40 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47552/0 (socket says 172.21.15.22:47552) 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 -- 172.21.15.22:0/44405450 learned_addr learned my addr 172.21.15.22:0/44405450 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b665f640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb3012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 -- 172.21.15.22:0/44405450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 msgr2=0x5627cb2e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 -- 172.21.15.22:0/44405450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 msgr2=0x5627cb3012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb3012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b565d640 1 -- 172.21.15.22:0/44405450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cb2de8e0 con 0x5627cb2df480 2024-09-11T22:38:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.707+0000 7f62b665f640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:03.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62b565d640 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f62b006a370 tx=0x7f62a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726015f03b022696 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f629b7fe640 1 -- 172.21.15.22:0/44405450 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0016a60 con 0x5627cb2df480 2024-09-11T22:38:03.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f629b7fe640 1 -- 172.21.15.22:0/44405450 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62a0020030 con 0x5627cb2df480 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f629b7fe640 1 -- 172.21.15.22:0/44405450 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a001c250 con 0x5627cb2df480 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 -- 172.21.15.22:0/44405450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 msgr2=0x5627cb301820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f62b006a370 tx=0x7f62a0008040 comp rx=0 tx=0).stop 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 -- 172.21.15.22:0/44405450 shutdown_connections 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2e9d40 0x5627cb2e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2df480 0x5627cb301820 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 --2- 172.21.15.22:0/44405450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb3012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.708+0000 7f62ba49b740 1 -- 172.21.15.22:0/44405450 >> 172.21.15.22:0/44405450 conn(0x5627cb2db0f0 msgr2=0x5627cb2e8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- 172.21.15.22:0/44405450 shutdown_connections 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- 172.21.15.22:0/44405450 wait complete. 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- start start 2024-09-11T22:38:03.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 Processor -- start 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb2ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01ae8c0 con 0x5627cb2e9d40 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01afd30 con 0x5627cb2deb60 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01aef90 con 0x5627cb2df480 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62ba49b740 10 client.0 _ll_register_callbacks cb 0x7f62ac0ccf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62b665f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.709+0000 7f62b665f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47556/0 (socket says 172.21.15.22:47556) 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 -- 172.21.15.22:0/3813911481 learned_addr learned my addr 172.21.15.22:0/3813911481 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb2ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b565d640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 -- 172.21.15.22:0/3813911481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 msgr2=0x5627cb2eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 -- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 msgr2=0x5627cb2ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb2ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 -- 172.21.15.22:0/3813911481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cb35caa0 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62b665f640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f62a8035000 tx=0x7f62a8046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c574c8745658a88f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62997fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8004450 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62a80045f0 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a0020030 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f62a8062050 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62ba49b740 10 client.16896 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.710+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5627cb364df0 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62a0020030 con 0x5627cb2e9d40 2024-09-11T22:38:03.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f62a80308d0 con 0x5627cb2e9d40 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 10 client.16896 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 20 client.16896 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb365590 0x5627cb3679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 4 client.16896 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5627cb24bd00 con 0x5627cb365590 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.711+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb365590 0x5627cb3679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.712+0000 7f62997fa640 10 client.16896 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:03.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.712+0000 7f62b5e5e640 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb365590 0x5627cb3679b0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dec787007fd76e7 server_cookie=1ab73358f83bbfc8 in_seq=0 out_seq=0 2024-09-11T22:38:03.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62997fa640 1 -- 172.21.15.22:0/3813911481 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5627cb24bd00 con 0x5627cb365590 2024-09-11T22:38:03.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62997fa640 10 client.16896 handle_command_reply: tid=0 2024-09-11T22:38:03.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 client.16896 shutdown 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 msgr2=0x5627cb35c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f62a8035000 tx=0x7f62a8046000 comp rx=0 tx=0).stop 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 shutdown_connections 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5627cb365590 0x5627cb3679b0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5627cb2e9d40 0x5627cb35c270 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5627cb2df480 0x5627cb2eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62997fa640 0 client.16896 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 --2- 172.21.15.22:0/3813911481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5627cb2deb60 0x5627cb2ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 >> 172.21.15.22:0/3813911481 conn(0x5627cb2db0f0 msgr2=0x5627cb2d9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 shutdown_connections 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 1 -- 172.21.15.22:0/3813911481 wait complete. 2024-09-11T22:38:03.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.713+0000 7f62ba49b740 20 client.16896 trim_cache size 0 max 16384 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "bdef957d-b630-4c4b-a60c-440b2b7d7b2e", 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:03.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 msgr2=0x7f629c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 0x7f629c0a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005fe0 tx=0x7f62a8032cc0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 msgr2=0x7f62b0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d950 tx=0x7f62ac00de10 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 shutdown_connections 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f629c0a2d70 0x7f629c0a5230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62b01082a0 0x7f62b0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b01036e0 0x7f62b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 --2- 172.21.15.22:0/181461257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62b0102d30 0x7f62b0100990 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 >> 172.21.15.22:0/181461257 conn(0x7f62b00fc7d0 msgr2=0x7f62b0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 shutdown_connections 2024-09-11T22:38:03.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:03.714+0000 7f62b80c2640 1 -- 172.21.15.22:0/181461257 wait complete. 2024-09-11T22:38:03.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:03 smithi169 ceph-mon[35628]: pgmap v278: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:03.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:03 smithi045 ceph-mon[35556]: pgmap v278: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:04.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:38:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:04 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:38:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:04 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:04 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:38:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:04 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:04 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:38:04.798 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:04.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:04 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:38:04.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:04 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:04 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:38:04.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:04 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:04 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:38:04.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:04 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:38:04.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:04 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:04 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:38:04.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:04 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:04.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:04 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:38:05.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 -- 172.21.15.22:0/1476575548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5501055b0 msgr2=0x7fb55010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 --2- 172.21.15.22:0/1476575548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5501055b0 0x7fb55010d130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb548009ca0 tx=0x7fb54802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 -- 172.21.15.22:0/1476575548 shutdown_connections 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 --2- 172.21.15.22:0/1476575548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5501055b0 0x7fb55010d130 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 --2- 172.21.15.22:0/1476575548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb550100e30 0x7fb550104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 --2- 172.21.15.22:0/1476575548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100480 0x7fb550100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 -- 172.21.15.22:0/1476575548 >> 172.21.15.22:0/1476575548 conn(0x7fb550077210 msgr2=0x7fb5500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 -- 172.21.15.22:0/1476575548 shutdown_connections 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.326+0000 7fb554a41640 1 -- 172.21.15.22:0/1476575548 wait complete. 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.327+0000 7fb554a41640 1 Processor -- start 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.327+0000 7fb554a41640 1 -- start start 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.327+0000 7fb554a41640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.327+0000 7fb554a41640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100e30 0x7fb550198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5501055b0 0x7fb55019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501120d0 con 0x7fb550100480 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb550111f50 con 0x7fb5501055b0 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb550112250 con 0x7fb550100e30 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55306/0 (socket says 172.21.15.22:55306) 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 -- 172.21.15.22:0/816450117 learned_addr learned my addr 172.21.15.22:0/816450117 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5501055b0 0x7fb55019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100e30 0x7fb550198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 -- 172.21.15.22:0/816450117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100e30 msgr2=0x7fb550198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100e30 0x7fb550198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 -- 172.21.15.22:0/816450117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5501055b0 msgr2=0x7fb55019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5501055b0 0x7fb55019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 -- 172.21.15.22:0/816450117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55019d480 con 0x7fb550100480 2024-09-11T22:38:05.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb54e59c640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb53f7fe640 1 -- 172.21.15.22:0/816450117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540017070 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55019d770 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb53f7fe640 1 -- 172.21.15.22:0/816450117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb540005520 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb53f7fe640 1 -- 172.21.15.22:0/816450117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540010460 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.328+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5501a5050 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb53f7fe640 1 -- 172.21.15.22:0/816450117 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb540004ea0 con 0x7fb550100480 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 Processor -- start 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 -- start start 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f81550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f83e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e178ed82e0 con 0x55e178f723c0 2024-09-11T22:38:05.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e178e7fce0 con 0x55e178f72ce0 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.331+0000 7fb556e1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e178ed42a0 con 0x55e178f81a90 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55308/0 (socket says 172.21.15.22:55308) 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54ed9d640 1 -- 172.21.15.22:0/2904209416 learned_addr learned my addr 172.21.15.22:0/2904209416 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f81550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb53f7fe640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 0x7fb5380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f83e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 0x7fb5380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb53f7fe640 1 -- 172.21.15.22:0/816450117 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fb5400cefb0 con 0x7fb550100480 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 -- 172.21.15.22:0/2904209416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 msgr2=0x55e178f83e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f83e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 -- 172.21.15.22:0/2904209416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 msgr2=0x55e178f727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 -- 172.21.15.22:0/2904209416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e178e64440 con 0x55e178f72ce0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f83e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54e59c640 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f81550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cc720 tx=0x7fb540004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4c6152ade20b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.332+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 0x7fb5380a51b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb548009430 tx=0x7fb54802a8c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb53cff9640 1 -- 172.21.15.22:0/2904209416 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540020070 con 0x55e178f72ce0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb53cff9640 1 -- 172.21.15.22:0/2904209416 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb54009bbf0 con 0x55e178f72ce0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb53cff9640 1 -- 172.21.15.22:0/2904209416 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400cc9a0 con 0x55e178f72ce0 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 -- 172.21.15.22:0/2904209416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 msgr2=0x55e178f81550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f81550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cc720 tx=0x7fb540004940 comp rx=0 tx=0).stop 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 -- 172.21.15.22:0/2904209416 shutdown_connections 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f83e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f81550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 --2- 172.21.15.22:0/2904209416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 -- 172.21.15.22:0/2904209416 >> 172.21.15.22:0/2904209416 conn(0x55e178f6ea30 msgr2=0x55e178f6ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 -- 172.21.15.22:0/2904209416 shutdown_connections 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.333+0000 7fb556e1a740 1 -- 172.21.15.22:0/2904209416 wait complete. 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 -- start start 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 Processor -- start 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f7e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f7ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e178f845a0 con 0x55e178f723c0 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e178e93050 con 0x55e178f72ce0 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e178f84720 con 0x55e178f81a90 2024-09-11T22:38:05.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb556e1a740 10 client.0 _ll_register_callbacks cb 0x55e178ed3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55310/0 (socket says 172.21.15.22:55310) 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb54e59c640 1 -- 172.21.15.22:0/974284802 learned_addr learned my addr 172.21.15.22:0/974284802 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f7e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.334+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f7ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 -- 172.21.15.22:0/974284802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 msgr2=0x55e178f7ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f7ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 -- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 msgr2=0x55e178f7e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f7e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 -- 172.21.15.22:0/974284802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e178c493c0 con 0x55e178f723c0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f7ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb54e59c640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb54009b480 tx=0x7fb540097d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226d4686deaddcfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400b3020 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fb540005190 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb54009bbf0 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb540020040 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb556e1a740 10 client.16908 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.335+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e178f900c0 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5400a4160 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fb54009a940 con 0x55e178f723c0 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 10 client.16908 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:05.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 20 client.16908 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178f91410 0x55e178f93800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 4 client.16908 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.336+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb54009bbf0 con 0x55e178f91410 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.337+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178f91410 0x55e178f93800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.337+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178f91410 0x55e178f93800 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c7766957403df38 server_cookie=d4f4e558e02a41a8 in_seq=0 out_seq=0 2024-09-11T22:38:05.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.337+0000 7fb535ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb535ffb640 1 -- 172.21.15.22:0/974284802 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb54009bbf0 con 0x55e178f91410 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb535ffb640 10 client.16908 handle_command_reply: tid=0 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 client.16908 shutdown 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 msgr2=0x55e178f814f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb54009b480 tx=0x7fb540097d40 comp rx=0 tx=0).stop 2024-09-11T22:38:05.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 shutdown_connections 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178f91410 0x55e178f93800 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f7ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f7e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 --2- 172.21.15.22:0/974284802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f814f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 >> 172.21.15.22:0/974284802 conn(0x55e178f6ea30 msgr2=0x55e178f6db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb535ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 shutdown_connections 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 1 -- 172.21.15.22:0/974284802 wait complete. 2024-09-11T22:38:05.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.338+0000 7fb556e1a740 20 client.16908 trim_cache size 0 max 16384 2024-09-11T22:38:05.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 Processor -- start 2024-09-11T22:38:05.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 -- start start 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f723c0 0x55e178f7ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f81a90 0x55e178f7cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501a97b0 con 0x55e178f72ce0 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ac010 con 0x55e178f81a90 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.355+0000 7fb556e1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501a9e00 con 0x55e178f723c0 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55322/0 (socket says 172.21.15.22:55322) 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 -- 172.21.15.22:0/1048462079 learned_addr learned my addr 172.21.15.22:0/1048462079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54e59c640 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f723c0 0x55e178f7ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 -- 172.21.15.22:0/1048462079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f723c0 msgr2=0x55e178f7ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f723c0 0x55e178f7ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f81a90 0x55e178f7cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 -- 172.21.15.22:0/1048462079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f81a90 msgr2=0x55e178f7cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f81a90 0x55e178f7cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 -- 172.21.15.22:0/1048462079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e178f81010 con 0x55e178f72ce0 2024-09-11T22:38:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb5500ff630 tx=0x7fb544013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ad71d053625398 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb537fff640 1 -- 172.21.15.22:0/1048462079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544004030 con 0x55e178f72ce0 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb537fff640 1 -- 172.21.15.22:0/1048462079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5440041d0 con 0x55e178f72ce0 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.356+0000 7fb537fff640 1 -- 172.21.15.22:0/1048462079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5440117c0 con 0x55e178f72ce0 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- 172.21.15.22:0/1048462079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 msgr2=0x55e178f7bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb5500ff630 tx=0x7fb544013830 comp rx=0 tx=0).stop 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- 172.21.15.22:0/1048462079 shutdown_connections 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f81a90 0x55e178f7cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f72ce0 0x55e178f7bf40 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 --2- 172.21.15.22:0/1048462079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f723c0 0x55e178f7ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- 172.21.15.22:0/1048462079 >> 172.21.15.22:0/1048462079 conn(0x55e178f6ea30 msgr2=0x55e178f79d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- 172.21.15.22:0/1048462079 shutdown_connections 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- 172.21.15.22:0/1048462079 wait complete. 2024-09-11T22:38:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 -- start start 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.357+0000 7fb556e1a740 1 Processor -- start 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f93d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f942d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501aa4d0 con 0x55e178f723c0 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ab940 con 0x55e178f72ce0 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501aaba0 con 0x55e178f81a90 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb556e1a740 10 client.0 _ll_register_callbacks cb 0x7fb548009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55330/0 (socket says 172.21.15.22:55330) 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 -- 172.21.15.22:0/4083457766 learned_addr learned my addr 172.21.15.22:0/4083457766 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f93d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 -- 172.21.15.22:0/4083457766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 msgr2=0x55e178f942d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f942d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 -- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 msgr2=0x55e178f93d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f93d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 -- 172.21.15.22:0/4083457766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e178f94970 con 0x55e178f723c0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54ed9d640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f942d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.358+0000 7fb54e59c640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb540097950 tx=0x7fb54009a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4253c39a098a1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400b3070 con 0x55e178f723c0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7fb5400b4450 con 0x55e178f723c0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5440041d0 con 0x55e178f723c0 2024-09-11T22:38:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb54009ae50 con 0x55e178f723c0 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 10 client.16914 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e178f94970 con 0x55e178f723c0 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5440041d0 con 0x55e178f723c0 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fb540083020 con 0x55e178f723c0 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 10 client.16914 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 20 client.16914 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178ffbf00 0x55e178ffe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 4 client.16914 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.359+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e178ee5850 con 0x55e178ffbf00 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178ffbf00 0x55e178ffe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb535ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb54dd9b640 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178ffbf00 0x55e178ffe2f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120c9476a79be1eb server_cookie=e4ccd66074ed1639 in_seq=0 out_seq=0 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb535ffb640 1 -- 172.21.15.22:0/4083457766 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e178ee5850 con 0x55e178ffbf00 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb535ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 client.16914 shutdown 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 msgr2=0x55e178f96a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb540097950 tx=0x7fb54009a580 comp rx=0 tx=0).stop 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 shutdown_connections 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55e178ffbf00 0x55e178ffe2f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e178f81a90 0x55e178f942d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e178f72ce0 0x55e178f93d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 --2- 172.21.15.22:0/4083457766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e178f723c0 0x55e178f96a40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 >> 172.21.15.22:0/4083457766 conn(0x55e178f6ea30 msgr2=0x55e178f8c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb535ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 shutdown_connections 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.360+0000 7fb556e1a740 1 -- 172.21.15.22:0/4083457766 wait complete. 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb556e1a740 20 client.16914 trim_cache size 0 max 16384 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:38:05.367 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 msgr2=0x7fb5380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 0x7fb5380a51b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb548009430 tx=0x7fb54802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 msgr2=0x7fb5501984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 shutdown_connections 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb5380a2cf0 0x7fb5380a51b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5501055b0 0x7fb55019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb550100e30 0x7fb550198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 --2- 172.21.15.22:0/816450117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb550100480 0x7fb5501984d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 >> 172.21.15.22:0/816450117 conn(0x7fb550077210 msgr2=0x7fb550103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 shutdown_connections 2024-09-11T22:38:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:05.361+0000 7fb554a41640 1 -- 172.21.15.22:0/816450117 wait complete. 2024-09-11T22:38:05.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:05 smithi022 ceph-mon[30966]: pgmap v279: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:38:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:05 smithi169 ceph-mon[35628]: pgmap v279: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:38:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:05 smithi045 ceph-mon[35556]: pgmap v279: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:38:06.111 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:38:06.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:38:06.370 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:06.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 -- 172.21.15.22:0/4183079980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 msgr2=0x7f21e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 --2- 172.21.15.22:0/4183079980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e0101200 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009900 tx=0x7f21d002a480 comp rx=0 tx=0).stop 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 -- 172.21.15.22:0/4183079980 shutdown_connections 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 --2- 172.21.15.22:0/4183079980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102ef0 0x7f21e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 --2- 172.21.15.22:0/4183079980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102570 0x7f21e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 --2- 172.21.15.22:0/4183079980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e0101200 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 -- 172.21.15.22:0/4183079980 >> 172.21.15.22:0/4183079980 conn(0x7f21e00fc7d0 msgr2=0x7f21e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 -- 172.21.15.22:0/4183079980 shutdown_connections 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.977+0000 7f21e632a640 1 -- 172.21.15.22:0/4183079980 wait complete. 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 Processor -- start 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 -- start start 2024-09-11T22:38:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 0x7f21e00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 0x7f21e00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21e01110a0 con 0x7f21e0100e20 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0110f20 con 0x7f21e0102ef0 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21e632a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0111220 con 0x7f21e0102570 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55356/0 (socket says 172.21.15.22:55356) 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.978+0000 7f21dffff640 1 -- 172.21.15.22:0/3841155000 learned_addr learned my addr 172.21.15.22:0/3841155000 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:06.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21df7fe640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 0x7f21e00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21e48c7640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 0x7f21e00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 -- 172.21.15.22:0/3841155000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 msgr2=0x7f21e00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 0x7f21e00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 -- 172.21.15.22:0/3841155000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 msgr2=0x7f21e00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 0x7f21e00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 -- 172.21.15.22:0/3841155000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e01a6a20 con 0x7f21e0100e20 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21df7fe640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 0x7f21e00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21e48c7640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 0x7f21e00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dffff640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006010 tx=0x7f21d0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d003f030 con 0x7f21e0100e20 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f21d0005500 con 0x7f21e0100e20 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e01a6cb0 con 0x7f21e0100e20 2024-09-11T22:38:06.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0035070 con 0x7f21e0100e20 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.979+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e01a7190 con 0x7f21e0100e20 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.980+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e0101200 con 0x7f21e0100e20 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.981+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f21d0042030 con 0x7f21e0100e20 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.982+0000 7f21dd7fa640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 0x7f21c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.982+0000 7f21df7fe640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 0x7f21c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.982+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f21d00efa60 con 0x7f21e0100e20 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.982+0000 7f21df7fe640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 0x7f21c80a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f21e00fe710 tx=0x7f21d4005d90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:06.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:06.986+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21d00bc6a0 con 0x7f21e0100e20 2024-09-11T22:38:07.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.196+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21e010a0a0 con 0x7f21e0100e20 2024-09-11T22:38:07.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.197+0000 7f21dd7fa640 1 -- 172.21.15.22:0/3841155000 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f21d00bbfa0 con 0x7f21e0100e20 2024-09-11T22:38:07.197 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:38:07.198 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:38:07.198 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:38:07.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 msgr2=0x7f21c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:07.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 0x7f21c80a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f21e00fe710 tx=0x7f21d4005d90 comp rx=0 tx=0).stop 2024-09-11T22:38:07.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 msgr2=0x7f21e00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:07.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f21d0006010 tx=0x7f21d0004c00 comp rx=0 tx=0).stop 2024-09-11T22:38:07.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 shutdown_connections 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f21c80a2d70 0x7f21c80a5230 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e0102ef0 0x7f21e00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21e0102570 0x7f21e00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 --2- 172.21.15.22:0/3841155000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21e0100e20 0x7f21e00fcc80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 >> 172.21.15.22:0/3841155000 conn(0x7f21e00fc7d0 msgr2=0x7f21e006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 shutdown_connections 2024-09-11T22:38:07.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:07.199+0000 7f21e632a640 1 -- 172.21.15.22:0/3841155000 wait complete. 2024-09-11T22:38:07.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:07 smithi022 ceph-mon[30966]: pgmap v280: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:38:07.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:07 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3841155000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:07 smithi169 ceph-mon[35628]: pgmap v280: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:38:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:07 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3841155000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:07 smithi045 ceph-mon[35556]: pgmap v280: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:38:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:07 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3841155000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:07.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:38:08.261 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:08.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- 172.21.15.22:0/505012776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 msgr2=0x7f62f810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 --2- 172.21.15.22:0/505012776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f810ec70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009cd0 tx=0x7f62f002a8d0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- 172.21.15.22:0/505012776 shutdown_connections 2024-09-11T22:38:08.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 --2- 172.21.15.22:0/505012776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f810ec70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 --2- 172.21.15.22:0/505012776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 0x7f62f8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 --2- 172.21.15.22:0/505012776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- 172.21.15.22:0/505012776 >> 172.21.15.22:0/505012776 conn(0x7f62f80fc7d0 msgr2=0x7f62f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- 172.21.15.22:0/505012776 shutdown_connections 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- 172.21.15.22:0/505012776 wait complete. 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 Processor -- start 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.844+0000 7f62fec9d640 1 -- start start 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 0x7f62f8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81121f0 con 0x7f62f8108300 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8112070 con 0x7f62f8103780 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fec9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8112370 con 0x7f62f8102dd0 2024-09-11T22:38:08.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55378/0 (socket says 172.21.15.22:55378) 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 -- 172.21.15.22:0/3744381775 learned_addr learned my addr 172.21.15.22:0/3744381775 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 0x7f62f8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fca39640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 -- 172.21.15.22:0/3744381775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 msgr2=0x7f62f8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 -- 172.21.15.22:0/3744381775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 msgr2=0x7f62f8198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 0x7f62f8198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 -- 172.21.15.22:0/3744381775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f819d5e0 con 0x7f62f8108300 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fca39640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62fd23a640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009df0 tx=0x7f62f0031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.845+0000 7f62f5ffb640 1 -- 172.21.15.22:0/3744381775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f002f7e0 con 0x7f62f8108300 2024-09-11T22:38:08.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.846+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f819d870 con 0x7f62f8108300 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.846+0000 7f62f5ffb640 1 -- 172.21.15.22:0/3744381775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62f002fe80 con 0x7f62f8108300 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.846+0000 7f62f5ffb640 1 -- 172.21.15.22:0/3744381775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0046480 con 0x7f62f8108300 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.846+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a51b0 con 0x7f62f8108300 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.848+0000 7f62f5ffb640 1 -- 172.21.15.22:0/3744381775 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f62f0030720 con 0x7f62f8108300 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.848+0000 7f6301076740 1 Processor -- start 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.848+0000 7f6301076740 1 -- start start 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85dc5d0 0x55a1c85dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a1c85422f0 con 0x55a1c85ddb40 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1c84e9cf0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f6301076740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a1c853e2b0 con 0x55a1c85e7370 2024-09-11T22:38:08.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55384/0 (socket says 172.21.15.22:55384) 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 -- 172.21.15.22:0/3674064799 learned_addr learned my addr 172.21.15.22:0/3674064799 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f5ffb640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 0x7f62e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62fca39640 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85dc5d0 0x55a1c85dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62fd23a640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 0x7f62e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f5ffb640 1 -- 172.21.15.22:0/3744381775 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62f00f04e0 con 0x7f62f8108300 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 -- 172.21.15.22:0/3674064799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 msgr2=0x55a1c85e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 -- 172.21.15.22:0/3674064799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85dc5d0 msgr2=0x55a1c85dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85dc5d0 0x55a1c85dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.849+0000 7f62f7fff640 1 -- 172.21.15.22:0/3674064799 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c84ce3a0 con 0x55a1c85ddb40 2024-09-11T22:38:08.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00af60 tx=0x7f62ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8fee5712b72a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f62fd23a640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 0x7f62e00a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f62f00b8f30 tx=0x7f62f008c930 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f62deffd640 1 -- 172.21.15.22:0/3674064799 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004020 con 0x55a1c85ddb40 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f62deffd640 1 -- 172.21.15.22:0/3674064799 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62ec0041c0 con 0x55a1c85ddb40 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f62deffd640 1 -- 172.21.15.22:0/3674064799 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0126b0 con 0x55a1c85ddb40 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 -- 172.21.15.22:0/3674064799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 msgr2=0x55a1c85dc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00af60 tx=0x7f62ec00a660 comp rx=0 tx=0).stop 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 -- 172.21.15.22:0/3674064799 shutdown_connections 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85dc5d0 0x55a1c85dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 --2- 172.21.15.22:0/3674064799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85dc090 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 -- 172.21.15.22:0/3674064799 >> 172.21.15.22:0/3674064799 conn(0x55a1c85a5310 msgr2=0x55a1c85d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.850+0000 7f6301076740 1 -- 172.21.15.22:0/3674064799 shutdown_connections 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 -- 172.21.15.22:0/3674064799 wait complete. 2024-09-11T22:38:08.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 -- start start 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 Processor -- start 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a1c85ea070 con 0x55a1c85dc5d0 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1c84fd060 con 0x55a1c85ddb40 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.851+0000 7f6301076740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a1c85ea1f0 con 0x55a1c85e7370 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f6301076740 10 client.0 _ll_register_callbacks cb 0x55a1c82508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55394/0 (socket says 172.21.15.22:55394) 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 -- 172.21.15.22:0/314737627 learned_addr learned my addr 172.21.15.22:0/314737627 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62fca39640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 -- 172.21.15.22:0/314737627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 msgr2=0x55a1c85e44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 -- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 msgr2=0x55a1c85e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 -- 172.21.15.22:0/314737627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c82b33c0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62f7fff640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f62ec012010 tx=0x7f62ec003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2526250741f9f26d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01e660 con 0x55a1c85dc5d0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ec0041c0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.852+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62ec01e800 con 0x55a1c85dc5d0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f62ec033050 con 0x55a1c85dc5d0 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 10 client.16932 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a1c85f5a80 con 0x55a1c85dc5d0 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62ec0041c0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f62ec00f7b0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 10 client.16932 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 20 client.16932 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c85f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 4 client.16932 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1c854f860 con 0x55a1c85f6e30 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.853+0000 7f62fca39640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c85f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.854+0000 7f62d7fff640 10 client.16932 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.854+0000 7f62fca39640 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c85f9220 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29aff9db19ee48b server_cookie=17a37157783ee3c in_seq=0 out_seq=0 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f62d7fff640 1 -- 172.21.15.22:0/314737627 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1c854f860 con 0x55a1c85f6e30 2024-09-11T22:38:08.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f62d7fff640 10 client.16932 handle_command_reply: tid=0 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 client.16932 shutdown 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 msgr2=0x55a1c85e6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f62ec012010 tx=0x7f62ec003e40 comp rx=0 tx=0).stop 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 shutdown_connections 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c85f9220 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f62d7fff640 0 client.16932 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 --2- 172.21.15.22:0/314737627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85e6ce0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 >> 172.21.15.22:0/314737627 conn(0x55a1c85a5310 msgr2=0x55a1c85de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 shutdown_connections 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 1 -- 172.21.15.22:0/314737627 wait complete. 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.855+0000 7f6301076740 20 client.16932 trim_cache size 0 max 16384 2024-09-11T22:38:08.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.868+0000 7f6301076740 1 Processor -- start 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.868+0000 7f6301076740 1 -- start start 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.868+0000 7f6301076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f6301076740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f6301076740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f6301076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81ab8b0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f6301076740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81ae110 con 0x55a1c85ddb40 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f6301076740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81abf00 con 0x55a1c85e7370 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55404/0 (socket says 172.21.15.22:55404) 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62f7fff640 1 -- 172.21.15.22:0/2744932030 learned_addr learned my addr 172.21.15.22:0/2744932030 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62f7fff640 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 -- 172.21.15.22:0/2744932030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 msgr2=0x55a1c85fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 -- 172.21.15.22:0/2744932030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 msgr2=0x55a1c85f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 -- 172.21.15.22:0/2744932030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c85e7050 con 0x55a1c85ddb40 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62fca39640 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e2f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a1c85f9950 tx=0x7f62e800c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b4471b24805dea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.869+0000 7f62de7fc640 1 -- 172.21.15.22:0/2744932030 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8021070 con 0x55a1c85ddb40 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f62de7fc640 1 -- 172.21.15.22:0/2744932030 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62e8005520 con 0x55a1c85ddb40 2024-09-11T22:38:08.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f62de7fc640 1 -- 172.21.15.22:0/2744932030 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8004d70 con 0x55a1c85ddb40 2024-09-11T22:38:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 -- 172.21.15.22:0/2744932030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 msgr2=0x55a1c85e2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e2f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55a1c85f9950 tx=0x7f62e800c4f0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 -- 172.21.15.22:0/2744932030 shutdown_connections 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85e7370 0x55a1c85fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85ddb40 0x55a1c85e2f70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 --2- 172.21.15.22:0/2744932030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85dc5d0 0x55a1c85f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 -- 172.21.15.22:0/2744932030 >> 172.21.15.22:0/2744932030 conn(0x55a1c85a5310 msgr2=0x55a1c85e2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 -- 172.21.15.22:0/2744932030 shutdown_connections 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.870+0000 7f6301076740 1 -- 172.21.15.22:0/2744932030 wait complete. 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 -- start start 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 Processor -- start 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85dc5d0 0x55a1c85ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85e7370 0x55a1c85e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81ac5d0 con 0x55a1c85ddb40 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81ada40 con 0x55a1c85e7370 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81acca0 con 0x55a1c85dc5d0 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.871+0000 7f6301076740 10 client.0 _ll_register_callbacks cb 0x7f62e800c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55416/0 (socket says 172.21.15.22:55416) 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 -- 172.21.15.22:0/3478833476 learned_addr learned my addr 172.21.15.22:0/3478833476 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85dc5d0 0x55a1c85ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85e7370 0x55a1c85e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 -- 172.21.15.22:0/3478833476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85dc5d0 msgr2=0x55a1c85ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85dc5d0 0x55a1c85ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 -- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85e7370 msgr2=0x55a1c85e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85e7370 0x55a1c85e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 -- 172.21.15.22:0/3478833476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c85e10d0 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62fca39640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f62e8000c00 tx=0x7f62e8004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5ba57b962fcfdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8021070 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8484+0+0 (secure 0 0 0) 0x7f62e8003a00 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e8005520 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f62e8003c00 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f6301076740 10 client.16938 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.872+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a1c8661500 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62e8005520 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f62e802f020 con 0x55a1c85ddb40 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 10 client.16938 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:08.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 20 client.16938 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c8663c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 4 client.16938 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1c8549d70 con 0x55a1c85f6e30 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.873+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c8663c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f62f7fff640 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c8663c90 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae03523300089b6d server_cookie=1f575794c110f1df in_seq=0 out_seq=0 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f62d7fff640 10 client.16938 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f62d7fff640 1 -- 172.21.15.22:0/3478833476 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1c8549d70 con 0x55a1c85f6e30 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f62d7fff640 10 client.16938 handle_command_reply: tid=0 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 client.16938 shutdown 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 msgr2=0x55a1c85efc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f62e8000c00 tx=0x7f62e8004250 comp rx=0 tx=0).stop 2024-09-11T22:38:08.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 shutdown_connections 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a1c85f6e30 0x55a1c8663c90 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1c85e7370 0x55a1c85e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a1c85ddb40 0x55a1c85efc50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f62d7fff640 0 client.16938 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 --2- 172.21.15.22:0/3478833476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a1c85dc5d0 0x55a1c85ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 >> 172.21.15.22:0/3478833476 conn(0x55a1c85a5310 msgr2=0x55a1c85d74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 shutdown_connections 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 1 -- 172.21.15.22:0/3478833476 wait complete. 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.874+0000 7f6301076740 20 client.16938 trim_cache size 0 max 16384 2024-09-11T22:38:08.889 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:38:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 msgr2=0x7f62e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 0x7f62e00a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f62f00b8f30 tx=0x7f62f008c930 comp rx=0 tx=0).stop 2024-09-11T22:38:08.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 msgr2=0x7f62f819cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009df0 tx=0x7f62f0031650 comp rx=0 tx=0).stop 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 shutdown_connections 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f62e00a2cf0 0x7f62e00a51b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62f8108300 0x7f62f819cf00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f8103780 0x7f62f8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 --2- 172.21.15.22:0/3744381775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f8102dd0 0x7f62f8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 >> 172.21.15.22:0/3744381775 conn(0x7f62f80fc7d0 msgr2=0x7f62f8105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 shutdown_connections 2024-09-11T22:38:08.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:08.875+0000 7f62fec9d640 1 -- 172.21.15.22:0/3744381775 wait complete. 2024-09-11T22:38:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:09 smithi022 ceph-mon[30966]: pgmap v281: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:38:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:09 smithi169 ceph-mon[35628]: pgmap v281: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:38:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:09 smithi045 ceph-mon[35556]: pgmap v281: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:38:10.760 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:38:10.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:38:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:10 smithi022 ceph-mon[30966]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:38:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:10 smithi169 ceph-mon[35628]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:38:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:10 smithi045 ceph-mon[35556]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:38:11.030 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:11.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 -- 172.21.15.22:0/3142422803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4102d40 msgr2=0x7f44c4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 --2- 172.21.15.22:0/3142422803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4102d40 0x7f44c4103120 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009900 tx=0x7f44c002a480 comp rx=0 tx=0).stop 2024-09-11T22:38:11.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 -- 172.21.15.22:0/3142422803 shutdown_connections 2024-09-11T22:38:11.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 --2- 172.21.15.22:0/3142422803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c410c170 0x7f44c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 --2- 172.21.15.22:0/3142422803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c4103660 0x7f44c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 --2- 172.21.15.22:0/3142422803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4102d40 0x7f44c4103120 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 -- 172.21.15.22:0/3142422803 >> 172.21.15.22:0/3142422803 conn(0x7f44c40fc7a0 msgr2=0x7f44c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.496+0000 7f44cb744640 1 -- 172.21.15.22:0/3142422803 shutdown_connections 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 -- 172.21.15.22:0/3142422803 wait complete. 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 Processor -- start 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 -- start start 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4102d40 0x7f44c4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 0x7f44c419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4112090 con 0x7f44c4103660 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4111f10 con 0x7f44c410c170 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44cb744640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4112210 con 0x7f44c4102d40 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.497+0000 7f44c8cdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55430/0 (socket says 172.21.15.22:55430) 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 -- 172.21.15.22:0/2147918505 learned_addr learned my addr 172.21.15.22:0/2147918505 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4102d40 0x7f44c4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 0x7f44c419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 -- 172.21.15.22:0/2147918505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4102d40 msgr2=0x7f44c4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4102d40 0x7f44c4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 -- 172.21.15.22:0/2147918505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 msgr2=0x7f44c419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 0x7f44c419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 -- 172.21.15.22:0/2147918505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c419d4c0 con 0x7f44c4103660 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 0x7f44c419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f44b400d740 tx=0x7f44b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44ba7fc640 1 -- 172.21.15.22:0/2147918505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4017070 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44ba7fc640 1 -- 172.21.15.22:0/2147918505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44b400de50 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44ba7fc640 1 -- 172.21.15.22:0/2147918505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b400f620 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c419d7b0 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.498+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c41a5090 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.500+0000 7f44ba7fc640 1 -- 172.21.15.22:0/2147918505 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f44b4009c30 con 0x7f44c4103660 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 Processor -- start 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 -- start start 2024-09-11T22:38:11.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20abf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5612a2011280 con 0x5612a20b6d40 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5612a1fb8b10 con 0x5612a20ac480 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612a200d240 con 0x5612a20abb60 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44ba7fc640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 0x7f44b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.501+0000 7f44c8cdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c8cdf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55440/0 (socket says 172.21.15.22:55440) 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c8cdf640 1 -- 172.21.15.22:0/2224354187 learned_addr learned my addr 172.21.15.22:0/2224354187 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 0x7f44b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44ba7fc640 1 -- 172.21.15.22:0/2147918505 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7f44b40cf0e0 con 0x7f44c4103660 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 -- 172.21.15.22:0/2224354187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 msgr2=0x5612a20abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 -- 172.21.15.22:0/2224354187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 msgr2=0x5612a20b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 -- 172.21.15.22:0/2224354187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a1fc51f0 con 0x5612a20ac480 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 0x7f44b00a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44bc005c40 tx=0x7f44bc009d50 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.502+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b6800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005940 tx=0x7f44c0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526585b644c6655f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44af7fe640 1 -- 172.21.15.22:0/2224354187 <== mon.2 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0040070 con 0x5612a20ac480 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44af7fe640 1 -- 172.21.15.22:0/2224354187 <== mon.2 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c0031a00 con 0x5612a20ac480 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44af7fe640 1 -- 172.21.15.22:0/2224354187 <== mon.2 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0035040 con 0x5612a20ac480 2024-09-11T22:38:11.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2224354187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 msgr2=0x5612a20b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b6800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005940 tx=0x7f44c0005c00 comp rx=0 tx=0).stop 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2224354187 shutdown_connections 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b6800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2224354187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2224354187 >> 172.21.15.22:0/2224354187 conn(0x5612a20a80f0 msgr2=0x5612a20a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2224354187 shutdown_connections 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.503+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2224354187 wait complete. 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 -- start start 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 Processor -- start 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20abb60 0x5612a20b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5612a20b9910 con 0x5612a20b6d40 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5612a1fcbf10 con 0x5612a20abb60 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612a20b9a90 con 0x5612a20ac480 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44cdb1d740 10 client.0 _ll_register_callbacks cb 0x5612a1f94a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44c9ce1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44c9ce1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55442/0 (socket says 172.21.15.22:55442) 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44c9ce1640 1 -- 172.21.15.22:0/1310768740 learned_addr learned my addr 172.21.15.22:0/1310768740 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.504+0000 7f44c94e0640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20abb60 0x5612a20b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 -- 172.21.15.22:0/1310768740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 msgr2=0x5612a20b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 -- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20abb60 msgr2=0x5612a20b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20abb60 0x5612a20b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 -- 172.21.15.22:0/1310768740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a1d826a0 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f44bc010d20 tx=0x7f44bc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7322f51aab892781 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44acff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc01ee40 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7f44bc02a410 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c0031a00 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f44bc02a650 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44cdb1d740 10 client.16950 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.505+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5612a20c5440 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c0031a00 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f44bc01f070 con 0x5612a20b6d40 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 10 client.16950 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:11.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 20 client.16950 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a20c6850 0x5612a20c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 4 client.16950 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612a201e7f0 con 0x5612a20c6850 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.506+0000 7f44c94e0640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a20c6850 0x5612a20c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.507+0000 7f44c94e0640 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a20c6850 0x5612a20c8ca0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58d33f4bc6b31d5 server_cookie=836eaa971f4ae702 in_seq=0 out_seq=0 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.507+0000 7f44acff9640 10 client.16950 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.507+0000 7f44acff9640 1 -- 172.21.15.22:0/1310768740 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612a201e7f0 con 0x5612a20c6850 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.507+0000 7f44acff9640 10 client.16950 handle_command_reply: tid=0 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.507+0000 7f44cdb1d740 1 client.16950 shutdown 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 msgr2=0x5612a20b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f44bc010d20 tx=0x7f44bc005bd0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 shutdown_connections 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a20c6850 0x5612a20c8ca0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b4280 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/1310768740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20abb60 0x5612a20b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 >> 172.21.15.22:0/1310768740 conn(0x5612a20a80f0 msgr2=0x5612a20addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44acff9640 0 client.16950 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 shutdown_connections 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 1 -- 172.21.15.22:0/1310768740 wait complete. 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.508+0000 7f44cdb1d740 20 client.16950 trim_cache size 0 max 16384 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 Processor -- start 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 -- start start 2024-09-11T22:38:11.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 0x5612a20b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41ab920 con 0x5612a20abb60 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41ae1a0 con 0x5612a20b6d40 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41abf90 con 0x5612a20ac480 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44c94e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44c94e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55454/0 (socket says 172.21.15.22:55454) 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.525+0000 7f44c94e0640 1 -- 172.21.15.22:0/2790497139 learned_addr learned my addr 172.21.15.22:0/2790497139 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 0x5612a20b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 -- 172.21.15.22:0/2790497139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 msgr2=0x5612a20bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 -- 172.21.15.22:0/2790497139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 msgr2=0x5612a20b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 0x5612a20b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 -- 172.21.15.22:0/2790497139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a20a7f20 con 0x5612a20abb60 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 0x5612a20b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44c94e0640 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005a90 tx=0x7f44c0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a836f660bff95321 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44aeffd640 1 -- 172.21.15.22:0/2790497139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0040050 con 0x5612a20abb60 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44aeffd640 1 -- 172.21.15.22:0/2790497139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c0004230 con 0x5612a20abb60 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.526+0000 7f44aeffd640 1 -- 172.21.15.22:0/2790497139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0035040 con 0x5612a20abb60 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2790497139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 msgr2=0x5612a20bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f44c0005a90 tx=0x7f44c0005a20 comp rx=0 tx=0).stop 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2790497139 shutdown_connections 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20b6d40 0x5612a20b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20ac480 0x5612a20bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/2790497139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20abb60 0x5612a20bf0c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2790497139 >> 172.21.15.22:0/2790497139 conn(0x5612a20a80f0 msgr2=0x5612a20aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2790497139 shutdown_connections 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- 172.21.15.22:0/2790497139 wait complete. 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 -- start start 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 Processor -- start 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.527+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41ac660 con 0x5612a20b6d40 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41adad0 con 0x5612a20ac480 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44c41acd30 con 0x5612a20abb60 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 10 client.0 _ll_register_callbacks cb 0x7f44bc009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55470/0 (socket says 172.21.15.22:55470) 2024-09-11T22:38:11.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 -- 172.21.15.22:0/3192781796 learned_addr learned my addr 172.21.15.22:0/3192781796 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c94e0640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c8cdf640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 -- 172.21.15.22:0/3192781796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 msgr2=0x5612a20b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 -- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 msgr2=0x5612a20b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 -- 172.21.15.22:0/3192781796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a2134770 con 0x5612a20b6d40 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44c9ce1640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f44bc012a40 tx=0x7f44bc009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bee00b19d2910d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44acff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc032b90 con 0x5612a20b6d40 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7f44bc01b030 con 0x5612a20b6d40 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c0004230 con 0x5612a20b6d40 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.528+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f44bc042050 con 0x5612a20b6d40 2024-09-11T22:38:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 10 client.16956 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5612a2135a20 con 0x5612a20b6d40 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c0004230 con 0x5612a20b6d40 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f44bc02ac90 con 0x5612a20b6d40 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 10 client.16956 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 20 client.16956 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a2136190 0x5612a21385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 4 client.16956 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5612a2018d00 con 0x5612a2136190 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.529+0000 7f44c94e0640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a2136190 0x5612a21385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.530+0000 7f44acff9640 10 client.16956 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.530+0000 7f44c94e0640 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a2136190 0x5612a21385b0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f21b7b340f9c74 server_cookie=8b2f849a0c997cd4 in_seq=0 out_seq=0 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44acff9640 1 -- 172.21.15.22:0/3192781796 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5612a2018d00 con 0x5612a2136190 2024-09-11T22:38:11.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44acff9640 10 client.16956 handle_command_reply: tid=0 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 client.16956 shutdown 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 msgr2=0x5612a20b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f44bc012a40 tx=0x7f44bc009fd0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 shutdown_connections 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x5612a2136190 0x5612a21385b0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5612a20b6d40 0x5612a20b7ba0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a20ac480 0x5612a20b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 --2- 172.21.15.22:0/3192781796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612a20abb60 0x5612a20b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44acff9640 0 client.16956 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 >> 172.21.15.22:0/3192781796 conn(0x5612a20a80f0 msgr2=0x5612a20ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 shutdown_connections 2024-09-11T22:38:11.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 1 -- 172.21.15.22:0/3192781796 wait complete. 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "51341f9a-758e-4090-81f6-4d758f377b87", 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:11.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.531+0000 7f44cdb1d740 20 client.16956 trim_cache size 0 max 16384 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 msgr2=0x7f44b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 0x7f44b00a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44bc005c40 tx=0x7f44bc009d50 comp rx=0 tx=0).stop 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 msgr2=0x7f44c4198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f44b400d740 tx=0x7f44b400dc00 comp rx=0 tx=0).stop 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 shutdown_connections 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f44b00a2cf0 0x7f44b00a51b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44c410c170 0x7f44c419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44c4103660 0x7f44c4198a50 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 --2- 172.21.15.22:0/2147918505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44c4102d40 0x7f44c4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:11.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 >> 172.21.15.22:0/2147918505 conn(0x7f44c40fc7a0 msgr2=0x7f44c40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:11.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 shutdown_connections 2024-09-11T22:38:11.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:11.532+0000 7f44cb744640 1 -- 172.21.15.22:0/2147918505 wait complete. 2024-09-11T22:38:11.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:11 smithi022 ceph-mon[30966]: pgmap v283: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:11.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:11 smithi169 ceph-mon[35628]: pgmap v283: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:11.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:11 smithi045 ceph-mon[35556]: pgmap v283: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:12.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:38:12.695 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:12.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:12 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:38:12.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:12 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:12.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:12 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:38:12.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:12 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:12.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:12 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:38:12.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:12 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:12.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:12 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:38:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:12 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:12.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:12 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:38:12.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:12 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:12.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:12 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:38:12.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:12 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:13.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 -- 172.21.15.22:0/248549608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298102790 msgr2=0x7fe2981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 --2- 172.21.15.22:0/248549608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298102790 0x7fe2981067e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009900 tx=0x7fe28c02a410 comp rx=0 tx=0).stop 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 -- 172.21.15.22:0/248549608 shutdown_connections 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 --2- 172.21.15.22:0/248549608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298106f10 0x7fe29810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 --2- 172.21.15.22:0/248549608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298102790 0x7fe2981067e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 --2- 172.21.15.22:0/248549608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298101de0 0x7fe2981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 -- 172.21.15.22:0/248549608 >> 172.21.15.22:0/248549608 conn(0x7fe2980fd8c0 msgr2=0x7fe2980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.145+0000 7fe29e03e640 1 -- 172.21.15.22:0/248549608 shutdown_connections 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.146+0000 7fe29e03e640 1 -- 172.21.15.22:0/248549608 wait complete. 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.146+0000 7fe29e03e640 1 Processor -- start 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.146+0000 7fe29e03e640 1 -- start start 2024-09-11T22:38:13.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 0x7fe298198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298102790 0x7fe298198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe298112090 con 0x7fe298106f10 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe298111f10 con 0x7fe298102790 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe29e03e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe298112210 con 0x7fe298101de0 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55488/0 (socket says 172.21.15.22:55488) 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 -- 172.21.15.22:0/2363643503 learned_addr learned my addr 172.21.15.22:0/2363643503 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe296ffd640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298102790 0x7fe298198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe2977fe640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 0x7fe298198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 -- 172.21.15.22:0/2363643503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 msgr2=0x7fe298198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 0x7fe298198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 -- 172.21.15.22:0/2363643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298102790 msgr2=0x7fe298198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298102790 0x7fe298198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 -- 172.21.15.22:0/2363643503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29819d520 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe2977fe640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 0x7fe298198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe297fff640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe29000cad0 tx=0x7fe29000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe294ff9640 1 -- 172.21.15.22:0/2363643503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000ae20 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe294ff9640 1 -- 172.21.15.22:0/2363643503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe290004b20 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.147+0000 7fe294ff9640 1 -- 172.21.15.22:0/2363643503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000f780 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.148+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29819d810 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.148+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2981a50f0 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe294ff9640 1 -- 172.21.15.22:0/2363643503 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe290004cd0 con 0x7fe298106f10 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 Processor -- start 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 -- start start 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce81c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce81c680 0x563dce81ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563dce7772e0 con 0x563dce8114a0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563dce71ece0 con 0x563dce811dc0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe2a0417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563dce7732a0 con 0x563dce81c680 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe294ff9640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 0x7fe2800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.150+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55504/0 (socket says 172.21.15.22:55504) 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 -- 172.21.15.22:0/2460668184 learned_addr learned my addr 172.21.15.22:0/2460668184 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe297fff640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 0x7fe2800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe2977fe640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce81c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce81c680 0x563dce81ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe294ff9640 1 -- 172.21.15.22:0/2363643503 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7fe2900cf3e0 con 0x7fe298106f10 2024-09-11T22:38:13.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 -- 172.21.15.22:0/2460668184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce81c680 msgr2=0x563dce81ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce81c680 0x563dce81ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 -- 172.21.15.22:0/2460668184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 msgr2=0x563dce81c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce81c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 -- 172.21.15.22:0/2460668184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dce703440 con 0x563dce8114a0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe2977fe640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce81c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe296ffd640 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe28c02a930 tx=0x7fe28c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5710477c80a326 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe297fff640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 0x7fe2800a5230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe290097d60 tx=0x7fe290086040 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe27dffb640 1 -- 172.21.15.22:0/2460668184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035040 con 0x563dce8114a0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe27dffb640 1 -- 172.21.15.22:0/2460668184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe28c005520 con 0x563dce8114a0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.151+0000 7fe27dffb640 1 -- 172.21.15.22:0/2460668184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c004d90 con 0x563dce8114a0 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- 172.21.15.22:0/2460668184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 msgr2=0x563dce811880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe28c02a930 tx=0x7fe28c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- 172.21.15.22:0/2460668184 shutdown_connections 2024-09-11T22:38:13.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce81c680 0x563dce81ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce81c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 --2- 172.21.15.22:0/2460668184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce8114a0 0x563dce811880 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- 172.21.15.22:0/2460668184 >> 172.21.15.22:0/2460668184 conn(0x563dce80da30 msgr2=0x563dce80de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- 172.21.15.22:0/2460668184 shutdown_connections 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- 172.21.15.22:0/2460668184 wait complete. 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.152+0000 7fe2a0417740 1 -- start start 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 Processor -- start 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce81beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce819160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563dce81f1f0 con 0x563dce81c680 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563dce732050 con 0x563dce811dc0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563dce81f370 con 0x563dce8114a0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2a0417740 10 client.0 _ll_register_callbacks cb 0x563dce772160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55512/0 (socket says 172.21.15.22:55512) 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 -- 172.21.15.22:0/255460301 learned_addr learned my addr 172.21.15.22:0/255460301 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe2977fe640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce819160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce81beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 -- 172.21.15.22:0/255460301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 msgr2=0x563dce81beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.153+0000 7fe296ffd640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce81beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe296ffd640 1 -- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 msgr2=0x563dce819160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe296ffd640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce819160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe296ffd640 1 -- 172.21.15.22:0/255460301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dce4e83c0 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2977fe640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce819160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe296ffd640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009900 tx=0x7fe28c004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfb9baa2164a4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035040 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28c005520 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7fe28c004fd0 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe28c0051d0 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 10 client.16968 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563dce82aaa0 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe28c005520 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe28c053570 con 0x563dce81c680 2024-09-11T22:38:13.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 10 client.16968 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.154+0000 7fe2a0417740 20 client.16968 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce82bdf0 0x563dce82e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe2a0417740 4 client.16968 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dce784850 con 0x563dce82bdf0 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe2977fe640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce82bdf0 0x563dce82e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe276ffd640 10 client.16968 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.155+0000 7fe2977fe640 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce82bdf0 0x563dce82e1e0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef63c3cb400b415e server_cookie=6e2318d84bddb14d in_seq=0 out_seq=0 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe276ffd640 1 -- 172.21.15.22:0/255460301 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563dce784850 con 0x563dce82bdf0 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe276ffd640 10 client.16968 handle_command_reply: tid=0 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 client.16968 shutdown 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 msgr2=0x563dce8196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009900 tx=0x7fe28c004970 comp rx=0 tx=0).stop 2024-09-11T22:38:13.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 shutdown_connections 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce82bdf0 0x563dce82e1e0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce8196a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce819160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe276ffd640 0 client.16968 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 --2- 172.21.15.22:0/255460301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce81beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 >> 172.21.15.22:0/255460301 conn(0x563dce80da30 msgr2=0x563dce813760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.156+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 shutdown_connections 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.157+0000 7fe2a0417740 1 -- 172.21.15.22:0/255460301 wait complete. 2024-09-11T22:38:13.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.157+0000 7fe2a0417740 20 client.16968 trim_cache size 0 max 16384 2024-09-11T22:38:13.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 Processor -- start 2024-09-11T22:38:13.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 -- start start 2024-09-11T22:38:13.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce8163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce81c680 0x563dce80c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981a97a0 con 0x563dce811dc0 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981abfd0 con 0x563dce81c680 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2a0417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981a9e10 con 0x563dce8114a0 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55520/0 (socket says 172.21.15.22:55520) 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 -- 172.21.15.22:0/3294099310 learned_addr learned my addr 172.21.15.22:0/3294099310 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 -- 172.21.15.22:0/3294099310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 msgr2=0x563dce8163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe296ffd640 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce8163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce8163e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 -- 172.21.15.22:0/3294099310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce81c680 msgr2=0x563dce80c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce81c680 0x563dce80c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 -- 172.21.15.22:0/3294099310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dce80d860 con 0x563dce811dc0 2024-09-11T22:38:13.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe296ffd640 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce8163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.174+0000 7fe2977fe640 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe28800be20 tx=0x7fe288005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de48019919bbc6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe27d7fa640 1 -- 172.21.15.22:0/3294099310 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288014c90 con 0x563dce811dc0 2024-09-11T22:38:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe27d7fa640 1 -- 172.21.15.22:0/3294099310 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe288014e30 con 0x563dce811dc0 2024-09-11T22:38:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe27d7fa640 1 -- 172.21.15.22:0/3294099310 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2880053b0 con 0x563dce811dc0 2024-09-11T22:38:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 -- 172.21.15.22:0/3294099310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 msgr2=0x563dce816920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe28800be20 tx=0x7fe288005850 comp rx=0 tx=0).stop 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 -- 172.21.15.22:0/3294099310 shutdown_connections 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce81c680 0x563dce80c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce811dc0 0x563dce816920 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 --2- 172.21.15.22:0/3294099310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce8163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 -- 172.21.15.22:0/3294099310 >> 172.21.15.22:0/3294099310 conn(0x563dce80da30 msgr2=0x563dce818250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 -- 172.21.15.22:0/3294099310 shutdown_connections 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.175+0000 7fe2a0417740 1 -- 172.21.15.22:0/3294099310 wait complete. 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 -- start start 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 Processor -- start 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce830f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce831440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981aa490 con 0x563dce81c680 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981ab900 con 0x563dce811dc0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981aab60 con 0x563dce8114a0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe2a0417740 10 client.0 _ll_register_callbacks cb 0x7fe28c031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55530/0 (socket says 172.21.15.22:55530) 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe296ffd640 1 -- 172.21.15.22:0/1184833524 learned_addr learned my addr 172.21.15.22:0/1184833524 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.176+0000 7fe296ffd640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce830f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe2977fe640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce831440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 -- 172.21.15.22:0/1184833524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 msgr2=0x563dce830f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce830f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 -- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 msgr2=0x563dce831440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:13.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce831440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 -- 172.21.15.22:0/1184833524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dce80e6c0 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe296ffd640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe28c02a450 tx=0x7fe28c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e559e38d4b8b14f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c035070 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8528+0+0 (secure 0 0 0) 0x7fe28c005370 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe288014e30 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe28c053db0 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe2a0417740 10 client.16974 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563dce896530 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.177+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe288014e30 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7fe28c043a70 con 0x563dce81c680 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 10 client.16974 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:13.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 20 client.16974 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce896c80 0x563dce8990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 4 client.16974 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563dce77ed60 con 0x563dce896c80 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2977fe640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce896c80 0x563dce8990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe276ffd640 10 client.16974 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.178+0000 7fe2977fe640 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce896c80 0x563dce8990a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77b9834789cf4c38 server_cookie=e838932813abc1e6 in_seq=0 out_seq=0 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe276ffd640 1 -- 172.21.15.22:0/1184833524 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563dce77ed60 con 0x563dce896c80 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe276ffd640 10 client.16974 handle_command_reply: tid=0 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 client.16974 shutdown 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 msgr2=0x563dce88dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe28c02a450 tx=0x7fe28c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 shutdown_connections 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x563dce896c80 0x563dce8990a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563dce81c680 0x563dce88dbc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe276ffd640 0 client.16974 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563dce811dc0 0x563dce831440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 --2- 172.21.15.22:0/1184833524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563dce8114a0 0x563dce830f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 >> 172.21.15.22:0/1184833524 conn(0x563dce80da30 msgr2=0x563dce81a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 shutdown_connections 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 1 -- 172.21.15.22:0/1184833524 wait complete. 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.179+0000 7fe2a0417740 20 client.16974 trim_cache size 0 max 16384 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:38:13.185 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: "51341f9a-758e-4090-81f6-4d758f377b87": { 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "51341f9a-758e-4090-81f6-4d758f377b87", 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:13.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 msgr2=0x7fe2800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 0x7fe2800a5230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe290097d60 tx=0x7fe290086040 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 msgr2=0x7fe29819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe29000cad0 tx=0x7fe29000cf90 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 shutdown_connections 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fe2800a2d70 0x7fe2800a5230 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe298106f10 0x7fe29819ce40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe298102790 0x7fe298198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 --2- 172.21.15.22:0/2363643503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe298101de0 0x7fe298198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 >> 172.21.15.22:0/2363643503 conn(0x7fe2980fd8c0 msgr2=0x7fe2980febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 shutdown_connections 2024-09-11T22:38:13.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:13.180+0000 7fe29e03e640 1 -- 172.21.15.22:0/2363643503 wait complete. 2024-09-11T22:38:13.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:13 smithi022 ceph-mon[30966]: pgmap v284: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:13 smithi169 ceph-mon[35628]: pgmap v284: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:13.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:13 smithi045 ceph-mon[35556]: pgmap v284: 97 pgs: 97 active+clean; 11 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T22:38:14.081 INFO:tasks.cephfs.filesystem:scrub status for tag:51341f9a-758e-4090-81f6-4d758f377b87 - {'path': '/', 'tag': '51341f9a-758e-4090-81f6-4d758f377b87', 'options': 'recursive,force'} 2024-09-11T22:38:14.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:14 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:38:14.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:14 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:38:14.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:14 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:38:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:15 smithi022 ceph-mon[30966]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:15 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:15 smithi169 ceph-mon[35628]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:15 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:15 smithi045 ceph-mon[35556]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:15 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:16 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:16 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:16.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:16 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:38:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:16 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:16 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:16.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:16 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:38:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:16 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:16 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:16 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:38:18.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:17 smithi022 ceph-mon[30966]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:18.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:17 smithi169 ceph-mon[35628]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:18.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:17 smithi045 ceph-mon[35556]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-11T22:38:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:19 smithi022 ceph-mon[30966]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:38:19.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:19 smithi022 ceph-mon[30966]: pgmap v288: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 230 B/s wr, 4 op/s 2024-09-11T22:38:19.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:19 smithi169 ceph-mon[35628]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:38:19.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:19 smithi169 ceph-mon[35628]: pgmap v288: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 230 B/s wr, 4 op/s 2024-09-11T22:38:19.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:19 smithi045 ceph-mon[35556]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:38:19.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:19 smithi045 ceph-mon[35556]: pgmap v288: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 230 B/s wr, 4 op/s 2024-09-11T22:38:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:21 smithi022 ceph-mon[30966]: pgmap v289: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:21.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:21 smithi169 ceph-mon[35628]: pgmap v289: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:21 smithi045 ceph-mon[35556]: pgmap v289: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:23.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:23 smithi022 ceph-mon[30966]: pgmap v290: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:23.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:23 smithi169 ceph-mon[35628]: pgmap v290: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:23 smithi045 ceph-mon[35556]: pgmap v290: 97 pgs: 97 active+clean; 5.5 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-11T22:38:25.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:25 smithi022 ceph-mon[30966]: pgmap v291: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:25.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:25 smithi169 ceph-mon[35628]: pgmap v291: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:25 smithi045 ceph-mon[35556]: pgmap v291: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:27.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:27 smithi022 ceph-mon[30966]: pgmap v292: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:27.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:27 smithi169 ceph-mon[35628]: pgmap v292: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:27 smithi045 ceph-mon[35556]: pgmap v292: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:38:29.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:29 smithi022 ceph-mon[30966]: pgmap v293: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:38:29.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:29 smithi169 ceph-mon[35628]: pgmap v293: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:38:29.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:29 smithi045 ceph-mon[35556]: pgmap v293: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:38:31.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:31 smithi022 ceph-mon[30966]: pgmap v294: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:31 smithi169 ceph-mon[35628]: pgmap v294: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:31 smithi045 ceph-mon[35556]: pgmap v294: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:33.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:33 smithi022 ceph-mon[30966]: pgmap v295: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:33 smithi169 ceph-mon[35628]: pgmap v295: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:33 smithi045 ceph-mon[35556]: pgmap v295: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:35.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:35 smithi022 ceph-mon[30966]: pgmap v296: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:35 smithi169 ceph-mon[35628]: pgmap v296: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:35 smithi045 ceph-mon[35556]: pgmap v296: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:37.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:37 smithi169 ceph-mon[35628]: pgmap v297: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:37.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:37 smithi022 ceph-mon[30966]: pgmap v297: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:37.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:37 smithi045 ceph-mon[35556]: pgmap v297: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:39 smithi022 ceph-mon[30966]: pgmap v298: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:39 smithi169 ceph-mon[35628]: pgmap v298: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:39 smithi045 ceph-mon[35556]: pgmap v298: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:41.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:41 smithi022 ceph-mon[30966]: pgmap v299: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:41.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:41 smithi169 ceph-mon[35628]: pgmap v299: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:41.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:41 smithi045 ceph-mon[35556]: pgmap v299: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:43 smithi022 ceph-mon[30966]: pgmap v300: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:43.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:43 smithi169 ceph-mon[35628]: pgmap v300: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:43 smithi045 ceph-mon[35556]: pgmap v300: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:44.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:38:44.358 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:44.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 -- 172.21.15.22:0/1737378997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102570 msgr2=0x7f7c781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 --2- 172.21.15.22:0/1737378997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102570 0x7f7c781029b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009900 tx=0x7f7c6002a480 comp rx=0 tx=0).stop 2024-09-11T22:38:44.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 -- 172.21.15.22:0/1737378997 shutdown_connections 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 --2- 172.21.15.22:0/1737378997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102ef0 0x7f7c7810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 --2- 172.21.15.22:0/1737378997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102570 0x7f7c781029b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 --2- 172.21.15.22:0/1737378997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 -- 172.21.15.22:0/1737378997 >> 172.21.15.22:0/1737378997 conn(0x7f7c780fc7d0 msgr2=0x7f7c780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 -- 172.21.15.22:0/1737378997 shutdown_connections 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.854+0000 7f7c7e128640 1 -- 172.21.15.22:0/1737378997 wait complete. 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 Processor -- start 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 -- start start 2024-09-11T22:38:44.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102570 0x7f7c78198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781110e0 con 0x7f7c78102ef0 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78110f60 con 0x7f7c78100e20 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.855+0000 7f7c7e128640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78111260 con 0x7f7c78102570 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51722/0 (socket says 172.21.15.22:51722) 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 -- 172.21.15.22:0/101926758 learned_addr learned my addr 172.21.15.22:0/101926758 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c6effd640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102570 0x7f7c78198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c777fe640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 -- 172.21.15.22:0/101926758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102570 msgr2=0x7f7c78198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102570 0x7f7c78198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 -- 172.21.15.22:0/101926758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 msgr2=0x7f7c78198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 -- 172.21.15.22:0/101926758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7819d5c0 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c777fe640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c77fff640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b970 tx=0x7f7c7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c757fa640 1 -- 172.21.15.22:0/101926758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70019070 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7819d8b0 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c757fa640 1 -- 172.21.15.22:0/101926758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c7000cb40 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c757fa640 1 -- 172.21.15.22:0/101926758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70007700 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.856+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781a5190 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.859+0000 7f7c757fa640 1 -- 172.21.15.22:0/101926758 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7c7001c070 con 0x7f7c78102ef0 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.859+0000 7f7c80501740 1 Processor -- start 2024-09-11T22:38:44.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.859+0000 7f7c80501740 1 -- start start 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.859+0000 7f7c80501740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.859+0000 7f7c80501740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 0x55a0d34eb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c80501740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34eb680 0x55a0d34eda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c80501740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a0d34462e0 con 0x55a0d34e04a0 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c80501740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a0d33edce0 con 0x55a0d34eb680 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c80501740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a0d34422a0 con 0x55a0d34e0dc0 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51738/0 (socket says 172.21.15.22:51738) 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 -- 172.21.15.22:0/2104753567 learned_addr learned my addr 172.21.15.22:0/2104753567 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 0x55a0d34eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34eb680 0x55a0d34eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 -- 172.21.15.22:0/2104753567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 msgr2=0x55a0d34eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 0x55a0d34eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 -- 172.21.15.22:0/2104753567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34eb680 msgr2=0x55a0d34eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34eb680 0x55a0d34eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c6effd640 1 -- 172.21.15.22:0/2104753567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d33d2440 con 0x55a0d34e04a0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 0x55a0d34eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c757fa640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 0x7f7c640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c777fe640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 0x7f7c640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.860+0000 7f7c757fa640 1 -- 172.21.15.22:0/101926758 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f7c700ce9e0 con 0x7f7c78102ef0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.861+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005ab0 tx=0x7f7c600058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8251b3667a6da059 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.861+0000 7f7c6dffb640 1 -- 172.21.15.22:0/2104753567 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60043020 con 0x55a0d34e04a0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.861+0000 7f7c6dffb640 1 -- 172.21.15.22:0/2104753567 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c60005520 con 0x55a0d34e04a0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.861+0000 7f7c6dffb640 1 -- 172.21.15.22:0/2104753567 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60035050 con 0x55a0d34e04a0 2024-09-11T22:38:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- 172.21.15.22:0/2104753567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 msgr2=0x55a0d34e0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c777fe640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 0x7f7c640a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a0d34dd890 tx=0x7f7c680084c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005ab0 tx=0x7f7c600058b0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- 172.21.15.22:0/2104753567 shutdown_connections 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34eb680 0x55a0d34eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e0dc0 0x55a0d34eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 --2- 172.21.15.22:0/2104753567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34e0880 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- 172.21.15.22:0/2104753567 >> 172.21.15.22:0/2104753567 conn(0x55a0d34dca30 msgr2=0x55a0d34dce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- 172.21.15.22:0/2104753567 shutdown_connections 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- 172.21.15.22:0/2104753567 wait complete. 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 -- start start 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.862+0000 7f7c80501740 1 Processor -- start 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34e8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34eb680 0x55a0d34e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a0d34f2570 con 0x55a0d34e04a0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a0d3401050 con 0x55a0d34e0dc0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a0d34f26f0 con 0x55a0d34eb680 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c80501740 10 client.0 _ll_register_callbacks cb 0x55a0d3441160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51752/0 (socket says 172.21.15.22:51752) 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 -- 172.21.15.22:0/273579952 learned_addr learned my addr 172.21.15.22:0/273579952 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c6effd640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c77fff640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34eb680 0x55a0d34e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 -- 172.21.15.22:0/273579952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34eb680 msgr2=0x55a0d34e8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34eb680 0x55a0d34e8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 -- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 msgr2=0x55a0d34e8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34e8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 -- 172.21.15.22:0/273579952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d31b73c0 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c777fe640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f7c6801ce00 tx=0x7f7c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbde3509836305bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.863+0000 7f7c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6801ce30 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f7c68004020 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c60005520 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7c68004220 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 10 client.16986 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a0d34fe070 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c60005520 con 0x55a0d34e04a0 2024-09-11T22:38:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7c6802b020 con 0x55a0d34e04a0 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 10 client.16986 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 20 client.16986 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d35019f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 4 client.16986 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.864+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0d3453850 con 0x55a0d34ff580 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.865+0000 7f7c6effd640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d35019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.865+0000 7f7c56ffd640 10 client.16986 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.865+0000 7f7c6effd640 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d35019f0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba1489fe4ca326d server_cookie=cfd57c665261cece in_seq=0 out_seq=0 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c56ffd640 1 -- 172.21.15.22:0/273579952 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0d3453850 con 0x55a0d34ff580 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c56ffd640 10 client.16986 handle_command_reply: tid=0 2024-09-11T22:38:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 client.16986 shutdown 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 msgr2=0x55a0d34eb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f7c6801ce00 tx=0x7f7c680046c0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 shutdown_connections 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d35019f0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34eb680 0x55a0d34e8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c56ffd640 0 client.16986 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34e8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 --2- 172.21.15.22:0/273579952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34e04a0 0x55a0d34eb0b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 >> 172.21.15.22:0/273579952 conn(0x55a0d34dca30 msgr2=0x55a0d34e2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 shutdown_connections 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 1 -- 172.21.15.22:0/273579952 wait complete. 2024-09-11T22:38:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.866+0000 7f7c80501740 20 client.16986 trim_cache size 0 max 16384 2024-09-11T22:38:44.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 Processor -- start 2024-09-11T22:38:44.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 -- start start 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d35072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3507800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781a95e0 con 0x55a0d34eb680 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781abe40 con 0x55a0d34e0dc0 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c80501740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781a9c30 con 0x55a0d34e04a0 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3507800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.22:60574/0 (socket says 172.21.15.22:60574) 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c777fe640 1 -- 172.21.15.22:0/2718394501 learned_addr learned my addr 172.21.15.22:0/2718394501 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.885+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d35072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 -- 172.21.15.22:0/2718394501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 msgr2=0x55a0d35072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d35072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 -- 172.21.15.22:0/2718394501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 msgr2=0x55a0d3507800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3507800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 -- 172.21.15.22:0/2718394501 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d34ddae0 con 0x55a0d34e04a0 2024-09-11T22:38:44.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c68016040 tx=0x7f7c6801ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d848523786fd98e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c6d7fa640 1 -- 172.21.15.22:0/2718394501 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6801a800 con 0x55a0d34e04a0 2024-09-11T22:38:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c6d7fa640 1 -- 172.21.15.22:0/2718394501 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c68005040 con 0x55a0d34e04a0 2024-09-11T22:38:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.886+0000 7f7c6d7fa640 1 -- 172.21.15.22:0/2718394501 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68004970 con 0x55a0d34e04a0 2024-09-11T22:38:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 -- 172.21.15.22:0/2718394501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 msgr2=0x55a0d34e7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c68016040 tx=0x7f7c6801ca60 comp rx=0 tx=0).stop 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 -- 172.21.15.22:0/2718394501 shutdown_connections 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3507800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d35072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 --2- 172.21.15.22:0/2718394501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34e7c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 -- 172.21.15.22:0/2718394501 >> 172.21.15.22:0/2718394501 conn(0x55a0d34dca30 msgr2=0x55a0d34e2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 -- 172.21.15.22:0/2718394501 shutdown_connections 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.887+0000 7f7c80501740 1 -- 172.21.15.22:0/2718394501 wait complete. 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.888+0000 7f7c80501740 1 -- start start 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.888+0000 7f7c80501740 1 Processor -- start 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.888+0000 7f7c80501740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.888+0000 7f7c80501740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c80501740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3569290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c80501740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781aa300 con 0x55a0d34eb680 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c80501740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781ab770 con 0x55a0d34e0dc0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c80501740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781aa9d0 con 0x55a0d34e04a0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c80501740 10 client.0 _ll_register_callbacks cb 0x7f7c68008880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c6effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c6effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:49350/0 (socket says 172.21.15.22:49350) 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c6effd640 1 -- 172.21.15.22:0/2679371641 learned_addr learned my addr 172.21.15.22:0/2679371641 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3569290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 -- 172.21.15.22:0/2679371641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 msgr2=0x55a0d34f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 -- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 msgr2=0x55a0d34f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:44.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 -- 172.21.15.22:0/2679371641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d34dd6c0 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c6effd640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c77fff640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3569290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7c700cc200 tx=0x7f7c70004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab14100238006340 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.889+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c700a3c40 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c68005040 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f7c70097640 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7c700cc370 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 10 client.16992 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a0d356a920 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c68005040 con 0x55a0d34eb680 2024-09-11T22:38:44.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f7c70095cd0 con 0x55a0d34eb680 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 10 client.16992 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 20 client.16992 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d356d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 4 client.16992 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0d344dd60 con 0x55a0d34ff580 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.890+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d356d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c777fe640 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d356d000 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e2b5230c3c6e6 server_cookie=b9718a4ab4992617 in_seq=0 out_seq=0 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c56ffd640 10 client.16992 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c56ffd640 1 -- 172.21.15.22:0/2679371641 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a0d344dd60 con 0x55a0d34ff580 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c56ffd640 10 client.16992 handle_command_reply: tid=0 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 client.16992 shutdown 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 msgr2=0x55a0d3569290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3569290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7c700cc200 tx=0x7f7c70004b50 comp rx=0 tx=0).stop 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 shutdown_connections 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55a0d34ff580 0x55a0d356d000 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a0d34eb680 0x55a0d3569290 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a0d34e0dc0 0x55a0d34f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 --2- 172.21.15.22:0/2679371641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a0d34e04a0 0x55a0d34f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 >> 172.21.15.22:0/2679371641 conn(0x55a0d34dca30 msgr2=0x55a0d34e1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.891+0000 7f7c56ffd640 0 client.16992 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 shutdown_connections 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c80501740 1 -- 172.21.15.22:0/2679371641 wait complete. 2024-09-11T22:38:44.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c80501740 20 client.16992 trim_cache size 0 max 16384 2024-09-11T22:38:44.899 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:38:44.899 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:38:44.899 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 msgr2=0x7f7c640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 0x7f7c640a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a0d34dd890 tx=0x7f7c680084c0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 msgr2=0x7f7c7819cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b970 tx=0x7f7c7000be30 comp rx=0 tx=0).stop 2024-09-11T22:38:44.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 shutdown_connections 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7c640a2cf0 0x7f7c640a51b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78102ef0 0x7f7c7819cee0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c78102570 0x7f7c78198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 --2- 172.21.15.22:0/101926758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c78100e20 0x7f7c78198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 >> 172.21.15.22:0/101926758 conn(0x7f7c780fc7d0 msgr2=0x7f7c7806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 shutdown_connections 2024-09-11T22:38:44.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:44.892+0000 7f7c7e128640 1 -- 172.21.15.22:0/101926758 wait complete. 2024-09-11T22:38:45.728 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:38:45.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:38:45.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:45 smithi022 ceph-mon[30966]: pgmap v301: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:45 smithi169 ceph-mon[35628]: pgmap v301: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:45.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:45 smithi045 ceph-mon[35556]: pgmap v301: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 -- 172.21.15.22:0/3410837080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0101de0 msgr2=0x7f4ae01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/3410837080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0101de0 0x7f4ae01021c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009900 tx=0x7f4adc02a410 comp rx=0 tx=0).stop 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 -- 172.21.15.22:0/3410837080 shutdown_connections 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/3410837080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 0x7f4ae010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/3410837080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0102790 0x7f4ae01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/3410837080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0101de0 0x7f4ae01021c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 -- 172.21.15.22:0/3410837080 >> 172.21.15.22:0/3410837080 conn(0x7f4ae00fd8c0 msgr2=0x7f4ae00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 -- 172.21.15.22:0/3410837080 shutdown_connections 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.466+0000 7f4ae80f3640 1 -- 172.21.15.22:0/3410837080 wait complete. 2024-09-11T22:38:46.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 Processor -- start 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 -- start start 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 0x7f4ae019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 0x7f4ae019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0112050 con 0x7f4ae0102790 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0111ed0 con 0x7f4ae0106f10 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae80f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01121d0 con 0x7f4ae0101de0 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae568e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae568e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51774/0 (socket says 172.21.15.22:51774) 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.467+0000 7f4ae568e640 1 -- 172.21.15.22:0/4140976303 learned_addr learned my addr 172.21.15.22:0/4140976303 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae5e8f640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 0x7f4ae019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae6690640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 0x7f4ae019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:46.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 -- 172.21.15.22:0/4140976303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 msgr2=0x7f4ae019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 0x7f4ae019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 -- 172.21.15.22:0/4140976303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 msgr2=0x7f4ae019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 0x7f4ae019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 -- 172.21.15.22:0/4140976303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae019f700 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae5e8f640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 0x7f4ae019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae568e640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000d950 tx=0x7f4ad000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0017070 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ad0009c30 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae019f9f0 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000f740 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.468+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae01a72d0 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.469+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae01021c0 con 0x7f4ae0102790 2024-09-11T22:38:46.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.470+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4ad0010a80 con 0x7f4ae0102790 2024-09-11T22:38:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.471+0000 7f4ad6ffd640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.471+0000 7f4ae5e8f640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.471+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f4ad00cf150 con 0x7f4ae0102790 2024-09-11T22:38:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.472+0000 7f4ae5e8f640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc032c80 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:46.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.475+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ad0009de0 con 0x7f4ae0102790 2024-09-11T22:38:46.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.689+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ae01a7530 con 0x7f4ae0102790 2024-09-11T22:38:46.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.690+0000 7f4ad6ffd640 1 -- 172.21.15.22:0/4140976303 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f4ad009bd30 con 0x7f4ae0102790 2024-09-11T22:38:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:38:46.692 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:38:46.692 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 msgr2=0x7f4acc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4adc000c00 tx=0x7f4adc032c80 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 msgr2=0x7f4ae019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000d950 tx=0x7f4ad000de10 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 shutdown_connections 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae0106f10 0x7f4ae019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae0102790 0x7f4ae019ac90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 --2- 172.21.15.22:0/4140976303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ae0101de0 0x7f4ae019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:46.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 >> 172.21.15.22:0/4140976303 conn(0x7f4ae00fd8c0 msgr2=0x7f4ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:46.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 shutdown_connections 2024-09-11T22:38:46.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:46.692+0000 7f4ae80f3640 1 -- 172.21.15.22:0/4140976303 wait complete. 2024-09-11T22:38:47.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:38:47.635 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:47 smithi022 ceph-mon[30966]: pgmap v302: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:47.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:47 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4140976303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:47.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:47 smithi169 ceph-mon[35628]: pgmap v302: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:47.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:47 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4140976303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:47 smithi045 ceph-mon[35556]: pgmap v302: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:47 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4140976303' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:38:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- 172.21.15.22:0/2476709109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 msgr2=0x7f22bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 --2- 172.21.15.22:0/2476709109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc10ea90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009ca0 tx=0x7f22b402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- 172.21.15.22:0/2476709109 shutdown_connections 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 --2- 172.21.15.22:0/2476709109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc10ea90 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 --2- 172.21.15.22:0/2476709109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc102790 0x7f22bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 --2- 172.21.15.22:0/2476709109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc101de0 0x7f22bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- 172.21.15.22:0/2476709109 >> 172.21.15.22:0/2476709109 conn(0x7f22bc0fd8c0 msgr2=0x7f22bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- 172.21.15.22:0/2476709109 shutdown_connections 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- 172.21.15.22:0/2476709109 wait complete. 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 Processor -- start 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.135+0000 7f22c35ac640 1 -- start start 2024-09-11T22:38:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc101de0 0x7f22bc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc102790 0x7f22bc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1120d0 con 0x7f22bc106f10 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc111f50 con 0x7f22bc101de0 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c35ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc112250 con 0x7f22bc102790 2024-09-11T22:38:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51788/0 (socket says 172.21.15.22:51788) 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1348640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc101de0 0x7f22bc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 -- 172.21.15.22:0/3770308557 learned_addr learned my addr 172.21.15.22:0/3770308557 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c0b47640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc102790 0x7f22bc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 -- 172.21.15.22:0/3770308557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc102790 msgr2=0x7f22bc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc102790 0x7f22bc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 -- 172.21.15.22:0/3770308557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc101de0 msgr2=0x7f22bc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc101de0 0x7f22bc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 -- 172.21.15.22:0/3770308557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc19d400 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.136+0000 7f22c1b49640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009dc0 tx=0x7f22b4031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.137+0000 7f22b27fc640 1 -- 172.21.15.22:0/3770308557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b402fba0 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.137+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc19d690 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.137+0000 7f22b27fc640 1 -- 172.21.15.22:0/3770308557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22b402fd40 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.137+0000 7f22b27fc640 1 -- 172.21.15.22:0/3770308557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4046910 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.137+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc1a4fd0 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.139+0000 7f22b27fc640 1 -- 172.21.15.22:0/3770308557 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f22b4030c50 con 0x7f22bc106f10 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.139+0000 7f22c5985740 1 Processor -- start 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.139+0000 7f22c5985740 1 -- start start 2024-09-11T22:38:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a89a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a8a5370 0x56282a8a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56282a8002f0 con 0x56282a89a5d0 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56282a7a7cf0 con 0x56282a8a5370 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c5985740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56282a7fc2b0 con 0x56282a89bb40 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22b27fc640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 0x7f22a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51790/0 (socket says 172.21.15.22:51790) 2024-09-11T22:38:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 -- 172.21.15.22:0/439285231 learned_addr learned my addr 172.21.15.22:0/439285231 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c0b47640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a8a5370 0x56282a8a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1b49640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 0x7f22a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c0b47640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a89a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22b27fc640 1 -- 172.21.15.22:0/3770308557 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f22b40f0a50 con 0x7f22bc106f10 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 -- 172.21.15.22:0/439285231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 msgr2=0x56282a89a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a89a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 -- 172.21.15.22:0/439285231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a8a5370 msgr2=0x56282a8a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a8a5370 0x56282a8a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 -- 172.21.15.22:0/439285231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a78c3a0 con 0x56282a89a5d0 2024-09-11T22:38:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c0b47640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a89a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.140+0000 7f22c1348640 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009a70 tx=0x7f22b8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a838e4afbdb350 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c1b49640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 0x7f22a80a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22b40ee7c0 tx=0x7f22b4087c20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22a77fe640 1 -- 172.21.15.22:0/439285231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8017070 con 0x56282a89a5d0 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22a77fe640 1 -- 172.21.15.22:0/439285231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22b8013470 con 0x56282a89a5d0 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22a77fe640 1 -- 172.21.15.22:0/439285231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8012630 con 0x56282a89a5d0 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 -- 172.21.15.22:0/439285231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 msgr2=0x56282a89aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009a70 tx=0x7f22b8009f30 comp rx=0 tx=0).stop 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 -- 172.21.15.22:0/439285231 shutdown_connections 2024-09-11T22:38:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a8a5370 0x56282a8a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89a5d0 0x56282a89aa10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 --2- 172.21.15.22:0/439285231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a89a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.141+0000 7f22c5985740 1 -- 172.21.15.22:0/439285231 >> 172.21.15.22:0/439285231 conn(0x56282a863310 msgr2=0x56282a896c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- 172.21.15.22:0/439285231 shutdown_connections 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- 172.21.15.22:0/439285231 wait complete. 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- start start 2024-09-11T22:38:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 Processor -- start 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a8a5370 0x56282a8a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56282a8a8070 con 0x56282a89bb40 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56282a7bb060 con 0x56282a89a5d0 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.142+0000 7f22c5985740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56282a8a81f0 con 0x56282a8a5370 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c5985740 10 client.0 _ll_register_callbacks cb 0x56282a50e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c0b47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51792/0 (socket says 172.21.15.22:51792) 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 -- 172.21.15.22:0/1609902517 learned_addr learned my addr 172.21.15.22:0/1609902517 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c0b47640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a8a5370 0x56282a8a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 -- 172.21.15.22:0/1609902517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a8a5370 msgr2=0x56282a8a2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a8a5370 0x56282a8a2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 -- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 msgr2=0x56282a8a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 -- 172.21.15.22:0/1609902517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282a5713c0 con 0x56282a89bb40 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c0b47640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c1348640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f22b800efb0 tx=0x7f22b8006e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbe1ec042b48707 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8017050 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b8013470 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.143+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f22b801c450 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f22b801c650 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 10 client.17010 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56282a8b3ac0 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22b8013470 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f22b8026a80 con 0x56282a89bb40 2024-09-11T22:38:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 10 client.17010 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 20 client.17010 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a8b4e10 0x56282a8b7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 4 client.17010 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56282a80d860 con 0x56282a8b4e10 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.144+0000 7f22c0b47640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a8b4e10 0x56282a8b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.145+0000 7f22c0b47640 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a8b4e10 0x56282a8b7200 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e21c05f7b34e7da server_cookie=2d720deb0017f8d8 in_seq=0 out_seq=0 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.145+0000 7f22a4ff9640 10 client.17010 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22a4ff9640 1 -- 172.21.15.22:0/1609902517 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56282a80d860 con 0x56282a8b4e10 2024-09-11T22:38:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22a4ff9640 10 client.17010 handle_command_reply: tid=0 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 client.17010 shutdown 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 msgr2=0x56282a8a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f22b800efb0 tx=0x7f22b8006e40 comp rx=0 tx=0).stop 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 shutdown_connections 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a8b4e10 0x56282a8b7200 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a8a5370 0x56282a8a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a89bb40 0x56282a8a1fd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 --2- 172.21.15.22:0/1609902517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 >> 172.21.15.22:0/1609902517 conn(0x56282a863310 msgr2=0x56282a89c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22a4ff9640 0 client.17010 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 shutdown_connections 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 1 -- 172.21.15.22:0/1609902517 wait complete. 2024-09-11T22:38:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.146+0000 7f22c5985740 20 client.17010 trim_cache size 0 max 16384 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.159+0000 7f22c5985740 1 Processor -- start 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.159+0000 7f22c5985740 1 -- start start 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a8b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ab7b0 con 0x56282a8a5370 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ae010 con 0x56282a89a5d0 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c5985740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1abe00 con 0x56282a89bb40 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51804/0 (socket says 172.21.15.22:51804) 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 -- 172.21.15.22:0/3278666423 learned_addr learned my addr 172.21.15.22:0/3278666423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c1348640 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a8b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 -- 172.21.15.22:0/3278666423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 msgr2=0x56282a8b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a8b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 -- 172.21.15.22:0/3278666423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 msgr2=0x56282a8b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 -- 172.21.15.22:0/3278666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a897cf0 con 0x56282a8a5370 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.160+0000 7f22c0b47640 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f22ac013c60 tx=0x7f22ac00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81247546fc8f8b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22a6ffd640 1 -- 172.21.15.22:0/3278666423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac005540 con 0x56282a8a5370 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22a6ffd640 1 -- 172.21.15.22:0/3278666423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22ac027040 con 0x56282a8a5370 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22a6ffd640 1 -- 172.21.15.22:0/3278666423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0227c0 con 0x56282a8a5370 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 -- 172.21.15.22:0/3278666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 msgr2=0x56282a8ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f22ac013c60 tx=0x7f22ac00eb30 comp rx=0 tx=0).stop 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 -- 172.21.15.22:0/3278666423 shutdown_connections 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a8ad860 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89bb40 0x56282a8b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 --2- 172.21.15.22:0/3278666423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89a5d0 0x56282a8b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 -- 172.21.15.22:0/3278666423 >> 172.21.15.22:0/3278666423 conn(0x56282a863310 msgr2=0x56282a8a10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 -- 172.21.15.22:0/3278666423 shutdown_connections 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.161+0000 7f22c5985740 1 -- 172.21.15.22:0/3278666423 wait complete. 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 -- start start 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 Processor -- start 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89a5d0 0x56282a8bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89bb40 0x56282a89f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ac4d0 con 0x56282a8a5370 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1ad940 con 0x56282a89bb40 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1acba0 con 0x56282a89a5d0 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c5985740 10 client.0 _ll_register_callbacks cb 0x7f22ac00e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c0b47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c0b47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51812/0 (socket says 172.21.15.22:51812) 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.162+0000 7f22c0b47640 1 -- 172.21.15.22:0/4028914534 learned_addr learned my addr 172.21.15.22:0/4028914534 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c1348640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89bb40 0x56282a89f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89a5d0 0x56282a8bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 -- 172.21.15.22:0/4028914534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89a5d0 msgr2=0x56282a8bd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89a5d0 0x56282a8bd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 -- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89bb40 msgr2=0x56282a89f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89bb40 0x56282a89f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 -- 172.21.15.22:0/4028914534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282a89ca00 con 0x56282a8a5370 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c0b47640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f22ac022540 tx=0x7f22ac00e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f262f746b52858a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac022bf0 con 0x56282a8a5370 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac027040 con 0x56282a8a5370 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f22ac0046c0 con 0x56282a8a5370 2024-09-11T22:38:48.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f22ac040050 con 0x56282a8a5370 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c5985740 10 client.17016 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56282a923a70 con 0x56282a8a5370 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.163+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22ac027040 con 0x56282a8a5370 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f22ac039060 con 0x56282a8a5370 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 10 client.17016 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 20 client.17016 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a924140 0x56282a926560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 4 client.17016 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56282a8b75f0 con 0x56282a924140 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.164+0000 7f22c1348640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a924140 0x56282a926560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c1348640 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a924140 0x56282a926560 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=146667354c6a8c8b server_cookie=3d131de9efd62596 in_seq=0 out_seq=0 2024-09-11T22:38:48.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22a4ff9640 10 client.17016 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22a4ff9640 1 -- 172.21.15.22:0/4028914534 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56282a8b75f0 con 0x56282a924140 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22a4ff9640 10 client.17016 handle_command_reply: tid=0 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 client.17016 shutdown 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 msgr2=0x56282a89fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f22ac022540 tx=0x7f22ac00e630 comp rx=0 tx=0).stop 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 shutdown_connections 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x56282a924140 0x56282a926560 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56282a8a5370 0x56282a89fa00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56282a89bb40 0x56282a89f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 --2- 172.21.15.22:0/4028914534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56282a89a5d0 0x56282a8bd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 >> 172.21.15.22:0/4028914534 conn(0x56282a863310 msgr2=0x56282a8a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22a4ff9640 0 client.17016 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:48.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 shutdown_connections 2024-09-11T22:38:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 1 -- 172.21.15.22:0/4028914534 wait complete. 2024-09-11T22:38:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.165+0000 7f22c5985740 20 client.17016 trim_cache size 0 max 16384 2024-09-11T22:38:48.180 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:38:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 msgr2=0x7f22a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 0x7f22a80a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22b40ee7c0 tx=0x7f22b4087c20 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 msgr2=0x7f22bc19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009dc0 tx=0x7f22b4031b10 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 shutdown_connections 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f22a80a2cf0 0x7f22a80a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc106f10 0x7f22bc19cd20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22bc102790 0x7f22bc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 --2- 172.21.15.22:0/3770308557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22bc101de0 0x7f22bc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 >> 172.21.15.22:0/3770308557 conn(0x7f22bc0fd8c0 msgr2=0x7f22bc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 shutdown_connections 2024-09-11T22:38:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:48.166+0000 7f22c35ac640 1 -- 172.21.15.22:0/3770308557 wait complete. 2024-09-11T22:38:49.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:49 smithi022 ceph-mon[30966]: pgmap v303: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:49.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:49 smithi169 ceph-mon[35628]: pgmap v303: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:49.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:49 smithi045 ceph-mon[35556]: pgmap v303: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:38:49.918 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T22:38:49.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T22:38:50.191 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:50.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 -- 172.21.15.22:0/2250403124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014102790 msgr2=0x7f40141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 --2- 172.21.15.22:0/2250403124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014102790 0x7f40141067e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4008009900 tx=0x7f400802a410 comp rx=0 tx=0).stop 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 -- 172.21.15.22:0/2250403124 shutdown_connections 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 --2- 172.21.15.22:0/2250403124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 0x7f401410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 --2- 172.21.15.22:0/2250403124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014102790 0x7f40141067e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 --2- 172.21.15.22:0/2250403124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014101de0 0x7f40141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 -- 172.21.15.22:0/2250403124 >> 172.21.15.22:0/2250403124 conn(0x7f40140fd8c0 msgr2=0x7f40140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 -- 172.21.15.22:0/2250403124 shutdown_connections 2024-09-11T22:38:50.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.669+0000 7f401a34c640 1 -- 172.21.15.22:0/2250403124 wait complete. 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 Processor -- start 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 -- start start 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 0x7f4014198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 0x7f401419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112090 con 0x7f4014101de0 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111f10 con 0x7f4014106f10 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f401a34c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112210 con 0x7f4014102790 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51824/0 (socket says 172.21.15.22:51824) 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f4013fff640 1 -- 172.21.15.22:0/669828814 learned_addr learned my addr 172.21.15.22:0/669828814 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.670+0000 7f40137fe640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 0x7f4014198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f40188e9640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 0x7f401419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 -- 172.21.15.22:0/669828814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 msgr2=0x7f4014198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 0x7f4014198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 -- 172.21.15.22:0/669828814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 msgr2=0x7f401419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 0x7f401419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 -- 172.21.15.22:0/669828814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401419d4c0 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f40137fe640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 0x7f4014198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f4013fff640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f400400d770 tx=0x7f400400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f40117fa640 1 -- 172.21.15.22:0/669828814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004017070 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f40117fa640 1 -- 172.21.15.22:0/669828814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4004005520 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401419d7b0 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f40117fa640 1 -- 172.21.15.22:0/669828814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004010460 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.671+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a5090 con 0x7f4014101de0 2024-09-11T22:38:50.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.674+0000 7f40117fa640 1 -- 172.21.15.22:0/669828814 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4004004ea0 con 0x7f4014101de0 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.674+0000 7f401c725740 1 Processor -- start 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.674+0000 7f401c725740 1 -- start start 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f8753f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875406130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f87535e280 con 0x55f8753f9480 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f875305b10 con 0x55f875403d40 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f401c725740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f87535a240 con 0x55f8753f8b60 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51828/0 (socket says 172.21.15.22:51828) 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 -- 172.21.15.22:0/2119315365 learned_addr learned my addr 172.21.15.22:0/2119315365 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40137fe640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875406130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40188e9640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f8753f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40117fa640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 0x7f3ffc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 -- 172.21.15.22:0/2119315365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 msgr2=0x55f8753f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f8753f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 -- 172.21.15.22:0/2119315365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 msgr2=0x55f875406130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875406130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 -- 172.21.15.22:0/2119315365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8753121f0 con 0x55f8753f9480 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40188e9640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f8753f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40188e9640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 0x7f3ffc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f40117fa640 1 -- 172.21.15.22:0/669828814 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f40040cf070 con 0x7f4014101de0 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.675+0000 7f4013fff640 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f400409b250 tx=0x7f400405b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c24ffe431a55b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f3ffa7fc640 1 -- 172.21.15.22:0/2119315365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004020070 con 0x55f8753f9480 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f3ffa7fc640 1 -- 172.21.15.22:0/2119315365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f400409bc50 con 0x55f8753f9480 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f40188e9640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 0x7f3ffc0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f400c008e00 tx=0x7f400c004a40 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f3ffa7fc640 1 -- 172.21.15.22:0/2119315365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400409f900 con 0x55f8753f9480 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 -- 172.21.15.22:0/2119315365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 msgr2=0x55f875403800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f400409b250 tx=0x7f400405b570 comp rx=0 tx=0).stop 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 -- 172.21.15.22:0/2119315365 shutdown_connections 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875406130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875403800 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 --2- 172.21.15.22:0/2119315365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f8753f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 -- 172.21.15.22:0/2119315365 >> 172.21.15.22:0/2119315365 conn(0x55f8753f50f0 msgr2=0x55f8753f54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.676+0000 7f401c725740 1 -- 172.21.15.22:0/2119315365 shutdown_connections 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 -- 172.21.15.22:0/2119315365 wait complete. 2024-09-11T22:38:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 -- start start 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 Processor -- start 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f875400bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875401650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f8754068b0 con 0x55f8753f9480 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f875318f10 con 0x55f875403d40 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f875406a30 con 0x55f8753f8b60 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f401c725740 10 client.0 _ll_register_callbacks cb 0x55f8752e1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f40137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f40137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51844/0 (socket says 172.21.15.22:51844) 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.677+0000 7f40137fe640 1 -- 172.21.15.22:0/1342681812 learned_addr learned my addr 172.21.15.22:0/1342681812 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40188e9640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875401650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f4013fff640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f875400bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 -- 172.21.15.22:0/1342681812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 msgr2=0x55f875400bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f875400bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 -- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 msgr2=0x55f875401650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875401650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 -- 172.21.15.22:0/1342681812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8750cf6a0 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f40137fe640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f400802a930 tx=0x7f4008031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c2aaf145c05ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f3ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008035040 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f4008004380 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400409bc50 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4008005030 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f401c725740 10 client.17028 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.678+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f875412460 con 0x55f8753f9480 2024-09-11T22:38:50.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f400409bc50 con 0x55f8753f9480 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f40080035f0 con 0x55f8753f9480 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 10 client.17028 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 10 client.17028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 20 client.17028 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f875413920 0x55f875415d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 4 client.17028 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f87536b7f0 con 0x55f875413920 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.679+0000 7f4013fff640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f875413920 0x55f875415d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f3ff37fe640 10 client.17028 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f4013fff640 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f875413920 0x55f875415d60 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c8373b4a252bc9 server_cookie=4e713a6f1da30825 in_seq=0 out_seq=0 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f3ff37fe640 1 -- 172.21.15.22:0/1342681812 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f87536b7f0 con 0x55f875413920 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f3ff37fe640 10 client.17028 handle_command_reply: tid=0 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 client.17028 shutdown 2024-09-11T22:38:50.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 msgr2=0x55f875401110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f400802a930 tx=0x7f4008031a80 comp rx=0 tx=0).stop 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 shutdown_connections 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f875413920 0x55f875415d60 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f875403d40 0x55f875401650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875401110 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f401c725740 1 --2- 172.21.15.22:0/1342681812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f8b60 0x55f875400bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.680+0000 7f3ff37fe640 0 client.17028 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.681+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 >> 172.21.15.22:0/1342681812 conn(0x55f8753f50f0 msgr2=0x55f8753f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.681+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 shutdown_connections 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.681+0000 7f401c725740 1 -- 172.21.15.22:0/1342681812 wait complete. 2024-09-11T22:38:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.681+0000 7f401c725740 20 client.17028 trim_cache size 0 max 16384 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 Processor -- start 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 -- start start 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875402df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 0x55f8754014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ab8e0 con 0x55f875403d40 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ae140 con 0x55f8753f8b60 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f401c725740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f40141abf30 con 0x55f8753f9480 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f40188e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f40188e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51854/0 (socket says 172.21.15.22:51854) 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f40188e9640 1 -- 172.21.15.22:0/1777238575 learned_addr learned my addr 172.21.15.22:0/1777238575 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f4013fff640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875402df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.704+0000 7f40137fe640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 0x55f8754014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 -- 172.21.15.22:0/1777238575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 msgr2=0x55f8754014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 0x55f8754014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 -- 172.21.15.22:0/1777238575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 msgr2=0x55f875402df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875402df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 -- 172.21.15.22:0/1777238575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8754163e0 con 0x55f875403d40 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40137fe640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 0x55f8754014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f40188e9640 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f400c0127a0 tx=0x7f400c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cae7a7ad31e20b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f3ff9ffb640 1 -- 172.21.15.22:0/1777238575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c02b070 con 0x55f875403d40 2024-09-11T22:38:50.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f3ff9ffb640 1 -- 172.21.15.22:0/1777238575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f400c01b450 con 0x55f875403d40 2024-09-11T22:38:50.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.705+0000 7f3ff9ffb640 1 -- 172.21.15.22:0/1777238575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c026640 con 0x55f875403d40 2024-09-11T22:38:50.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- 172.21.15.22:0/1777238575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 msgr2=0x55f87541b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f400c0127a0 tx=0x7f400c015000 comp rx=0 tx=0).stop 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- 172.21.15.22:0/1777238575 shutdown_connections 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f875403d40 0x55f87541b630 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8753f9480 0x55f8754014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 --2- 172.21.15.22:0/1777238575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875402df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- 172.21.15.22:0/1777238575 >> 172.21.15.22:0/1777238575 conn(0x55f8753f50f0 msgr2=0x55f8753ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- 172.21.15.22:0/1777238575 shutdown_connections 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- 172.21.15.22:0/1777238575 wait complete. 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 -- start start 2024-09-11T22:38:50.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.706+0000 7f401c725740 1 Processor -- start 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875407cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f875403d40 0x55f8754087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ac600 con 0x55f8753f9480 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40141ada70 con 0x55f8753f8b60 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f40141accd0 con 0x55f875403d40 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f401c725740 10 client.0 _ll_register_callbacks cb 0x7f4008031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51858/0 (socket says 172.21.15.22:51858) 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 -- 172.21.15.22:0/3798164535 learned_addr learned my addr 172.21.15.22:0/3798164535 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f4013fff640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875407cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40188e9640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f875403d40 0x55f8754087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 -- 172.21.15.22:0/3798164535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f875403d40 msgr2=0x55f8754087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f875403d40 0x55f8754087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 -- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 msgr2=0x55f875407cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875407cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 -- 172.21.15.22:0/3798164535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87547d8f0 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f40137fe640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f40080039f0 tx=0x7f4008032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cd3f750ace9467 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.707+0000 7f3ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008052070 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7f4008004380 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c01b450 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4008035040 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 10 client.17034 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f87547ec90 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f400c01b450 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f40080046c0 con 0x55f8753f9480 2024-09-11T22:38:50.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 10 client.17034 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 10 client.17034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 20 client.17034 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f87547f360 0x55f875481750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 4 client.17034 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.708+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f875365d00 con 0x55f87547f360 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.709+0000 7f4013fff640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f87547f360 0x55f875481750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.709+0000 7f4013fff640 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f87547f360 0x55f875481750 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=699abe533621318f server_cookie=bd9b40ad40ff9fd in_seq=0 out_seq=0 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.709+0000 7f3ff37fe640 10 client.17034 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f3ff37fe640 1 -- 172.21.15.22:0/3798164535 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f875365d00 con 0x55f87547f360 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f3ff37fe640 10 client.17034 handle_command_reply: tid=0 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 client.17034 shutdown 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 msgr2=0x55f875408230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f40080039f0 tx=0x7f4008032f90 comp rx=0 tx=0).stop 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 shutdown_connections 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55f87547f360 0x55f875481750 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f875403d40 0x55f8754087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f8753f9480 0x55f875408230 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 --2- 172.21.15.22:0/3798164535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8753f8b60 0x55f875407cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 >> 172.21.15.22:0/3798164535 conn(0x55f8753f50f0 msgr2=0x55f8753ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f3ff37fe640 0 client.17034 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.710+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 shutdown_connections 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401c725740 1 -- 172.21.15.22:0/3798164535 wait complete. 2024-09-11T22:38:50.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401c725740 20 client.17034 trim_cache size 0 max 16384 2024-09-11T22:38:50.719 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:50.719 INFO:teuthology.orchestra.run.smithi022.stdout: "return_code": 0, 2024-09-11T22:38:50.719 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_tag": "8ddbda3d-d25e-4f48-a0e4-0b62cdc86509", 2024-09-11T22:38:50.719 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": "asynchronous" 2024-09-11T22:38:50.719 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 msgr2=0x7f3ffc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 0x7f3ffc0a51b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f400c008e00 tx=0x7f400c004a40 comp rx=0 tx=0).stop 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 msgr2=0x7f4014198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f400400d770 tx=0x7f400400dc30 comp rx=0 tx=0).stop 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 shutdown_connections 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f3ffc0a2cf0 0x7f3ffc0a51b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4014106f10 0x7f401419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4014102790 0x7f4014198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 --2- 172.21.15.22:0/669828814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4014101de0 0x7f4014198510 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 >> 172.21.15.22:0/669828814 conn(0x7f40140fd8c0 msgr2=0x7f40140febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 shutdown_connections 2024-09-11T22:38:50.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:50.711+0000 7f401a34c640 1 -- 172.21.15.22:0/669828814 wait complete. 2024-09-11T22:38:51.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:38:51.728 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:38:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:51 smithi022 ceph-mon[30966]: pgmap v304: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:51 smithi022 ceph-mon[30966]: scrub queued for path: / 2024-09-11T22:38:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:51.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:51 smithi022 ceph-mon[30966]: scrub summary: active paths [/] 2024-09-11T22:38:51.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:51 smithi022 ceph-mon[30966]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:51 smithi169 ceph-mon[35628]: pgmap v304: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:51 smithi169 ceph-mon[35628]: scrub queued for path: / 2024-09-11T22:38:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:51 smithi169 ceph-mon[35628]: scrub summary: active paths [/] 2024-09-11T22:38:51.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:51 smithi169 ceph-mon[35628]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:51.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:51 smithi045 ceph-mon[35556]: pgmap v304: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:51.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:51 smithi045 ceph-mon[35556]: scrub queued for path: / 2024-09-11T22:38:51.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:51.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:51 smithi045 ceph-mon[35556]: scrub summary: active paths [/] 2024-09-11T22:38:51.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:51 smithi045 ceph-mon[35556]: scrub summary: idle+waiting paths [/] 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 -- 172.21.15.22:0/1114616274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e8102da0 msgr2=0x7ff9e8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 --2- 172.21.15.22:0/1114616274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e8102da0 0x7ff9e8103180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009900 tx=0x7ff9d802a480 comp rx=0 tx=0).stop 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 -- 172.21.15.22:0/1114616274 shutdown_connections 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 --2- 172.21.15.22:0/1114616274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 0x7ff9e810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 --2- 172.21.15.22:0/1114616274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e81036c0 0x7ff9e810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 --2- 172.21.15.22:0/1114616274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e8102da0 0x7ff9e8103180 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 -- 172.21.15.22:0/1114616274 >> 172.21.15.22:0/1114616274 conn(0x7ff9e80fc7a0 msgr2=0x7ff9e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 -- 172.21.15.22:0/1114616274 shutdown_connections 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.200+0000 7ff9ee523640 1 -- 172.21.15.22:0/1114616274 wait complete. 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 Processor -- start 2024-09-11T22:38:52.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 -- start start 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 0x7ff9e81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 0x7ff9e819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8112080 con 0x7ff9e81036c0 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8111f00 con 0x7ff9e810c180 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ee523640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8112200 con 0x7ff9e8102da0 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51878/0 (socket says 172.21.15.22:51878) 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9e77fe640 1 -- 172.21.15.22:0/3749405709 learned_addr learned my addr 172.21.15.22:0/3749405709 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.201+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 0x7ff9e819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 0x7ff9e81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 -- 172.21.15.22:0/3749405709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 msgr2=0x7ff9e81984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 0x7ff9e81984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 -- 172.21.15.22:0/3749405709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 msgr2=0x7ff9e819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 0x7ff9e819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 -- 172.21.15.22:0/3749405709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e819d460 con 0x7ff9e81036c0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 0x7ff9e81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c970 tx=0x7ff9dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e57fa640 1 -- 172.21.15.22:0/3749405709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc007bb0 con 0x7ff9e81036c0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e819d750 con 0x7ff9e81036c0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e81a5030 con 0x7ff9e81036c0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e57fa640 1 -- 172.21.15.22:0/3749405709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9dc007d50 con 0x7ff9e81036c0 2024-09-11T22:38:52.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.202+0000 7ff9e57fa640 1 -- 172.21.15.22:0/3749405709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc01d060 con 0x7ff9e81036c0 2024-09-11T22:38:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.204+0000 7ff9e57fa640 1 -- 172.21.15.22:0/3749405709 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff9dc0046c0 con 0x7ff9e81036c0 2024-09-11T22:38:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 Processor -- start 2024-09-11T22:38:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 -- start start 2024-09-11T22:38:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906e4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 0x555f906e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555f9063b2e0 con 0x555f906d53c0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f905e2ce0 con 0x555f906e4a90 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f906372a0 con 0x555f906d5ce0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51888/0 (socket says 172.21.15.22:51888) 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9ecac0640 1 -- 172.21.15.22:0/279401249 learned_addr learned my addr 172.21.15.22:0/279401249 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9e57fa640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 0x7ff9d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.205+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9e57fa640 1 -- 172.21.15.22:0/3749405709 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7ff9dc0ced60 con 0x7ff9e81036c0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 0x7ff9d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 0x555f906e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 -- 172.21.15.22:0/279401249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 msgr2=0x555f906e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 -- 172.21.15.22:0/279401249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 msgr2=0x555f906e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 0x555f906e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 -- 172.21.15.22:0/279401249 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f905c7440 con 0x555f906d53c0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 0x555f906e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00139d0 tx=0x7ff9e0013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cde3f8eb2dbcec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ce7fc640 1 -- 172.21.15.22:0/279401249 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0013050 con 0x555f906d53c0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ce7fc640 1 -- 172.21.15.22:0/279401249 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9e0022070 con 0x555f906d53c0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.206+0000 7ff9ce7fc640 1 -- 172.21.15.22:0/279401249 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0012740 con 0x555f906d53c0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- 172.21.15.22:0/279401249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 msgr2=0x555f906d57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 0x7ff9d00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0021000 tx=0x7ff9e001f000 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00139d0 tx=0x7ff9e0013e90 comp rx=0 tx=0).stop 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- 172.21.15.22:0/279401249 shutdown_connections 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906e4a90 0x555f906e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/279401249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906d53c0 0x555f906d57a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- 172.21.15.22:0/279401249 >> 172.21.15.22:0/279401249 conn(0x555f906d1a30 msgr2=0x555f906d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- 172.21.15.22:0/279401249 shutdown_connections 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- 172.21.15.22:0/279401249 wait complete. 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.207+0000 7ff9f08fc740 1 -- start start 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 Processor -- start 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555f906e7600 con 0x555f906e4a90 2024-09-11T22:38:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f905f6050 con 0x555f906d5ce0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f906e7780 con 0x555f906d53c0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9f08fc740 10 client.0 _ll_register_callbacks cb 0x555f90636160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51900/0 (socket says 172.21.15.22:51900) 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9ecac0640 1 -- 172.21.15.22:0/560770389 learned_addr learned my addr 172.21.15.22:0/560770389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.208+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 -- 172.21.15.22:0/560770389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 msgr2=0x555f906e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 -- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 msgr2=0x555f906e16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 -- 172.21.15.22:0/560770389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f903ac3c0 con 0x555f906e4a90 2024-09-11T22:38:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007d80 tx=0x7ff9e0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e6274122a0fb60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00124c0 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7ff9e0012660 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0022070 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff9e0012aa0 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9f08fc740 10 client.17046 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555f906f3010 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9e0022070 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.209+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff9e0039070 con 0x555f906e4a90 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 10 client.17046 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 10 client.17046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 20 client.17046 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f906f4470 0x555f906f6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 4 client.17046 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:38:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f90648850 con 0x555f906f4470 2024-09-11T22:38:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f906f4470 0x555f906f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f906f4470 0x555f906f6860 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42960df288846a7f server_cookie=6ec5684e0971ca6a in_seq=0 out_seq=0 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.210+0000 7ff9c77fe640 10 client.17046 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9c77fe640 1 -- 172.21.15.22:0/560770389 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f90648850 con 0x555f906f4470 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9c77fe640 10 client.17046 handle_command_reply: tid=0 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 client.17046 shutdown 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 msgr2=0x555f906e1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007d80 tx=0x7ff9e0007f70 comp rx=0 tx=0).stop 2024-09-11T22:38:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 shutdown_connections 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f906f4470 0x555f906f6860 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e1c00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9c77fe640 0 client.17046 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/560770389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 >> 172.21.15.22:0/560770389 conn(0x555f906d1a30 msgr2=0x555f906d76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 shutdown_connections 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.211+0000 7ff9f08fc740 1 -- 172.21.15.22:0/560770389 wait complete. 2024-09-11T22:38:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.212+0000 7ff9f08fc740 20 client.17046 trim_cache size 0 max 16384 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.228+0000 7ff9f08fc740 1 Processor -- start 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 -- start start 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d53c0 0x555f906f0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906dff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400c6e0 con 0x555f906e4a90 2024-09-11T22:38:52.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400ef40 con 0x555f906d53c0 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400cd30 con 0x555f906d5ce0 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51910/0 (socket says 172.21.15.22:51910) 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 -- 172.21.15.22:0/3655390395 learned_addr learned my addr 172.21.15.22:0/3655390395 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 -- 172.21.15.22:0/3655390395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 msgr2=0x555f906dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d53c0 0x555f906f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906dff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 -- 172.21.15.22:0/3655390395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d53c0 msgr2=0x555f906f0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d53c0 0x555f906f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 -- 172.21.15.22:0/3655390395 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f906e2a20 con 0x555f906e4a90 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:38:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0013ed0 tx=0x7ff9e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7919732587493dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.229+0000 7ff9cdffb640 1 -- 172.21.15.22:0/3655390395 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e003f020 con 0x555f906e4a90 2024-09-11T22:38:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9cdffb640 1 -- 172.21.15.22:0/3655390395 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9e0022040 con 0x555f906e4a90 2024-09-11T22:38:52.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9cdffb640 1 -- 172.21.15.22:0/3655390395 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0003970 con 0x555f906e4a90 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- 172.21.15.22:0/3655390395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 msgr2=0x555f906e3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0013ed0 tx=0x7ff9e0005fd0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- 172.21.15.22:0/3655390395 shutdown_connections 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e3610 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d5ce0 0x555f906dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/3655390395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d53c0 0x555f906f0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- 172.21.15.22:0/3655390395 >> 172.21.15.22:0/3655390395 conn(0x555f906d1a30 msgr2=0x555f906e2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- 172.21.15.22:0/3655390395 shutdown_connections 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- 172.21.15.22:0/3655390395 wait complete. 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.230+0000 7ff9f08fc740 1 -- start start 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 Processor -- start 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400d400 con 0x555f906e4a90 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400e870 con 0x555f906d5ce0 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400dad0 con 0x555f906d53c0 2024-09-11T22:38:52.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9f08fc740 10 client.0 _ll_register_callbacks cb 0x7ff9d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9ecac0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51916/0 (socket says 172.21.15.22:51916) 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9ecac0640 1 -- 172.21.15.22:0/1455472860 learned_addr learned my addr 172.21.15.22:0/1455472860 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9e77fe640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.231+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 -- 172.21.15.22:0/1455472860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 msgr2=0x555f906e8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 -- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 msgr2=0x555f906e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 -- 172.21.15.22:0/1455472860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9075e1c0 con 0x555f906e4a90 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9ecac0640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007ec0 tx=0x7ff9e0012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56614992c0f4822 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e003f040 con 0x555f906e4a90 2024-09-11T22:38:52.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8484+0+0 (secure 0 0 0) 0x7ff9e0002030 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0022040 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff9e0013750 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9f08fc740 10 client.17052 fetch_fsmap learned FSMap version 22 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x555f9075f3c0 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.232+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9e0022040 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff9e0039040 con 0x555f906e4a90 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 10 client.17052 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 20 client.17052 populate_metadata read hostname 'smithi022' 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f9075f7a0 0x555f90761b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 4 client.17052 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f90642d60 con 0x555f9075f7a0 2024-09-11T22:38:52.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.233+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f9075f7a0 0x555f90761b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9e7fff640 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f9075f7a0 0x555f90761b90 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d6c7fe6a6d1a49d server_cookie=1caa0448c956f728 in_seq=0 out_seq=0 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9c77fe640 10 client.17052 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9c77fe640 1 -- 172.21.15.22:0/1455472860 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555f90642d60 con 0x555f9075f7a0 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9c77fe640 10 client.17052 handle_command_reply: tid=0 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 client.17052 shutdown 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 msgr2=0x555f906e9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0007ec0 tx=0x7ff9e0012680 comp rx=0 tx=0).stop 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 shutdown_connections 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x555f9075f7a0 0x555f90761b90 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f906e4a90 0x555f906e9390 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f906d5ce0 0x555f906e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 --2- 172.21.15.22:0/1455472860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f906d53c0 0x555f906e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9c77fe640 0 client.17052 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:38:52.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 >> 172.21.15.22:0/1455472860 conn(0x555f906d1a30 msgr2=0x555f906e3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 shutdown_connections 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 1 -- 172.21.15.22:0/1455472860 wait complete. 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.234+0000 7ff9f08fc740 20 client.17052 trim_cache size 0 max 16384 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": { 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout: "8ddbda3d-d25e-4f48-a0e4-0b62cdc86509": { 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout: "path": "/", 2024-09-11T22:38:52.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tag": "8ddbda3d-d25e-4f48-a0e4-0b62cdc86509", 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stdout: "options": "recursive,force" 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 msgr2=0x7ff9d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 0x7ff9d00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0021000 tx=0x7ff9e001f000 comp rx=0 tx=0).stop 2024-09-11T22:38:52.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 msgr2=0x7ff9e81989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c970 tx=0x7ff9dc00ce30 comp rx=0 tx=0).stop 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 shutdown_connections 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff9d00a2cf0 0x7ff9d00a51b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9e810c180 0x7ff9e819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9e81036c0 0x7ff9e81989f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 --2- 172.21.15.22:0/3749405709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102da0 0x7ff9e81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 >> 172.21.15.22:0/3749405709 conn(0x7ff9e80fc7a0 msgr2=0x7ff9e80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 shutdown_connections 2024-09-11T22:38:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:38:52.235+0000 7ff9ee523640 1 -- 172.21.15.22:0/3749405709 wait complete. 2024-09-11T22:38:53.107 INFO:tasks.cephfs.filesystem:scrub status for tag:8ddbda3d-d25e-4f48-a0e4-0b62cdc86509 - {'path': '/', 'tag': '8ddbda3d-d25e-4f48-a0e4-0b62cdc86509', 'options': 'recursive,force'} 2024-09-11T22:38:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:53 smithi022 ceph-mon[30966]: pgmap v305: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:53 smithi169 ceph-mon[35628]: pgmap v305: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:53 smithi045 ceph-mon[35556]: pgmap v305: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:38:54.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:54 smithi022 ceph-mon[30966]: scrub summary: idle 2024-09-11T22:38:54.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:54 smithi169 ceph-mon[35628]: scrub summary: idle 2024-09-11T22:38:54.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:54 smithi045 ceph-mon[35556]: scrub summary: idle 2024-09-11T22:38:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:55 smithi022 ceph-mon[30966]: pgmap v306: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:38:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:55 smithi169 ceph-mon[35628]: pgmap v306: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:38:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:55 smithi045 ceph-mon[35556]: pgmap v306: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:38:57.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:57 smithi022 ceph-mon[30966]: pgmap v307: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:38:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:57 smithi169 ceph-mon[35628]: pgmap v307: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:38:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:57 smithi045 ceph-mon[35556]: pgmap v307: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:38:59.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:38:59 smithi022 ceph-mon[30966]: pgmap v308: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:38:59.652 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:38:59 smithi169 ceph-mon[35628]: pgmap v308: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:38:59.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:38:59 smithi045 ceph-mon[35556]: pgmap v308: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-11T22:39:01.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:01 smithi022 ceph-mon[30966]: pgmap v309: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:01.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:01 smithi169 ceph-mon[35628]: pgmap v309: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:01 smithi045 ceph-mon[35556]: pgmap v309: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:03.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:03 smithi022 ceph-mon[30966]: pgmap v310: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:03.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:03 smithi169 ceph-mon[35628]: pgmap v310: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:03.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:03 smithi045 ceph-mon[35556]: pgmap v310: 97 pgs: 97 active+clean; 5.5 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-11T22:39:05.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:05 smithi022 ceph-mon[30966]: pgmap v311: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:39:05.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:05 smithi169 ceph-mon[35628]: pgmap v311: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:39:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:05 smithi045 ceph-mon[35556]: pgmap v311: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T22:39:07.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:07 smithi022 ceph-mon[30966]: pgmap v312: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:39:07.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:07 smithi169 ceph-mon[35628]: pgmap v312: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:39:07.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:07 smithi045 ceph-mon[35556]: pgmap v312: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T22:39:09.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:09 smithi022 ceph-mon[30966]: pgmap v313: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:39:09.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:09 smithi169 ceph-mon[35628]: pgmap v313: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:39:09.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:09 smithi045 ceph-mon[35556]: pgmap v313: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T22:39:10.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:10 smithi022 ceph-mon[30966]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:39:10.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:10 smithi169 ceph-mon[35628]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:39:10.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:10 smithi045 ceph-mon[35556]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:39:11.221 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T22:39:11.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- 172.21.15.22:0/2211324980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 msgr2=0x7f32d4100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 --2- 172.21.15.22:0/2211324980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4100e50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009930 tx=0x7f32c402a420 comp rx=0 tx=0).stop 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- 172.21.15.22:0/2211324980 shutdown_connections 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 --2- 172.21.15.22:0/2211324980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4101390 0x7f32d410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 --2- 172.21.15.22:0/2211324980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4100e50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 --2- 172.21.15.22:0/2211324980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4106a00 0x7f32d4106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- 172.21.15.22:0/2211324980 >> 172.21.15.22:0/2211324980 conn(0x7f32d40fc6b0 msgr2=0x7f32d40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- 172.21.15.22:0/2211324980 shutdown_connections 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- 172.21.15.22:0/2211324980 wait complete. 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 Processor -- start 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.341+0000 7f32dad2c640 1 -- start start 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4101390 0x7f32d4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4106a00 0x7f32d419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4110f60 con 0x7f32d41009f0 2024-09-11T22:39:11.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4110de0 con 0x7f32d4106a00 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41110e0 con 0x7f32d4101390 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48370/0 (socket says 172.21.15.22:48370) 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 -- 172.21.15.22:0/3129299158 learned_addr learned my addr 172.21.15.22:0/3129299158 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32cbfff640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4101390 0x7f32d4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d92c9640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4106a00 0x7f32d419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 -- 172.21.15.22:0/3129299158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4101390 msgr2=0x7f32d4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4101390 0x7f32d4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 -- 172.21.15.22:0/3129299158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4106a00 msgr2=0x7f32d419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4106a00 0x7f32d419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 -- 172.21.15.22:0/3129299158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d419d440 con 0x7f32d41009f0 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32d8ac8640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e9f0 tx=0x7f32d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:11.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d000cd80 con 0x7f32d41009f0 2024-09-11T22:39:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32d0005520 con 0x7f32d41009f0 2024-09-11T22:39:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.342+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d419d730 con 0x7f32d41009f0 2024-09-11T22:39:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.343+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0010690 con 0x7f32d41009f0 2024-09-11T22:39:11.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.343+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41a4fc0 con 0x7f32d41009f0 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.344+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d4100e50 con 0x7f32d41009f0 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.345+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f32d00046c0 con 0x7f32d41009f0 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.345+0000 7f32c9ffb640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 0x7f32bc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.346+0000 7f32cbfff640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 0x7f32bc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.346+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8528+0+0 (secure 0 0 0) 0x7f32d00cf950 con 0x7f32d41009f0 2024-09-11T22:39:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.346+0000 7f32cbfff640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 0x7f32bc0a5260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32c4000c00 tx=0x7f32c4005a20 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:11.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.350+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32d009c570 con 0x7f32d41009f0 2024-09-11T22:39:11.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.545+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f32d4062630 con 0x7f32bc0a2da0 2024-09-11T22:39:11.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.553+0000 7f32c9ffb640 1 -- 172.21.15.22:0/3129299158 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f32d4062630 con 0x7f32bc0a2da0 2024-09-11T22:39:11.554 INFO:teuthology.orchestra.run.smithi022.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T22:29:10", "first": "2024-09-11T22:30:00", "last": "2024-09-11T22:39:00", "last_pruned": "2024-09-11T22:39:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 msgr2=0x7f32bc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 0x7f32bc0a5260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32c4000c00 tx=0x7f32c4005a20 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 msgr2=0x7f32d4198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f32d000e9f0 tx=0x7f32d000edf0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 shutdown_connections 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f32bc0a2da0 0x7f32bc0a5260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32d4106a00 0x7f32d419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32d4101390 0x7f32d4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 --2- 172.21.15.22:0/3129299158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32d41009f0 0x7f32d4198450 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 >> 172.21.15.22:0/3129299158 conn(0x7f32d40fc6b0 msgr2=0x7f32d406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 shutdown_connections 2024-09-11T22:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.555+0000 7f32dad2c640 1 -- 172.21.15.22:0/3129299158 wait complete. 2024-09-11T22:39:11.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- 172.21.15.22:0/354364759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 msgr2=0x7ff8cc10e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 --2- 172.21.15.22:0/354364759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc10e560 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009ca0 tx=0x7ff8c402a950 comp rx=0 tx=0).stop 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- 172.21.15.22:0/354364759 shutdown_connections 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 --2- 172.21.15.22:0/354364759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc10e560 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 --2- 172.21.15.22:0/354364759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc103660 0x7ff8cc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 --2- 172.21.15.22:0/354364759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc102d40 0x7ff8cc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- 172.21.15.22:0/354364759 >> 172.21.15.22:0/354364759 conn(0x7ff8cc077990 msgr2=0x7ff8cc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- 172.21.15.22:0/354364759 shutdown_connections 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- 172.21.15.22:0/354364759 wait complete. 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 Processor -- start 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.673+0000 7ff8d234b640 1 -- start start 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 0x7ff8cc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc103660 0x7ff8cc198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc112000 con 0x7ff8cc10c110 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc111e80 con 0x7ff8cc102d40 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d234b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc112180 con 0x7ff8cc103660 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48398/0 (socket says 172.21.15.22:48398) 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 -- 172.21.15.22:0/735957853 learned_addr learned my addr 172.21.15.22:0/735957853 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8cbfff640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 0x7ff8cc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8cb7fe640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc103660 0x7ff8cc198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 -- 172.21.15.22:0/735957853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc103660 msgr2=0x7ff8cc198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc103660 0x7ff8cc198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 -- 172.21.15.22:0/735957853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 msgr2=0x7ff8cc198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 0x7ff8cc198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 -- 172.21.15.22:0/735957853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc19d300 con 0x7ff8cc10c110 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8cbfff640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 0x7ff8cc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.674+0000 7ff8d08e8640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098d0 tx=0x7ff8c402ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.675+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4034040 con 0x7ff8cc10c110 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.675+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff8c4030940 con 0x7ff8cc10c110 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.675+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc19d590 con 0x7ff8cc10c110 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.675+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40456e0 con 0x7ff8cc10c110 2024-09-11T22:39:11.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.675+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc1a4e80 con 0x7ff8cc10c110 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.676+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc103120 con 0x7ff8cc10c110 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.677+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff8c4037020 con 0x7ff8cc10c110 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.677+0000 7ff8c97fa640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 0x7ff8b40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.678+0000 7ff8cbfff640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 0x7ff8b40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.678+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8528+0+0 (secure 0 0 0) 0x7ff8c40f05b0 con 0x7ff8cc10c110 2024-09-11T22:39:11.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.678+0000 7ff8cbfff640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 0x7ff8b40a5260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00abe0 tx=0x7ff8bc00a5c0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:11.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.681+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c40811b0 con 0x7ff8cc10c110 2024-09-11T22:39:11.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.880+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 --> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7ff8cc0fed20 con 0x7ff8b40a2da0 2024-09-11T22:39:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.887+0000 7ff8c97fa640 1 -- 172.21.15.22:0/735957853 <== mgr.15057 v2:172.21.15.22:6800/3304490936 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7ff8cc0fed20 con 0x7ff8b40a2da0 2024-09-11T22:39:11.887 INFO:teuthology.orchestra.run.smithi022.stdout:/ 1m 6m3h 2024-09-11T22:39:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 msgr2=0x7ff8b40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 0x7ff8b40a5260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00abe0 tx=0x7ff8bc00a5c0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 msgr2=0x7ff8cc19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098d0 tx=0x7ff8c402ffa0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 shutdown_connections 2024-09-11T22:39:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8b40a2da0 0x7ff8b40a5260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8cc10c110 0x7ff8cc19cbd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8cc103660 0x7ff8cc198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 --2- 172.21.15.22:0/735957853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8cc102d40 0x7ff8cc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 >> 172.21.15.22:0/735957853 conn(0x7ff8cc077990 msgr2=0x7ff8cc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 shutdown_connections 2024-09-11T22:39:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:11.889+0000 7ff8d234b640 1 -- 172.21.15.22:0/735957853 wait complete. 2024-09-11T22:39:11.899 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:11 smithi022 ceph-mon[30966]: pgmap v315: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:11.900 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-11T22:39:11.911 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-11T22:39:11.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:11 smithi045 ceph-mon[35556]: pgmap v315: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:11.912 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:11 smithi169 ceph-mon[35628]: pgmap v315: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:12 smithi022 ceph-mon[30966]: from='client.17058 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:12.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:12 smithi022 ceph-mon[30966]: from='client.17064 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:12.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:12 smithi169 ceph-mon[35628]: from='client.17058 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:12.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:12 smithi169 ceph-mon[35628]: from='client.17064 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:12.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:12 smithi045 ceph-mon[35556]: from='client.17058 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:12.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:12 smithi045 ceph-mon[35556]: from='client.17064 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:39:13.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:13 smithi022 ceph-mon[30966]: pgmap v316: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:13.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:13 smithi169 ceph-mon[35628]: pgmap v316: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:13.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:13 smithi045 ceph-mon[35556]: pgmap v316: 97 pgs: 97 active+clean; 5.5 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T22:39:15.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:15 smithi022 ceph-mon[30966]: pgmap v317: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:15.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:15 smithi169 ceph-mon[35628]: pgmap v317: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:15.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:15 smithi045 ceph-mon[35556]: pgmap v317: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:16.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:16 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:16.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:16 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:16.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:16 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: pgmap v318: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:17 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: pgmap v318: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:17 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: pgmap v318: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:17.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:17.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:17 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:39:18.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:18.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:18 smithi022 ceph-mon[30966]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:39:18.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:18.906 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:18.906 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:18 smithi169 ceph-mon[35628]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:39:18.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi169 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi045 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' 2024-09-11T22:39:18.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:18 smithi045 ceph-mon[35556]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:39:19.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:19 smithi022 ceph-mon[30966]: pgmap v320: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-11T22:39:19.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:19 smithi169 ceph-mon[35628]: pgmap v320: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-11T22:39:19.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:19 smithi045 ceph-mon[35556]: pgmap v320: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-11T22:39:21.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:21 smithi022 ceph-mon[30966]: pgmap v321: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:21.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:21 smithi169 ceph-mon[35628]: pgmap v321: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:21.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:21 smithi045 ceph-mon[35556]: pgmap v321: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:23.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T22:39:23.382 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:23.795 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:23 smithi022 ceph-mon[30966]: pgmap v322: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.884+0000 7f1016f27640 1 -- 172.21.15.22:0/3701594552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 msgr2=0x7f101010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.884+0000 7f1016f27640 1 --2- 172.21.15.22:0/3701594552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f101010eaa0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f1008009ca0 tx=0x7f100802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 -- 172.21.15.22:0/3701594552 shutdown_connections 2024-09-11T22:39:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 --2- 172.21.15.22:0/3701594552 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f101010eaa0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 --2- 172.21.15.22:0/3701594552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 0x7f10101067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 --2- 172.21.15.22:0/3701594552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 0x7f10101021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 -- 172.21.15.22:0/3701594552 >> 172.21.15.22:0/3701594552 conn(0x7f10100fd8f0 msgr2=0x7f10100ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 -- 172.21.15.22:0/3701594552 shutdown_connections 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 -- 172.21.15.22:0/3701594552 wait complete. 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 Processor -- start 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 -- start start 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.885+0000 7f1016f27640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 0x7f10100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1016f27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 0x7f1010074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1016f27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1016f27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10101120a0 con 0x7f1010106f20 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1016f27640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1010111f20 con 0x7f10101027a0 2024-09-11T22:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1016f27640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1010112220 con 0x7f1010101df0 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54860/0 (socket says 172.21.15.22:54860) 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f100ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 0x7f1010074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 -- 172.21.15.22:0/1118549432 learned_addr learned my addr 172.21.15.22:0/1118549432 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 0x7f10100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 -- 172.21.15.22:0/1118549432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 msgr2=0x7f10100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 0x7f10100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 -- 172.21.15.22:0/1118549432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 msgr2=0x7f1010074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 0x7f1010074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 -- 172.21.15.22:0/1118549432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10101a69c0 con 0x7f1010106f20 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.886+0000 7f10154c4640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1008006010 tx=0x7f10080319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.887+0000 7f100dffb640 1 -- 172.21.15.22:0/1118549432 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100802fa20 con 0x7f1010106f20 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.887+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10101a6c50 con 0x7f1010106f20 2024-09-11T22:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.887+0000 7f100dffb640 1 -- 172.21.15.22:0/1118549432 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f100802fbc0 con 0x7f1010106f20 2024-09-11T22:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.887+0000 7f100dffb640 1 -- 172.21.15.22:0/1118549432 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080467f0 con 0x7f1010106f20 2024-09-11T22:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.887+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10101a7190 con 0x7f1010106f20 2024-09-11T22:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.889+0000 7f100dffb640 1 -- 172.21.15.22:0/1118549432 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1008046990 con 0x7f1010106f20 2024-09-11T22:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.890+0000 7f100dffb640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 0x7f10000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.890+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 0x7f10000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.890+0000 7f100dffb640 1 -- 172.21.15.22:0/1118549432 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f10080f0780 con 0x7f1010106f20 2024-09-11T22:39:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.890+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 0x7f10000a51b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1004009bd0 tx=0x7f1004005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.890+0000 7f1019300740 1 Processor -- start 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 -- start start 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1c2680 0x55ba9a1c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a11d2e0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a0c4ce0 con 0x55ba9a1b7dc0 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1019300740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a1192a0 con 0x55ba9a1c2680 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54868/0 (socket says 172.21.15.22:54868) 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 -- 172.21.15.22:0/2838214275 learned_addr learned my addr 172.21.15.22:0/2838214275 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f100ffff640 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f10154c4640 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1c2680 0x55ba9a1c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 -- 172.21.15.22:0/2838214275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1c2680 msgr2=0x55ba9a1c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1c2680 0x55ba9a1c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 -- 172.21.15.22:0/2838214275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 msgr2=0x55ba9a1c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.891+0000 7f1014cc3640 1 -- 172.21.15.22:0/2838214275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9a0a9440 con 0x55ba9a1b74a0 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.892+0000 7f1014cc3640 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f10040058c0 tx=0x7f1004014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8428c74891c60790 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.892+0000 7f0ffaffd640 1 -- 172.21.15.22:0/2838214275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004005020 con 0x55ba9a1b74a0 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.892+0000 7f0ffaffd640 1 -- 172.21.15.22:0/2838214275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10040047a0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.892+0000 7f0ffaffd640 1 -- 172.21.15.22:0/2838214275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100401e820 con 0x55ba9a1b74a0 2024-09-11T22:39:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 -- 172.21.15.22:0/2838214275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 msgr2=0x55ba9a1b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f10040058c0 tx=0x7f1004014000 comp rx=0 tx=0).stop 2024-09-11T22:39:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 -- 172.21.15.22:0/2838214275 shutdown_connections 2024-09-11T22:39:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1c2680 0x55ba9a1c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 --2- 172.21.15.22:0/2838214275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1b7880 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 -- 172.21.15.22:0/2838214275 >> 172.21.15.22:0/2838214275 conn(0x55ba9a1b3a30 msgr2=0x55ba9a1b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 -- 172.21.15.22:0/2838214275 shutdown_connections 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.893+0000 7f1019300740 1 -- 172.21.15.22:0/2838214275 wait complete. 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 -- start start 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 Processor -- start 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 0x55ba9a1bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a1c5250 con 0x55ba9a1c2680 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a0d8050 con 0x55ba9a1b7dc0 2024-09-11T22:39:23.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba9a1c53d0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f1019300740 10 client.0 _ll_register_callbacks cb 0x55ba9a118160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f10154c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 0x55ba9a1bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.894+0000 7f100ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f100ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.22:40548/0 (socket says 172.21.15.22:40548) 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f100ffff640 1 -- 172.21.15.22:0/973028443 learned_addr learned my addr 172.21.15.22:0/973028443 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f1014cc3640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 -- 172.21.15.22:0/973028443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b74a0 msgr2=0x55ba9a1c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 -- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 msgr2=0x55ba9a1bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 -- 172.21.15.22:0/973028443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba99e8e3c0 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f100ffff640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f10154c4640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 0x55ba9a1bf6f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f10080edfa0 tx=0x7f10080bc6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f59549666381e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f0feffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080c1120 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f1008046c80 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.895+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10040047a0 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f10080c59e0 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 10 client.17076 fetch_fsmap learned FSMap version 22 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba9a1c5250 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10040047a0 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f100804e030 con 0x55ba9a1c2680 2024-09-11T22:39:23.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 10 client.17076 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 20 client.17076 populate_metadata read hostname 'smithi022' 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1d2010 0x55ba9a1d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 4 client.17076 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9a12a850 con 0x55ba9a1d2010 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.896+0000 7f1014cc3640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1d2010 0x55ba9a1d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.897+0000 7f1014cc3640 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1d2010 0x55ba9a1d4420 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=924a6ac15e264209 server_cookie=fd3229445ba1d127 in_seq=0 out_seq=0 2024-09-11T22:39:23.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.897+0000 7f0feffff640 10 client.17076 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:23.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f0feffff640 1 -- 172.21.15.22:0/973028443 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba9a12a850 con 0x55ba9a1d2010 2024-09-11T22:39:23.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f0feffff640 10 client.17076 handle_command_reply: tid=0 2024-09-11T22:39:23.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 client.17076 shutdown 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 msgr2=0x55ba9a1bf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 0x55ba9a1bf6f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f10080edfa0 tx=0x7f10080bc6d0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 shutdown_connections 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1d2010 0x55ba9a1d4420 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f0feffff640 0 client.17076 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1c2680 0x55ba9a1bf6f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 --2- 172.21.15.22:0/973028443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 >> 172.21.15.22:0/973028443 conn(0x55ba9a1b3a30 msgr2=0x55ba9a1b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 shutdown_connections 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 1 -- 172.21.15.22:0/973028443 wait complete. 2024-09-11T22:39:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.898+0000 7f1019300740 20 client.17076 trim_cache size 0 max 16384 2024-09-11T22:39:23.905 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:23 smithi169 ceph-mon[35628]: pgmap v322: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:23.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:23 smithi045 ceph-mon[35556]: pgmap v322: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T22:39:23.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.915+0000 7f1019300740 1 Processor -- start 2024-09-11T22:39:23.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.915+0000 7f1019300740 1 -- start start 2024-09-11T22:39:23.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.915+0000 7f1019300740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1019300740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1019300740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1d9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1019300740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10101ada80 con 0x55ba9a1b3a30 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1019300740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10101b02e0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1019300740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10101ae0d0 con 0x55ba9a1b7dc0 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54888/0 (socket says 172.21.15.22:54888) 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 -- 172.21.15.22:0/1335505696 learned_addr learned my addr 172.21.15.22:0/1335505696 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f100ffff640 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f10154c4640 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1d9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 -- 172.21.15.22:0/1335505696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b7dc0 msgr2=0x55ba9a1d9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1d9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 -- 172.21.15.22:0/1335505696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b74a0 msgr2=0x55ba9a1c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 -- 172.21.15.22:0/1335505696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9a1c2270 con 0x55ba9a1b3a30 2024-09-11T22:39:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.916+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1004009710 tx=0x7f100401e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71fa0bade679435 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f0ffa7fc640 1 -- 172.21.15.22:0/1335505696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004039020 con 0x55ba9a1b3a30 2024-09-11T22:39:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f0ffa7fc640 1 -- 172.21.15.22:0/1335505696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f100401ea20 con 0x55ba9a1b3a30 2024-09-11T22:39:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f0ffa7fc640 1 -- 172.21.15.22:0/1335505696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040346e0 con 0x55ba9a1b3a30 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 -- 172.21.15.22:0/1335505696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 msgr2=0x55ba9a1bf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1004009710 tx=0x7f100401e420 comp rx=0 tx=0).stop 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 -- 172.21.15.22:0/1335505696 shutdown_connections 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1d9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 --2- 172.21.15.22:0/1335505696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1bf170 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 -- 172.21.15.22:0/1335505696 >> 172.21.15.22:0/1335505696 conn(0x55ba9a1bf850 msgr2=0x55ba9a1c0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 -- 172.21.15.22:0/1335505696 shutdown_connections 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.917+0000 7f1019300740 1 -- 172.21.15.22:0/1335505696 wait complete. 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 -- start start 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 Processor -- start 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10101ae7a0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10101afc10 con 0x55ba9a1b7dc0 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10101aee70 con 0x55ba9a1b3a30 2024-09-11T22:39:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f1019300740 10 client.0 _ll_register_callbacks cb 0x7f1008005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.918+0000 7f100ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54890/0 (socket says 172.21.15.22:54890) 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 -- 172.21.15.22:0/1446049047 learned_addr learned my addr 172.21.15.22:0/1446049047 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f10154c4640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 -- 172.21.15.22:0/1446049047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b3a30 msgr2=0x55ba9a1cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 -- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 msgr2=0x55ba9a1c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 -- 172.21.15.22:0/1446049047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba9a1c8f10 con 0x55ba9a1b74a0 2024-09-11T22:39:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f10154c4640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f100ffff640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x55ba9a1bea40 tx=0x7f0ffc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956b5f5e22d90ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f0feffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc005220 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f0ffc0053c0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.919+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100401ea20 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc005600 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 10 client.17082 fetch_fsmap learned FSMap version 22 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ba9a23cdf0 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f100401ea20 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7f0ffc023020 con 0x55ba9a1b74a0 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 10 client.17082 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:39:23.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 20 client.17082 populate_metadata read hostname 'smithi022' 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1c2680 0x55ba9a23f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 4 client.17082 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba9a124d60 con 0x55ba9a1c2680 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.920+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1c2680 0x55ba9a23f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1014cc3640 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1c2680 0x55ba9a23f660 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73338654aaa3d056 server_cookie=450bdbb486dc2d19 in_seq=0 out_seq=0 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f0feffff640 10 client.17082 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f0feffff640 1 -- 172.21.15.22:0/1446049047 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ba9a124d60 con 0x55ba9a1c2680 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f0feffff640 10 client.17082 handle_command_reply: tid=0 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 client.17082 shutdown 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 msgr2=0x55ba9a1c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x55ba9a1bea40 tx=0x7f0ffc0039c0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 shutdown_connections 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55ba9a1c2680 0x55ba9a23f660 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f0feffff640 0 client.17082 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ba9a1b7dc0 0x55ba9a1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ba9a1b74a0 0x55ba9a1c8160 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 --2- 172.21.15.22:0/1446049047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9a1b3a30 0x55ba9a1cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 >> 172.21.15.22:0/1446049047 conn(0x55ba9a1bf850 msgr2=0x55ba9a1c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 shutdown_connections 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 1 -- 172.21.15.22:0/1446049047 wait complete. 2024-09-11T22:39:23.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.921+0000 7f1019300740 20 client.17082 trim_cache size 0 max 16384 2024-09-11T22:39:23.929 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:23.929 INFO:teuthology.orchestra.run.smithi022.stdout: "status": "no active scrubs running", 2024-09-11T22:39:23.929 INFO:teuthology.orchestra.run.smithi022.stdout: "scrubs": {} 2024-09-11T22:39:23.929 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 msgr2=0x7f10000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 0x7f10000a51b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1004009bd0 tx=0x7f1004005f90 comp rx=0 tx=0).stop 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 msgr2=0x7f1010074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1008006010 tx=0x7f10080319f0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 shutdown_connections 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f10000a2cf0 0x7f10000a51b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1010106f20 0x7f1010074f70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10101027a0 0x7f1010074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 --2- 172.21.15.22:0/1118549432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1010101df0 0x7f10100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:23.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 >> 172.21.15.22:0/1118549432 conn(0x7f10100fd8f0 msgr2=0x7f10100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:23.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 shutdown_connections 2024-09-11T22:39:23.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:23.922+0000 7f1016f27640 1 -- 172.21.15.22:0/1118549432 wait complete. 2024-09-11T22:39:24.735 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T22:39:24.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:39:25.001 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 -- 172.21.15.22:0/2033453313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041036e0 msgr2=0x7f7004107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 --2- 172.21.15.22:0/2033453313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041036e0 0x7f7004107b90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009930 tx=0x7f6fec02a420 comp rx=0 tx=0).stop 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 -- 172.21.15.22:0/2033453313 shutdown_connections 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 --2- 172.21.15.22:0/2033453313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041082a0 0x7f700410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 --2- 172.21.15.22:0/2033453313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041036e0 0x7f7004107b90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 --2- 172.21.15.22:0/2033453313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 0x7f7004103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 -- 172.21.15.22:0/2033453313 >> 172.21.15.22:0/2033453313 conn(0x7f70040fc7d0 msgr2=0x7f70040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:25.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 -- 172.21.15.22:0/2033453313 shutdown_connections 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.488+0000 7f7009624640 1 -- 172.21.15.22:0/2033453313 wait complete. 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 Processor -- start 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 -- start start 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 0x7f7004198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041036e0 0x7f7004198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f70041121c0 con 0x7f70041082a0 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112040 con 0x7f70041036e0 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7009624640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112340 con 0x7f7004102d30 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f70037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f70037fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36044/0 (socket says 172.21.15.22:36044) 2024-09-11T22:39:25.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f70037fe640 1 -- 172.21.15.22:0/3062879056 learned_addr learned my addr 172.21.15.22:0/3062879056 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f70027fc640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041036e0 0x7f7004198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.489+0000 7f7002ffd640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 0x7f7004198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 -- 172.21.15.22:0/3062879056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 msgr2=0x7f7004198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 0x7f7004198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 -- 172.21.15.22:0/3062879056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041036e0 msgr2=0x7f7004198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041036e0 0x7f7004198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 -- 172.21.15.22:0/3062879056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700419d620 con 0x7f70041082a0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f70037fe640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c970 tx=0x7f6ff400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4007bb0 con 0x7f70041082a0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700419d910 con 0x7f70041082a0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ff4007d50 con 0x7f70041082a0 2024-09-11T22:39:25.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40188a0 con 0x7f70041082a0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.490+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70041a51f0 con 0x7f70041082a0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.491+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7004103110 con 0x7f70041082a0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.492+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6ff400f450 con 0x7f70041082a0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.493+0000 7f6ffbfff640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 0x7f6ff00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.493+0000 7f7002ffd640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 0x7f6ff00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.493+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f6ff40cf510 con 0x7f70041082a0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.494+0000 7f7002ffd640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 0x7f6ff00a51b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005c40 tx=0x7f6ffc00a390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:25.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.498+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ff4014030 con 0x7f70041082a0 2024-09-11T22:39:25.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.712+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f700410a2b0 con 0x7f70041082a0 2024-09-11T22:39:25.713 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:25 smithi022 ceph-mon[30966]: pgmap v323: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:25.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.712+0000 7f6ffbfff640 1 -- 172.21.15.22:0/3062879056 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f6ff409c0f0 con 0x7f70041082a0 2024-09-11T22:39:25.714 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:25.714 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:39:25.714 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 msgr2=0x7f6ff00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 0x7f6ff00a51b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005c40 tx=0x7f6ffc00a390 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 msgr2=0x7f700419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c970 tx=0x7f6ff400ce30 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 shutdown_connections 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f6ff00a2cf0 0x7f6ff00a51b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70041082a0 0x7f700419cf40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70041036e0 0x7f7004198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 --2- 172.21.15.22:0/3062879056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7004102d30 0x7f7004198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 >> 172.21.15.22:0/3062879056 conn(0x7f70040fc7d0 msgr2=0x7f7004105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:25.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 shutdown_connections 2024-09-11T22:39:25.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:25.715+0000 7f7009624640 1 -- 172.21.15.22:0/3062879056 wait complete. 2024-09-11T22:39:25.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:25 smithi169 ceph-mon[35628]: pgmap v323: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:25.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:25 smithi045 ceph-mon[35556]: pgmap v323: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:26.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T22:39:26.631 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:26.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:26 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3062879056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:26.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:26 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3062879056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:26.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:26 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3062879056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3853446632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac102da0 msgr2=0x7ff6ac103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3853446632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac102da0 0x7ff6ac103180 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009900 tx=0x7ff6a802a480 comp rx=0 tx=0).stop 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3853446632 shutdown_connections 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3853446632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac10c180 0x7ff6ac10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3853446632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3853446632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac102da0 0x7ff6ac103180 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3853446632 >> 172.21.15.22:0/3853446632 conn(0x7ff6ac0fc7a0 msgr2=0x7ff6ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3853446632 shutdown_connections 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3853446632 wait complete. 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 Processor -- start 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.095+0000 7ff6b3bd2640 1 -- start start 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 0x7ff6ac100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac10c180 0x7ff6ac101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1120e0 con 0x7ff6ac1036c0 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac111f60 con 0x7ff6ac10c180 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b3bd2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112260 con 0x7ff6ac102da0 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36064/0 (socket says 172.21.15.22:36064) 2024-09-11T22:39:27.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 -- 172.21.15.22:0/3960046792 learned_addr learned my addr 172.21.15.22:0/3960046792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b216f640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac10c180 0x7ff6ac101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b196e640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 0x7ff6ac100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 -- 172.21.15.22:0/3960046792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 msgr2=0x7ff6ac100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 0x7ff6ac100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 -- 172.21.15.22:0/3960046792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac10c180 msgr2=0x7ff6ac101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac10c180 0x7ff6ac101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 -- 172.21.15.22:0/3960046792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a6a40 con 0x7ff6ac1036c0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b196e640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 0x7ff6ac100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6b116d640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b4a0 tx=0x7ff69c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.096+0000 7ff6a2ffd640 1 -- 172.21.15.22:0/3960046792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c014070 con 0x7ff6ac1036c0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.097+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a6d30 con 0x7ff6ac1036c0 2024-09-11T22:39:27.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.097+0000 7ff6a2ffd640 1 -- 172.21.15.22:0/3960046792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff69c010b10 con 0x7ff6ac1036c0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.097+0000 7ff6a2ffd640 1 -- 172.21.15.22:0/3960046792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c017d60 con 0x7ff6ac1036c0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.097+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a7210 con 0x7ff6ac1036c0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.099+0000 7ff6a2ffd640 1 -- 172.21.15.22:0/3960046792 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff69c017070 con 0x7ff6ac1036c0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.099+0000 7ff6b5fab740 1 Processor -- start 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.099+0000 7ff6b5fab740 1 -- start start 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac9b40 0x55d20bac8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6a2ffd640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 0x7ff6980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bad3370 0x55d20bad5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d20ba2e2f0 con 0x55d20bac85d0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d20b9d5cf0 con 0x55d20bac9b40 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d20ba2a2b0 con 0x55d20bad3370 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36066/0 (socket says 172.21.15.22:36066) 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 -- 172.21.15.22:0/4053659151 learned_addr learned my addr 172.21.15.22:0/4053659151 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b216f640 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac9b40 0x55d20bac8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b116d640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 0x7ff6980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6a2ffd640 1 -- 172.21.15.22:0/3960046792 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7ff69c0ce7b0 con 0x7ff6ac1036c0 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b216f640 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bad3370 0x55d20bad5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 -- 172.21.15.22:0/4053659151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bad3370 msgr2=0x55d20bad5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bad3370 0x55d20bad5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 -- 172.21.15.22:0/4053659151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac9b40 msgr2=0x55d20bac8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac9b40 0x55d20bac8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 -- 172.21.15.22:0/4053659151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20b9ba3a0 con 0x55d20bac85d0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b116d640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 0x7ff6980a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff69c09aaa0 tx=0x7ff69c090230 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.100+0000 7ff6b196e640 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005ec0 tx=0x7ff6a8032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c678ae0723b87c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff697fff640 1 -- 172.21.15.22:0/4053659151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8035070 con 0x55d20bac85d0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff697fff640 1 -- 172.21.15.22:0/4053659151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6a8041d60 con 0x55d20bac85d0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff697fff640 1 -- 172.21.15.22:0/4053659151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80053c0 con 0x55d20bac85d0 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 -- 172.21.15.22:0/4053659151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 msgr2=0x55d20bac8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8005ec0 tx=0x7ff6a8032d30 comp rx=0 tx=0).stop 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 -- 172.21.15.22:0/4053659151 shutdown_connections 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bad3370 0x55d20bad5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bac85d0 0x55d20bac8a10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/4053659151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac9b40 0x55d20bac8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 -- 172.21.15.22:0/4053659151 >> 172.21.15.22:0/4053659151 conn(0x55d20ba91310 msgr2=0x55d20bac4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 -- 172.21.15.22:0/4053659151 shutdown_connections 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.101+0000 7ff6b5fab740 1 -- 172.21.15.22:0/4053659151 wait complete. 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 -- start start 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 Processor -- start 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bad2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bacfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d20bad6010 con 0x55d20bad3370 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d20b9e9060 con 0x55d20bac85d0 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.102+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d20bad6190 con 0x55d20bac9b40 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b5fab740 10 client.0 _ll_register_callbacks cb 0x55d20b73c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36074/0 (socket says 172.21.15.22:36074) 2024-09-11T22:39:27.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 -- 172.21.15.22:0/2486271473 learned_addr learned my addr 172.21.15.22:0/2486271473 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b196e640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bacfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bad2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 -- 172.21.15.22:0/2486271473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 msgr2=0x55d20bacfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bacfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 -- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 msgr2=0x55d20bad2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bad2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 -- 172.21.15.22:0/2486271473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20b79f3c0 con 0x55d20bad3370 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4013f10 tx=0x7ff6a4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afdd8949335ebf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6957fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4010e50 con 0x55d20bad3370 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a8041d60 con 0x55d20bad3370 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.103+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7ff6a4004b20 con 0x55d20bad3370 2024-09-11T22:39:27.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff6a4004d20 con 0x55d20bad3370 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 10 client.17100 fetch_fsmap learned FSMap version 22 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55d20bae1ae0 con 0x55d20bad3370 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6a8041d60 con 0x55d20bad3370 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff6a4011900 con 0x55d20bad3370 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 10 client.17100 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 20 client.17100 populate_metadata read hostname 'smithi022' 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bae2fa0 0x55d20bae53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 4 client.17100 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d20ba3b860 con 0x55d20bae2fa0 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.104+0000 7ff6b196e640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bae2fa0 0x55d20bae53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.105+0000 7ff6b196e640 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bae2fa0 0x55d20bae53d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13edfeb10c208842 server_cookie=324d54ab9caef2f8 in_seq=0 out_seq=0 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.105+0000 7ff6957fa640 10 client.17100 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.105+0000 7ff6957fa640 1 -- 172.21.15.22:0/2486271473 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d20ba3b860 con 0x55d20bae2fa0 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.105+0000 7ff6957fa640 10 client.17100 handle_command_reply: tid=0 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.105+0000 7ff6b5fab740 1 client.17100 shutdown 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 msgr2=0x55d20bad05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4013f10 tx=0x7ff6a4004ab0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 shutdown_connections 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bae2fa0 0x55d20bae53d0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bad05e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bacfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2486271473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bad2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6957fa640 0 client.17100 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 >> 172.21.15.22:0/2486271473 conn(0x55d20ba91310 msgr2=0x55d20baca930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 shutdown_connections 2024-09-11T22:39:27.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2486271473 wait complete. 2024-09-11T22:39:27.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.106+0000 7ff6b5fab740 20 client.17100 trim_cache size 0 max 16384 2024-09-11T22:39:27.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 Processor -- start 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 -- start start 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bacef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bad1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1a97d0 con 0x55d20bad3370 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1ac030 con 0x55d20bac85d0 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.119+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1a9e20 con 0x55d20bac9b40 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36082/0 (socket says 172.21.15.22:36082) 2024-09-11T22:39:27.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 -- 172.21.15.22:0/2381186380 learned_addr learned my addr 172.21.15.22:0/2381186380 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bacef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b196e640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bad1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 -- 172.21.15.22:0/2381186380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 msgr2=0x55d20bad1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bad1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 -- 172.21.15.22:0/2381186380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 msgr2=0x55d20bacef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bacef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 -- 172.21.15.22:0/2381186380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20bad2960 con 0x55d20bad3370 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b196e640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bad1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6b216f640 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400ae10 tx=0x7ff6a4011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab3ea03c8c41b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6977fe640 1 -- 172.21.15.22:0/2381186380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402c040 con 0x55d20bad3370 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6977fe640 1 -- 172.21.15.22:0/2381186380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6a40138e0 con 0x55d20bad3370 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.120+0000 7ff6977fe640 1 -- 172.21.15.22:0/2381186380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011750 con 0x55d20bad3370 2024-09-11T22:39:27.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2381186380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 msgr2=0x55d20bacb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400ae10 tx=0x7ff6a4011440 comp rx=0 tx=0).stop 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2381186380 shutdown_connections 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacb120 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20bad1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/2381186380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20bacef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2381186380 >> 172.21.15.22:0/2381186380 conn(0x55d20ba91310 msgr2=0x55d20bad1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2381186380 shutdown_connections 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- 172.21.15.22:0/2381186380 wait complete. 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 -- start start 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.121+0000 7ff6b5fab740 1 Processor -- start 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20badb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20badbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1aa4f0 con 0x55d20bad3370 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1ab960 con 0x55d20bac85d0 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1aabc0 con 0x55d20bac9b40 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b5fab740 10 client.0 _ll_register_callbacks cb 0x7ff6a4013680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36098/0 (socket says 172.21.15.22:36098) 2024-09-11T22:39:27.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 -- 172.21.15.22:0/666303197 learned_addr learned my addr 172.21.15.22:0/666303197 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20badb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b196e640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20badbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 -- 172.21.15.22:0/666303197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 msgr2=0x55d20badbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20badbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 -- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 msgr2=0x55d20badb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20badb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.122+0000 7ff6b216f640 1 -- 172.21.15.22:0/666303197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20bacd230 con 0x55d20bad3370 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b216f640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4010710 tx=0x7ff6a40131b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5842ec5ec24e5198 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402c040 con 0x55d20bad3370 2024-09-11T22:39:27.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7ff6a400cb40 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6a40138e0 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff6a4047050 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 10 client.17106 fetch_fsmap learned FSMap version 22 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55d20bb4d7d0 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6a40138e0 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 22) ==== 8330+0+0 (secure 0 0 0) 0x7ff6a40425e0 con 0x55d20bad3370 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 10 client.17106 fetch_fsmap finished waiting for FSMap version 22 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 20 client.17106 populate_metadata read hostname 'smithi022' 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bb4dd30 0x55d20bb50120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 4 client.17106 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.123+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 --> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d20ba35d70 con 0x55d20bb4dd30 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b196e640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bb4dd30 0x55d20bb50120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:27.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b196e640 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bb4dd30 0x55d20bb50120 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e35842946198b61d server_cookie=f49d6dc544b198a4 in_seq=0 out_seq=0 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6957fa640 10 client.17106 ms_handle_connect on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6957fa640 1 -- 172.21.15.22:0/666303197 <== mds.0 v2:172.21.15.45:6838/2293732037 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d20ba35d70 con 0x55d20bb4dd30 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6957fa640 10 client.17106 handle_command_reply: tid=0 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 client.17106 shutdown 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 msgr2=0x55d20bacca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4010710 tx=0x7ff6a40131b0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 shutdown_connections 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:6838/2293732037,v1:172.21.15.45:6839/2293732037] conn(0x55d20bb4dd30 0x55d20bb50120 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d20bad3370 0x55d20bacca00 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6957fa640 0 client.17106 ms_handle_reset on v2:172.21.15.45:6838/2293732037 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d20bac9b40 0x55d20badbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 --2- 172.21.15.22:0/666303197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d20bac85d0 0x55d20badb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.124+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 >> 172.21.15.22:0/666303197 conn(0x55d20ba91310 msgr2=0x55d20bad2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 shutdown_connections 2024-09-11T22:39:27.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b5fab740 1 -- 172.21.15.22:0/666303197 wait complete. 2024-09-11T22:39:27.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b5fab740 20 client.17106 trim_cache size 0 max 16384 2024-09-11T22:39:27.140 INFO:teuthology.orchestra.run.smithi022.stdout:[] 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 msgr2=0x7ff6980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 0x7ff6980a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff69c09aaa0 tx=0x7ff69c090230 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 msgr2=0x7ff6ac100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b4a0 tx=0x7ff69c00b960 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 shutdown_connections 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff6980a2cf0 0x7ff6980a51b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6ac10c180 0x7ff6ac101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6ac1036c0 0x7ff6ac100f40 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 --2- 172.21.15.22:0/3960046792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6ac102da0 0x7ff6ac100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 >> 172.21.15.22:0/3960046792 conn(0x7ff6ac0fc7a0 msgr2=0x7ff6ac0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:27.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 shutdown_connections 2024-09-11T22:39:27.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:27.125+0000 7ff6b3bd2640 1 -- 172.21.15.22:0/3960046792 wait complete. 2024-09-11T22:39:27.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:27 smithi022 ceph-mon[30966]: pgmap v324: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:27.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:27 smithi169 ceph-mon[35628]: pgmap v324: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:27.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:27 smithi045 ceph-mon[35556]: pgmap v324: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T22:39:28.030 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-11T22:39:28.031 INFO:tasks.fwd_scrub:done joining 2024-09-11T22:39:28.031 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T22:39:28.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:39:28.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 -- 172.21.15.22:0/3443108213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20100980 msgr2=0x7fba20100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 --2- 172.21.15.22:0/3443108213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20100980 0x7fba20100de0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fba14009930 tx=0x7fba1402a420 comp rx=0 tx=0).stop 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 -- 172.21.15.22:0/3443108213 shutdown_connections 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 --2- 172.21.15.22:0/3443108213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20101320 0x7fba2010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 --2- 172.21.15.22:0/3443108213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20100980 0x7fba20100de0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 --2- 172.21.15.22:0/3443108213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 0x7fba20106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 -- 172.21.15.22:0/3443108213 >> 172.21.15.22:0/3443108213 conn(0x7fba20077a10 msgr2=0x7fba200fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 -- 172.21.15.22:0/3443108213 shutdown_connections 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.152+0000 7fba25453640 1 -- 172.21.15.22:0/3443108213 wait complete. 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 Processor -- start 2024-09-11T22:39:28.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 -- start start 2024-09-11T22:39:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20100980 0x7fba201984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 0x7fba2019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba20110ef0 con 0x7fba20101320 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fba20110d70 con 0x7fba20106990 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.153+0000 7fba25453640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba20111070 con 0x7fba20100980 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36118/0 (socket says 172.21.15.22:36118) 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 -- 172.21.15.22:0/745161453 learned_addr learned my addr 172.21.15.22:0/745161453 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1f7fe640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 0x7fba2019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1effd640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20100980 0x7fba201984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 -- 172.21.15.22:0/745161453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20100980 msgr2=0x7fba201984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20100980 0x7fba201984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 -- 172.21.15.22:0/745161453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 msgr2=0x7fba2019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 0x7fba2019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 -- 172.21.15.22:0/745161453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2019d4e0 con 0x7fba20101320 2024-09-11T22:39:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba1e7fc640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fba14009230 tx=0x7fba14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1403f030 con 0x7fba20101320 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2019d770 con 0x7fba20101320 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba14003af0 con 0x7fba20101320 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14035070 con 0x7fba20101320 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.154+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba201a5060 con 0x7fba20101320 2024-09-11T22:39:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.155+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba20100de0 con 0x7fba20101320 2024-09-11T22:39:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.157+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fba14042030 con 0x7fba20101320 2024-09-11T22:39:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.157+0000 7fba07fff640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 0x7fba080a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.157+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fba140eff70 con 0x7fba20101320 2024-09-11T22:39:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.157+0000 7fba1effd640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 0x7fba080a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.158+0000 7fba1effd640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 0x7fba080a51c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba10005c40 tx=0x7fba1000a590 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.160+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba140bc560 con 0x7fba20101320 2024-09-11T22:39:28.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.337+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba201a5260 con 0x7fba20101320 2024-09-11T22:39:28.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.338+0000 7fba07fff640 1 -- 172.21.15.22:0/745161453 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23110 (secure 0 0 0) 0x7fba140c0860 con 0x7fba20101320 2024-09-11T22:39:28.339 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:28.339 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":92,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:39:18.379798+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/1813461442":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/1692369784":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4017592669":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1661302101":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3117763107":"2024-09-12T22:29:02.319778+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3117763107":"2024-09-12T22:29:02.319778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 msgr2=0x7fba080a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 0x7fba080a51c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fba10005c40 tx=0x7fba1000a590 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 msgr2=0x7fba20198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fba14009230 tx=0x7fba14004270 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 shutdown_connections 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fba080a2d00 0x7fba080a51c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba20106990 0x7fba2019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba20101320 0x7fba20198a30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 --2- 172.21.15.22:0/745161453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba20100980 0x7fba201984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 >> 172.21.15.22:0/745161453 conn(0x7fba20077a10 msgr2=0x7fba20069420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 shutdown_connections 2024-09-11T22:39:28.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.341+0000 7fba25453640 1 -- 172.21.15.22:0/745161453 wait complete. 2024-09-11T22:39:28.353 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:22:47.028188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:27:20.730565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:27:22.755310+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:39:28.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- 172.21.15.22:0/1658103339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 msgr2=0x7f7d54103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/1658103339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d54103060 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009900 tx=0x7f7d4402a480 comp rx=0 tx=0).stop 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- 172.21.15.22:0/1658103339 shutdown_connections 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/1658103339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d5410c0d0 0x7f7d5410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/1658103339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d541035a0 0x7f7d5410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/1658103339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d54103060 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- 172.21.15.22:0/1658103339 >> 172.21.15.22:0/1658103339 conn(0x7f7d540fc690 msgr2=0x7f7d540feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- 172.21.15.22:0/1658103339 shutdown_connections 2024-09-11T22:39:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- 172.21.15.22:0/1658103339 wait complete. 2024-09-11T22:39:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 Processor -- start 2024-09-11T22:39:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.461+0000 7f7d59fcf640 1 -- start start 2024-09-11T22:39:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d541035a0 0x7f7d54100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d5410c0d0 0x7f7d54101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111fd0 con 0x7f7d54102c80 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54111e50 con 0x7f7d541035a0 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d59fcf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d54112150 con 0x7f7d5410c0d0 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36136/0 (socket says 172.21.15.22:36136) 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 -- 172.21.15.22:0/4176738208 learned_addr learned my addr 172.21.15.22:0/4176738208 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d53fff640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d5410c0d0 0x7f7d54101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d52ffd640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d541035a0 0x7f7d54100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 -- 172.21.15.22:0/4176738208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d5410c0d0 msgr2=0x7f7d54101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d5410c0d0 0x7f7d54101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 -- 172.21.15.22:0/4176738208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d541035a0 msgr2=0x7f7d54100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d541035a0 0x7f7d54100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 -- 172.21.15.22:0/4176738208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d541a6a10 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d537fe640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d44006010 tx=0x7f7d440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.462+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4403f030 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.463+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d44003d00 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.463+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d541a6ca0 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.463+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44035070 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.463+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d541a7190 con 0x7f7d54102c80 2024-09-11T22:39:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.464+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d54103060 con 0x7f7d54102c80 2024-09-11T22:39:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.465+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7d44042030 con 0x7f7d54102c80 2024-09-11T22:39:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.466+0000 7f7d50ff9640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 0x7f7d3c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.466+0000 7f7d52ffd640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 0x7f7d3c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.466+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f7d440ef750 con 0x7f7d54102c80 2024-09-11T22:39:28.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.466+0000 7f7d52ffd640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 0x7f7d3c0a5240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d54102360 tx=0x7f7d48005f90 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.470+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d440bbd40 con 0x7f7d54102c80 2024-09-11T22:39:28.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.646+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d54107140 con 0x7f7d54102c80 2024-09-11T22:39:28.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.647+0000 7f7d50ff9640 1 -- 172.21.15.22:0/4176738208 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f7d440c0040 con 0x7f7d54102c80 2024-09-11T22:39:28.648 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-11T22:39:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 msgr2=0x7f7d3c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 0x7f7d3c0a5240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d54102360 tx=0x7f7d48005f90 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 msgr2=0x7f7d541008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7d44006010 tx=0x7f7d440042f0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 shutdown_connections 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f7d3c0a2d80 0x7f7d3c0a5240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d5410c0d0 0x7f7d54101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d541035a0 0x7f7d54100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 --2- 172.21.15.22:0/4176738208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d54102c80 0x7f7d541008d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 >> 172.21.15.22:0/4176738208 conn(0x7f7d540fc690 msgr2=0x7f7d540fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 shutdown_connections 2024-09-11T22:39:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.649+0000 7f7d59fcf640 1 -- 172.21.15.22:0/4176738208 wait complete. 2024-09-11T22:39:28.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:28 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/745161453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:28.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:39:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- 172.21.15.22:0/1408822950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 msgr2=0x7f43a8101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/1408822950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a8101dd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4398009930 tx=0x7f439802a420 comp rx=0 tx=0).stop 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- 172.21.15.22:0/1408822950 shutdown_connections 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/1408822950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8102310 0x7f43a810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/1408822950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a8101dd0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/1408822950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8107980 0x7f43a8107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- 172.21.15.22:0/1408822950 >> 172.21.15.22:0/1408822950 conn(0x7f43a80fd690 msgr2=0x7f43a80ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- 172.21.15.22:0/1408822950 shutdown_connections 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- 172.21.15.22:0/1408822950 wait complete. 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 Processor -- start 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.767+0000 7f43aeb9d640 1 -- start start 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8102310 0x7f43a8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8107980 0x7f43a819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8111ee0 con 0x7f43a8101970 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8111d60 con 0x7f43a8102310 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43aeb9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112060 con 0x7f43a8107980 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36146/0 (socket says 172.21.15.22:36146) 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 -- 172.21.15.22:0/633296945 learned_addr learned my addr 172.21.15.22:0/633296945 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43ae39c640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8107980 0x7f43a819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43ad39a640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8102310 0x7f43a8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 -- 172.21.15.22:0/633296945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8107980 msgr2=0x7f43a819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8107980 0x7f43a819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 -- 172.21.15.22:0/633296945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8102310 msgr2=0x7f43a8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8102310 0x7f43a8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 -- 172.21.15.22:0/633296945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a819d3c0 con 0x7f43a8101970 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f43adb9b640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d950 tx=0x7f43a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.768+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4017070 con 0x7f43a8101970 2024-09-11T22:39:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.769+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a819d6b0 con 0x7f43a8101970 2024-09-11T22:39:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.769+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43a4009c30 con 0x7f43a8101970 2024-09-11T22:39:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.769+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a400f740 con 0x7f43a8101970 2024-09-11T22:39:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.769+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a4f40 con 0x7f43a8101970 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.769+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a8101dd0 con 0x7f43a8101970 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.771+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f43a4010a80 con 0x7f43a8101970 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.771+0000 7f439effd640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 0x7f43940a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.771+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f43a40cef20 con 0x7f43a8101970 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.772+0000 7f43ad39a640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 0x7f43940a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.772+0000 7f43ad39a640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 0x7f43940a51c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f43980058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:28.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.774+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43a4009de0 con 0x7f43a8101970 2024-09-11T22:39:28.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:28 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/745161453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:28.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:28 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/745161453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:28.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.953+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f43a8109f00 con 0x7f43a8101970 2024-09-11T22:39:28.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.954+0000 7f439effd640 1 -- 172.21.15.22:0/633296945 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f43a409b510 con 0x7f43a8101970 2024-09-11T22:39:28.955 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 msgr2=0x7f43940a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 0x7f43940a51c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f43980058d0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 msgr2=0x7f43a81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d950 tx=0x7f43a400de10 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 shutdown_connections 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f43940a2d00 0x7f43940a51c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43a8107980 0x7f43a819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43a8102310 0x7f43a8198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 --2- 172.21.15.22:0/633296945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a8101970 0x7f43a81983d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 >> 172.21.15.22:0/633296945 conn(0x7f43a80fd690 msgr2=0x7f43a80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:28.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 shutdown_connections 2024-09-11T22:39:28.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:28.956+0000 7f43aeb9d640 1 -- 172.21.15.22:0/633296945 wait complete. 2024-09-11T22:39:28.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:39:29.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 -- 172.21.15.22:0/1234329525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330102c60 msgr2=0x7fb330103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 --2- 172.21.15.22:0/1234329525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330102c60 0x7fb330103040 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb320009900 tx=0x7fb32002a480 comp rx=0 tx=0).stop 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 -- 172.21.15.22:0/1234329525 shutdown_connections 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 --2- 172.21.15.22:0/1234329525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb33010c080 0x7fb33010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 --2- 172.21.15.22:0/1234329525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb330103580 0x7fb33010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 --2- 172.21.15.22:0/1234329525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330102c60 0x7fb330103040 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 -- 172.21.15.22:0/1234329525 >> 172.21.15.22:0/1234329525 conn(0x7fb3300fc6d0 msgr2=0x7fb3300feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 -- 172.21.15.22:0/1234329525 shutdown_connections 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.073+0000 7fb33656d640 1 -- 172.21.15.22:0/1234329525 wait complete. 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 Processor -- start 2024-09-11T22:39:29.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 -- start start 2024-09-11T22:39:29.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 0x7fb3301984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 0x7fb33019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb330111fc0 con 0x7fb330103580 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb330111e40 con 0x7fb33010c080 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb33656d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb330112140 con 0x7fb330102c60 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb32f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36168/0 (socket says 172.21.15.22:36168) 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb32f7fe640 1 -- 172.21.15.22:0/1357251373 learned_addr learned my addr 172.21.15.22:0/1357251373 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb334b0a640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 0x7fb33019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb32f7fe640 1 -- 172.21.15.22:0/1357251373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 msgr2=0x7fb3301984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.074+0000 7fb32ffff640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 0x7fb3301984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32f7fe640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 0x7fb3301984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32f7fe640 1 -- 172.21.15.22:0/1357251373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 msgr2=0x7fb33019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32f7fe640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 0x7fb33019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32f7fe640 1 -- 172.21.15.22:0/1357251373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33019d4e0 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb334b0a640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 0x7fb33019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32ffff640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 0x7fb3301984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32f7fe640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb32400e9f0 tx=0x7fb32400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32400cd80 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb324010930 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33019d7d0 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb324018b00 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.075+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301a5060 con 0x7fb330103580 2024-09-11T22:39:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.076+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330103040 con 0x7fb330103580 2024-09-11T22:39:29.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.077+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb324018ca0 con 0x7fb330103580 2024-09-11T22:39:29.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.078+0000 7fb32d7fa640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 0x7fb3180a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.078+0000 7fb32ffff640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 0x7fb3180a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.079+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fb3240cfc60 con 0x7fb330103580 2024-09-11T22:39:29.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.079+0000 7fb32ffff640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 0x7fb3180a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb320000c00 tx=0x7fb320032c40 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:29.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.082+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb32409c840 con 0x7fb330103580 2024-09-11T22:39:29.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.258+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb33002d7c0 con 0x7fb330103580 2024-09-11T22:39:29.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.258+0000 7fb32d7fa640 1 -- 172.21.15.22:0/1357251373 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7fb32409c140 con 0x7fb330103580 2024-09-11T22:39:29.259 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 msgr2=0x7fb3180a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 0x7fb3180a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb320000c00 tx=0x7fb320032c40 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 msgr2=0x7fb330198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb32400e9f0 tx=0x7fb32400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 shutdown_connections 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb3180a2d00 0x7fb3180a51c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb33010c080 0x7fb33019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb330103580 0x7fb330198a30 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 --2- 172.21.15.22:0/1357251373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb330102c60 0x7fb3301984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 >> 172.21.15.22:0/1357251373 conn(0x7fb3300fc6d0 msgr2=0x7fb3300fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 shutdown_connections 2024-09-11T22:39:29.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.260+0000 7fb33656d640 1 -- 172.21.15.22:0/1357251373 wait complete. 2024-09-11T22:39:29.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T22:39:29.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 -- 172.21.15.22:0/2893818276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8103650 msgr2=0x7ff8e810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2893818276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8103650 0x7ff8e810bb30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009900 tx=0x7ff8d802a480 comp rx=0 tx=0).stop 2024-09-11T22:39:29.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 -- 172.21.15.22:0/2893818276 shutdown_connections 2024-09-11T22:39:29.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2893818276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e810c100 0x7ff8e810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2893818276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8103650 0x7ff8e810bb30 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2893818276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e8102d30 0x7ff8e8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 -- 172.21.15.22:0/2893818276 >> 172.21.15.22:0/2893818276 conn(0x7ff8e80fc6a0 msgr2=0x7ff8e80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 -- 172.21.15.22:0/2893818276 shutdown_connections 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 -- 172.21.15.22:0/2893818276 wait complete. 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.375+0000 7ff8efd31640 1 Processor -- start 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 -- start start 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e8103650 0x7ff8e8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 0x7ff8e819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8111ff0 con 0x7ff8e8102d30 2024-09-11T22:39:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8111e70 con 0x7ff8e8103650 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8efd31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8112170 con 0x7ff8e810c100 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36184/0 (socket says 172.21.15.22:36184) 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 -- 172.21.15.22:0/2646518216 learned_addr learned my addr 172.21.15.22:0/2646518216 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8ed2cc640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e8103650 0x7ff8e8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8ee2ce640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 0x7ff8e819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 -- 172.21.15.22:0/2646518216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 msgr2=0x7ff8e819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 0x7ff8e819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 -- 172.21.15.22:0/2646518216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e8103650 msgr2=0x7ff8e8198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e8103650 0x7ff8e8198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 -- 172.21.15.22:0/2646518216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e819d510 con 0x7ff8e8102d30 2024-09-11T22:39:29.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8ee2ce640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 0x7ff8e819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8edacd640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400d770 tx=0x7ff8e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.376+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4017070 con 0x7ff8e8102d30 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.377+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff8e4005520 con 0x7ff8e8102d30 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.377+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4010460 con 0x7ff8e8102d30 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.377+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e819d800 con 0x7ff8e8102d30 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.377+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81a5090 con 0x7ff8e8102d30 2024-09-11T22:39:29.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.378+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e8103110 con 0x7ff8e8102d30 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.379+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff8e4004ea0 con 0x7ff8e8102d30 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.380+0000 7ff8deffd640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 0x7ff8d40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.380+0000 7ff8ed2cc640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 0x7ff8d40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.380+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7ff8e40ceea0 con 0x7ff8e8102d30 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.380+0000 7ff8ed2cc640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 0x7ff8d40a5240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009230 tx=0x7ff8d80058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.384+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8e409bae0 con 0x7ff8e8102d30 2024-09-11T22:39:29.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.606+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff8e81071b0 con 0x7ff8e8102d30 2024-09-11T22:39:29.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.616+0000 7ff8deffd640 1 -- 172.21.15.22:0/2646518216 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740902 (secure 0 0 0) 0x7ff8e409b3e0 con 0x7ff8e8102d30 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 25, 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "active_gid": 15057, 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "active_name": "x", 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addrs": { 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:29.627 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3304490936 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3304490936 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addr": "172.21.15.22:6801/3304490936", 2024-09-11T22:39:29.628 INFO:teuthology.orchestra.run.smithi022.stdout: "active_change": "2024-09-11T22:29:02.320103+0000", 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "available": true, 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "standbys": [ 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24757, 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "z", 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.629 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.631 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:29.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-11T22:39:29.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-11T22:39:29.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:29.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:29.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:29.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-11T22:39:29.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-11T22:39:29.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-11T22:39:29.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.656 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:29.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:29.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:29.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:29.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-11T22:39:29.665 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:29.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-11T22:39:29.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:29.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-11T22:39:29.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.676 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:29.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:29.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:29.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:29.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-11T22:39:29.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:29.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-11T22:39:29.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-11T22:39:29.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.701 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.702 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.703 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:29.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.710 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-11T22:39:29.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.719 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:29.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:29.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-11T22:39:29.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-11T22:39:29.734 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.735 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.738 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-11T22:39:29.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.742 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:29.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:29.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:29.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.761 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.762 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:29.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:29.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:29.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:29.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.781 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-11T22:39:29.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-11T22:39:29.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.792 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.793 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.794 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.795 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.798 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:29.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:29.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.804 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.806 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.807 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:29.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.810 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.812 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-11T22:39:29.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-11T22:39:29.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.828 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-11T22:39:29.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-11T22:39:29.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.832 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.833 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-11T22:39:29.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.842 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:29.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.851 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.859 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-11T22:39:29.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.874 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-11T22:39:29.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-11T22:39:29.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.878 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.879 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.881 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.896 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.897 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.898 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.898 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.898 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.898 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.898 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.930 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.933 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.934 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.937 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:29.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-11T22:39:29.941 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:29.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.944 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.946 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:29.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:29.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:29.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-11T22:39:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.986 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.987 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.989 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:29.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:29.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:29.993 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.996 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:29.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:29.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:29.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:29.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:29.999 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.000 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.004 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.005 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.006 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.008 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.009 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:30.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.012 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.013 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.017 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.021 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-11T22:39:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.024 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.026 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.027 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.028 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.029 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.032 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.033 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.035 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.036 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-11T22:39:30.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.038 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.039 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.040 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.045 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.046 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.049 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.050 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.052 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.053 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.054 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.055 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.057 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-11T22:39:30.059 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.060 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.061 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.063 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.065 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.066 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.067 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.070 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.072 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:30.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.074 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-11T22:39:30.075 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-11T22:39:30.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.077 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.078 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.079 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.080 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.082 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.084 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24782, 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "y", 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-11T22:39:30.087 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.088 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.089 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.090 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.092 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-11T22:39:30.095 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.099 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-11T22:39:30.099 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.099 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.101 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-11T22:39:30.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.109 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.111 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.112 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.113 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.115 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.116 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-11T22:39:30.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:30.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-11T22:39:30.119 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.120 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.121 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.122 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.123 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.124 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.125 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.126 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:30.128 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.130 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.131 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.134 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.135 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:30.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-11T22:39:30.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:30.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:30.140 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:30.141 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.142 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.145 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.147 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.152 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:30.153 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.154 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.156 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.157 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.161 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.166 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.167 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.169 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.170 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.171 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.172 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.175 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.176 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:30.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.179 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.180 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.184 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.186 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.190 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.191 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.192 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.194 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.197 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-11T22:39:30.198 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.199 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.202 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.205 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.206 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.207 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.208 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.210 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.211 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.213 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.216 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.217 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.219 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:30.220 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:30.221 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:30.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.223 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.226 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.227 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.231 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.234 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.236 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.237 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.241 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.242 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.246 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:30.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.251 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.252 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-11T22:39:30.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:30.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.257 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.258 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-11T22:39:30.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.260 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-11T22:39:30.261 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:30.262 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.263 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.264 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.265 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.266 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.268 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.269 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.270 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.271 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.272 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-11T22:39:30.273 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-11T22:39:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.286 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-11T22:39:30.287 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-11T22:39:30.288 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.289 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.292 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.293 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.294 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.295 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:30.297 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.298 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-11T22:39:30.299 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.300 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.301 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.302 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.303 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.304 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.305 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.306 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.307 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.308 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.310 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.311 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.312 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.313 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:30.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-11T22:39:30.316 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.317 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.318 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.319 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.321 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.322 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.323 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.324 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.325 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.326 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.327 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.328 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-11T22:39:30.329 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-11T22:39:30.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-11T22:39:30.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:30.333 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.337 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.338 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.340 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.341 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.343 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.344 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.345 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.346 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.347 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.348 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.349 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.350 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.351 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.352 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.354 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.355 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.356 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.357 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-11T22:39:30.359 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.360 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.361 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.362 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.363 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.364 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.365 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.366 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.367 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.368 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.369 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.370 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.372 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.373 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.374 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.375 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.376 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.377 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.378 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.379 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.381 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.382 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.384 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.385 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.386 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.387 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.388 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-11T22:39:30.389 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.391 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.392 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.393 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.394 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.395 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.396 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.397 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.398 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.399 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.400 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.401 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:30.403 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.404 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.406 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.407 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.408 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.410 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:30.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:30.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.413 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.415 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.416 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.418 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.420 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.423 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.424 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.428 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.429 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.431 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.433 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.434 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.435 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.436 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-11T22:39:30.437 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.438 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.439 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.444 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.445 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.447 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.448 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.449 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.450 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.451 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-11T22:39:30.452 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-11T22:39:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-11T22:39:30.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.458 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.459 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.461 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.462 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.464 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.467 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.468 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.469 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.470 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.471 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.472 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.473 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.474 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.475 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.480 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.481 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.483 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:30.485 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:30.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:30.487 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:30.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-11T22:39:30.493 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.494 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.495 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.496 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.498 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.500 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.501 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.503 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.504 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.505 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.506 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.507 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.509 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.510 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.512 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.513 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.514 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.516 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.517 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.518 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.520 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.522 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-11T22:39:30.523 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.525 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.526 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.527 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.528 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.529 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.531 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.532 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.533 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.534 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "modules": [ 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-11T22:39:30.535 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "iostat", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "nfs", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "restful", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_schedule" 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.536 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.537 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.538 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.540 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.541 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:30.543 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-11T22:39:30.547 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.548 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.550 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.551 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.553 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:30.554 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.555 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:30.556 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.557 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.558 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.559 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.561 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.562 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.564 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-11T22:39:30.567 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.574 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-11T22:39:30.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-11T22:39:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-11T22:39:30.581 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-11T22:39:30.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-11T22:39:30.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-11T22:39:30.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.587 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:30.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-11T22:39:30.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:30.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:30.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.607 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.612 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.622 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.623 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-11T22:39:30.624 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:30.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-11T22:39:30.626 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-11T22:39:30.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.640 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-11T22:39:30.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-11T22:39:30.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.646 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:30.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:30.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:30.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:30.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:30.660 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:30.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:30.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:30.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.664 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.665 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.666 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.667 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:30.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:30.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:30.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-11T22:39:30.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-11T22:39:30.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-11T22:39:30.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-11T22:39:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:30.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.697 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.711 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.713 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-11T22:39:30.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.725 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.726 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-11T22:39:30.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-11T22:39:30.734 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:30.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:30.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.739 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.751 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-11T22:39:30.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.767 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:30.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.771 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.781 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.782 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.790 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.792 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.794 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.796 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.798 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.800 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.803 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.808 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.810 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.823 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.830 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.831 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.839 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.841 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:30.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-11T22:39:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.847 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.855 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:30.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:30.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.859 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.870 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.871 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.876 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.877 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.881 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.886 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-11T22:39:30.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-11T22:39:30.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-11T22:39:30.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:30.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:30.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.904 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.909 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.910 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.916 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.920 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.924 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.926 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.928 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.931 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:30.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:30.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.934 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.937 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.943 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.944 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.945 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-11T22:39:30.950 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.951 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-11T22:39:30.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-11T22:39:30.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:30.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:30.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.965 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-11T22:39:30.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-11T22:39:30.972 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-11T22:39:30.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.977 INFO:teuthology.orchestra.run.smithi022.stdout: "services": { 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard": "https://172.21.15.22:8443/" 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "always_on_modules": { 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "octopus": [ 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-11T22:39:30.978 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "pacific": [ 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-11T22:39:30.979 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "quincy": [ 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "reef": [ 2024-09-11T22:39:30.980 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "squid": [ 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-11T22:39:30.981 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "last_failure_osd_epoch": 83, 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "active_clients": [ 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-11T22:39:30.982 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2346468751 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "libcephsqlite", 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.983 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4182437965 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 680945578 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.984 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3964516297 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3377071373 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2869821305 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.987 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:30.987 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-11T22:39:30.987 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:30.988 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:29 smithi045 ceph-mon[35556]: pgmap v325: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:39:30.988 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:29 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/4176738208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.988 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:29 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/633296945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:29 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1357251373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:30 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/2646518216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:29 smithi169 ceph-mon[35628]: pgmap v325: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:29 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/4176738208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:29 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/633296945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:29 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1357251373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.989 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:30 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/2646518216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 msgr2=0x7ff8d40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 0x7ff8d40a5240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009230 tx=0x7ff8d80058d0 comp rx=0 tx=0).stop 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 msgr2=0x7ff8e8198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400d770 tx=0x7ff8e400dc30 comp rx=0 tx=0).stop 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 shutdown_connections 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7ff8d40a2d80 0x7ff8d40a5240 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8e810c100 0x7ff8e819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e8103650 0x7ff8e8198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:30.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 --2- 172.21.15.22:0/2646518216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8e8102d30 0x7ff8e8198520 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:30.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 >> 172.21.15.22:0/2646518216 conn(0x7ff8e80fc6a0 msgr2=0x7ff8e80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:30.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 shutdown_connections 2024-09-11T22:39:30.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:29.621+0000 7ff8efd31640 1 -- 172.21.15.22:0/2646518216 wait complete. 2024-09-11T22:39:30.997 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T22:39:30.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T22:39:30.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:29 smithi022 ceph-mon[30966]: pgmap v325: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 101 B/s wr, 3 op/s 2024-09-11T22:39:30.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:29 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/4176738208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:29 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/633296945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:29 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1357251373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:30.998 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:30 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/2646518216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:31.268 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:31.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:31 smithi022 ceph-mon[30966]: pgmap v326: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:31.784 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:31.784 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001687503, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000258424, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:31.785 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 214, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 202, 2024-09-11T22:39:31.786 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1442784, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 123216, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.042300383, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.014641666, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.038528606, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 202, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.017883269, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000088531 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.787 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1442784, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 123216 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 152, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 183888, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:31.788 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.012339015, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.008394010, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001811579, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 149, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.011568743, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000077642 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:31.789 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 183888 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:31.790 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:31.791 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-11T22:39:31.792 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148977, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:31.793 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:31.794 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 212, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1410193, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 212, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 212, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1410193, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:31.795 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:31.796 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:31.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:31.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:31.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:31 smithi169 ceph-mon[35628]: pgmap v326: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:31.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:31 smithi045 ceph-mon[35556]: pgmap v326: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:32.613 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-11T22:39:32.613 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-11T22:39:32.613 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-11T22:39:32.613 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T22:39:32.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T22:39:32.870 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:33.380 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:33.380 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 215, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 205, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1441152, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 125984, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.042506987, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.014493610, 2024-09-11T22:39:33.381 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.039351745, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 204, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.012390784, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000060739 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:33.382 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1441152, 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 6, 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 159, 2024-09-11T22:39:33.383 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3312, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 185216, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.014752219, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.008924247, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.003747355, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:33.384 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 157, 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.018645612, 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000118761 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:33.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 185216 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-11T22:39:33.386 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.000189115, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000117814, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.387 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-11T22:39:33.388 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:33.389 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:33.390 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:33.391 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:33.392 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148955, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-11T22:39:33.393 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:33.394 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-11T22:39:33.395 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-11T22:39:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-11T22:39:33.396 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 217, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1410843, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 217, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 217, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1410843, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:33.397 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:33.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:33.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:33.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:33 smithi022 ceph-mon[30966]: pgmap v327: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:33.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:33 smithi169 ceph-mon[35628]: pgmap v327: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:33.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:33 smithi045 ceph-mon[35556]: pgmap v327: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:34.106 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-11T22:39:34.106 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-11T22:39:34.107 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-11T22:39:34.107 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T22:39:34.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T22:39:34.371 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:34.881 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:34.881 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:34.881 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001437691, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000317031, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:34.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 211, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 201, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1440064, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 123424, 2024-09-11T22:39:34.883 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.040830877, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.014711179, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.039039524, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 200, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010779444, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000053897 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:34.884 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1440064, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 123424 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 6, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 156, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3312, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 184688, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:34.885 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.015171284, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.009180491, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.004037279, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 154, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.013099484, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000085061 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 184688 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:34.887 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:34.888 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-11T22:39:34.889 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148994, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 31, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:34.890 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:34.891 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 213, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1410323, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 213, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 213, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1410323, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:34.892 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:34.893 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:34.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:34.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:34.893 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:35.745 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-11T22:39:35.745 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-11T22:39:35.745 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-11T22:39:35.745 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T22:39:35.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T22:39:35.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:35 smithi022 ceph-mon[30966]: pgmap v328: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:35.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:35 smithi169 ceph-mon[35628]: pgmap v328: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:35.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:35 smithi045 ceph-mon[35556]: pgmap v328: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:36.003 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-11T22:39:36.449 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001443351, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000266200, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:36.450 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 158, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 184944, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.015425294, 2024-09-11T22:39:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.010527713, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002274207, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 155, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010031942, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000064722 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 220, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 208, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1444416, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 127072, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.043233473, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.014042872, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.041022451, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 208, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.016141573, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000077603 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1444416, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 127072 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-11T22:39:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148945, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 29, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-11T22:39:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-11T22:39:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 218, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1410973, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 218, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 218, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1410973, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-11T22:39:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-11T22:39:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-11T22:39:36.461 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-11T22:39:37.162 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-11T22:39:37.163 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-11T22:39:37.163 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-11T22:39:37.163 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T22:39:37.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T22:39:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:39:37.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:37 smithi022 ceph-mon[30966]: pgmap v329: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:37.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:37 smithi169 ceph-mon[35628]: pgmap v329: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:37.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:37 smithi045 ceph-mon[35556]: pgmap v329: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:38.033 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 15999, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 15450, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 5706920, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 65664370, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 36, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 5, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 1.375480771, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.592272843, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.249276202, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.461104897, 2024-09-11T22:39:38.034 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 15449, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 18.248956362, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001181238 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 862, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000162421, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000188 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 307776, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 88784 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.035 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 15605, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 15455, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 6635229, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 74318487, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 172, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 5, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 1.286810541, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.503887980, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.250478600, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.461540889, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 15452, 2024-09-11T22:39:38.036 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 12.281226238, 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000794798 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 377, 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000048133, 2024-09-11T22:39:38.037 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000127 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 88048, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 128736 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 55330, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 100158, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 23138942, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 57338101, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 10, 2024-09-11T22:39:38.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 6, 2024-09-11T22:39:38.039 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 3.642971821, 2024-09-11T22:39:38.039 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 1.699404789, 2024-09-11T22:39:38.039 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 3.661617102, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.245670684, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 100157, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 7.685168066, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000076731 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 119895, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.015303033, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000127 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 20876096, 2024-09-11T22:39:38.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 48829184 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 6437, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 36.364445329, 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.005649284 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10477, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 4.870599985, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000464884 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 25828, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 25828, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 25828, 2024-09-11T22:39:38.042 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 82.976596035, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.003212660 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 0, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 1999, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 20, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 4, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 10711, 2024-09-11T22:39:38.043 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 5968, 2024-09-11T22:39:38.044 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 4743, 2024-09-11T22:39:38.044 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2024-09-11T22:39:38.044 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 505, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 0, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 3, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 4, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 2, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 26961, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 26930, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 0, 2024-09-11T22:39:38.045 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 0, 2024-09-11T22:39:38.046 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 5940, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 4, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 234, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 6, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 5940, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 559, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 19, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 540, 2024-09-11T22:39:38.047 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 5381, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 7158, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 24977, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 23522, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 12451, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 145, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 13551 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.048 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 363, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 11761, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 11398, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:39:38.049 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_quiesce_path": 3, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_quiesce_inode": 4900, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 19, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 24, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2024-09-11T22:39:38.050 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 57286, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 57088, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 57088, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 198, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 1572, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 83, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 82, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 82, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 1, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 1, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 3, 2024-09-11T22:39:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 128950128, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 129139589, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 0, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3557, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 718.873999949, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.202101208 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 0 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 4886, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 16303, 2024-09-11T22:39:38.052 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 11417, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 476, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 799, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 323, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 10711, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 24695, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 13984, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 4, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 12613, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 12609, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 130056, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 231712 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2024-09-11T22:39:38.053 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 28424, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 0, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 25828, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 33, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 0, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 11148, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 18.251214251, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001637173 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 103, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.180959336, 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001756886 2024-09-11T22:39:38.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1051, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 2.196637987, 2024-09-11T22:39:38.055 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002090045 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000378346, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000189173 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.056 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.057 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10, 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.002523132, 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000252313 2024-09-11T22:39:38.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 623, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.451470895, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000724672 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 10, 2024-09-11T22:39:38.059 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.879273908, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.187927390 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000203191, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000203191 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1105, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 2.323702300, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002102898 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.060 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.002011885, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001005942 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.061 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 617, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 8.483762305, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.013750019 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 4, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.013970527, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.003492631 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.062 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000724198, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000724198 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2024-09-11T22:39:38.063 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 7, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.019211970, 2024-09-11T22:39:38.064 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002744567 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 11144, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 49.170551804, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.004412289 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:39:38.065 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 2, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 5, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 3, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 2, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 143, 2024-09-11T22:39:38.066 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 71, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 603, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "mdthresh_evicted": 0 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:38.067 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:38.068 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:38.069 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 3384306, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 5685, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 8032, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 177, 2024-09-11T22:39:38.070 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 20109778, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 319211, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2024-09-11T22:39:38.071 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 36767, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 149268070, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 32, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 36767, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 36767, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 2275.835045511, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.061898850 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 36767, 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 65945 2024-09-11T22:39:38.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 36767, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 6080, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 30687, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 1200, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 12751, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 121, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 3659, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 108, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2024-09-11T22:39:38.073 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 20, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 12044, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 5959, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 25502, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2024-09-11T22:39:38.074 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2024-09-11T22:39:38.075 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 92, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 12, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 12, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 12, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2024-09-11T22:39:38.076 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 3992, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 0, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 589 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 1, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 4646 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2024-09-11T22:39:38.077 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 40, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 32, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed_ops": 11446, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 11398, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 86930, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 25118519, 2024-09-11T22:39:38.078 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 86930, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 86930, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 25118519, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:38.079 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 36767, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 150455292, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 36767, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 150455292, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.080 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:38.081 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 36767, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 36767, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 36767, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 36767, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:38.082 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 11398, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1187222, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 11398, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 102, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1187222, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:38.083 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x55d89f1e6960": { 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 57286, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 124945285, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 57286, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 3557, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 124945285, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:38.084 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:38.085 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:38.085 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.085 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:38.085 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-11T22:39:38.871 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-11T22:39:38.871 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-11T22:39:38.871 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-11T22:39:38.871 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T22:39:38.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T22:39:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:39:39.763 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-11T22:39:39.763 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:39.763 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.003118586, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000037137, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002237886, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.004044773, 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001348257 2024-09-11T22:39:39.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 158, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:39.765 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 184944, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.011271040, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.007427902, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.001659977, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 155, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.009101338, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000058718 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:39.766 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 215, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 205, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1441152, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 125984, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.039978459, 2024-09-11T22:39:39.767 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.014367587, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.039460342, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 204, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.011911823, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000058391 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.768 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1441152, 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-11T22:39:39.769 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:39.770 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:39.771 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 148977, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:39.772 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 217, 2024-09-11T22:39:39.774 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1410843, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 217, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 217, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1410843, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:39.775 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-11T22:39:39.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:39 smithi022 ceph-mon[30966]: pgmap v330: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:39.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:39 smithi169 ceph-mon[35628]: pgmap v330: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:39.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:39 smithi045 ceph-mon[35556]: pgmap v330: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:40.362 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-11T22:39:40.363 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-11T22:39:40.363 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-11T22:39:40.363 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T22:39:40.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T22:39:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:39:41.121 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-11T22:39:41.121 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:41.121 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 1486, 2024-09-11T22:39:41.121 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 1488, 2024-09-11T22:39:41.121 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 20506944, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 472558, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 7, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.131503263, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.042024473, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.042369625, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.037685653, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1486, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.050445631, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000033947 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:41.122 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 242, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 239, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 21502649, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 113170, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 4, 2024-09-11T22:39:41.123 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.041140260, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.011610196, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.028827465, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.001813944, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 239, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.018705433, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000078265 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 198448, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 85120 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 25, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 127, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 12589501, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 273505, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 4, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.018352272, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.004685136, 2024-09-11T22:39:41.125 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.011731933, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000557837, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 125, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.007694730, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000061557 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:39:41.126 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 265872 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 2628, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.120317932, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000045783 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.127 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 0, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 0, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.128 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 13513, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 7562, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 5951, 2024-09-11T22:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 374, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 2, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 0, 2024-09-11T22:39:41.130 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 4, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 234, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 6, 2024-09-11T22:39:41.131 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:39:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 0 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 0, 2024-09-11T22:39:41.133 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2024-09-11T22:39:41.134 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "evlrg": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2024-09-11T22:39:41.135 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 25017, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 2, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segmjr": 6, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 128950128, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 129139589, 2024-09-11T22:39:41.136 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 129139477, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 25017 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 3313, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 9540, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 6227, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 356, 2024-09-11T22:39:41.137 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 639, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 283, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 13513, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 16378, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 2865, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 0, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 0, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 0, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 75620, 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 215328 2024-09-11T22:39:41.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.139 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.140 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.141 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.142 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.143 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.144 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.145 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.146 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2024-09-11T22:39:41.147 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.150 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 2, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 2, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2024-09-11T22:39:41.151 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 1895, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "mdthresh_evicted": 0 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:41.152 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:41.153 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 344957, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 3614, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 8032, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 177, 2024-09-11T22:39:41.155 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 17859883, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 210317, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2024-09-11T22:39:41.156 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 1598, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 26, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 4, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 1598, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1598, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.728987972, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000456187 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1598, 2024-09-11T22:39:41.157 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1599 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 1598, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 1598, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 1032, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 563, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2024-09-11T22:39:41.158 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 2, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2024-09-11T22:39:41.159 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2024-09-11T22:39:41.160 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 92, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 8, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 8, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 8, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2024-09-11T22:39:41.161 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 0, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 2, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 0 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 0, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 0 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2024-09-11T22:39:41.162 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed_ops": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 1749, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 54431013, 2024-09-11T22:39:41.163 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 1749, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 1749, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 54431013, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:41.164 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 1598, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 53950727, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 1598, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 53950727, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.165 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 1598, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 1598, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 1598, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1598, 2024-09-11T22:39:41.166 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:41.167 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x55697ca38b40": { 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:41.168 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:41.169 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-11T22:39:41.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:41 smithi022 ceph-mon[30966]: pgmap v331: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:41.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:41 smithi169 ceph-mon[35628]: pgmap v331: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:41.903 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:41 smithi045 ceph-mon[35556]: pgmap v331: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:41.928 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-11T22:39:41.928 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-11T22:39:41.929 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T22:39:41.929 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T22:39:41.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T22:39:42.177 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:39:42.658 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-11T22:39:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 219, 2024-09-11T22:39:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 209, 2024-09-11T22:39:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1442240, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 128544, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.041737776, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.014975047, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.039157439, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 208, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.012890289, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000061972 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1442240, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 160, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 185296, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.011340517, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.007419879, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.001586599, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 157, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.012538589, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000079863 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.002302263, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000035313, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002259824, 2024-09-11T22:39:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.004102785, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001367595 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 148945, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 29, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-11T22:39:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 221, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1411363, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 221, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 221, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1411363, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-11T22:39:42.669 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-11T22:39:43.339 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-11T22:39:43.339 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-11T22:39:43.339 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-11T22:39:43.339 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T22:39:43.340 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T22:39:43.599 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:39:43.890 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:43 smithi169 ceph-mon[35628]: pgmap v332: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:43.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:43 smithi022 ceph-mon[30966]: pgmap v332: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:43.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:43 smithi045 ceph-mon[35556]: pgmap v332: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:44.092 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-11T22:39:44.092 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:44.092 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.003176779, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000035346, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002297580, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.004136620, 2024-09-11T22:39:44.093 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001378873 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 215, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 205, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1441152, 2024-09-11T22:39:44.094 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 125984, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.040390400, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.016087356, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.035317011, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 204, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.012496047, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000061255 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:44.095 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1441152, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 158, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 184944, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:44.096 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.010818449, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.007147051, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.001499094, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 155, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.017967719, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000115920 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:44.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 184944 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:44.098 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:44.099 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:44.100 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 148985, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:44.101 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:44.102 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 217, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1410843, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 217, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 217, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1410843, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:44.103 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:44.104 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:44.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:44.104 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:44.104 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-11T22:39:44.990 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-11T22:39:44.990 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-11T22:39:44.990 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-11T22:39:44.990 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T22:39:44.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T22:39:45.242 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:39:45.787 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 0, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 2, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 0, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.001098501, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:39:45.788 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.000257191, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:39:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 6, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 160, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 3312, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 185392, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.013100099, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.007711089, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.003227289, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:45.790 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 158, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.016061203, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000101653 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 185392 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.791 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 216, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 206, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1441424, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 126624, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.041831958, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.015923919, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.039728599, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 205, 2024-09-11T22:39:45.792 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.012761469, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000062251 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1441424, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 126624 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-11T22:39:45.793 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:45.794 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:45.795 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:45.796 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 149007, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-11T22:39:45.797 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:45.798 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-11T22:39:45.799 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 218, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1410973, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 218, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 218, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1410973, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:45.800 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:45.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:45.801 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:45.801 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-11T22:39:45.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:45 smithi022 ceph-mon[30966]: pgmap v333: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:45.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:45 smithi169 ceph-mon[35628]: pgmap v333: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:45.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:45 smithi045 ceph-mon[35556]: pgmap v333: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:46.431 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-11T22:39:46.431 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-11T22:39:46.431 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-11T22:39:46.431 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T22:39:46.431 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T22:39:46.677 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:47.151 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.003090841, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000040987, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002164844, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.003967720, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001322573 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:47.152 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 157, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 184768, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:47.153 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.013153501, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.007177201, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.003879832, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 154, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.011037708, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000071673 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:47.154 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 184768 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 215, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 205, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1441152, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 125984, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.038581942, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.014820812, 2024-09-11T22:39:47.155 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.034929811, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 204, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.012456890, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000061063 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1441152, 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-11T22:39:47.156 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:47.157 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:47.158 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:47.159 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 149007, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:47.160 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-11T22:39:47.161 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 217, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1410843, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 217, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 217, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1410843, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:47.162 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:47.163 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-11T22:39:47.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:47 smithi022 ceph-mon[30966]: pgmap v334: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:47.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:47 smithi169 ceph-mon[35628]: pgmap v334: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:47.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:47 smithi045 ceph-mon[35556]: pgmap v334: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:47.952 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.i 2024-09-11T22:39:47.952 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.i 2024-09-11T22:39:47.952 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.i 2024-09-11T22:39:47.952 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T22:39:47.953 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T22:39:48.200 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:39:48.700 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-11T22:39:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 221, 2024-09-11T22:39:48.700 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 211, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 1442784, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 129824, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.040954860, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.014722316, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.038853582, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 210, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.014583948, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000069447 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.701 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 1442784, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 129824 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 2, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 162, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 320, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 185648, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:48.702 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.012087696, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.008200906, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.001482371, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 159, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.012254413, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000077071 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:48.703 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 185648 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:48.704 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.002435866, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000036133, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002408578, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.004196657, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001398885 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.705 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:48.706 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:48.707 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:48.708 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 149001, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 31, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-11T22:39:48.709 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-11T22:39:48.710 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 223, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1411623, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 223, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 223, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1411623, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:48.711 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-11T22:39:48.712 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-11T22:39:49.504 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-11T22:39:49.504 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-11T22:39:49.504 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-11T22:39:49.505 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T22:39:50.038 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T22:39:50.039 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:39:50.039 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:39:50.040 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:49 smithi045 ceph-mon[35556]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:50.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:49 smithi022 ceph-mon[30966]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:50.041 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:49 smithi169 ceph-mon[35628]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T22:39:50.062 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-11T22:39:50.062 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:39:50.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T22:39:50.432 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/2317740897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf2810c170 msgr2=0x7fcf2810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/2317740897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf2810c170 0x7fcf2810e610 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009ca0 tx=0x7fcf2002a950 comp rx=0 tx=0).stop 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/2317740897 shutdown_connections 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/2317740897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf2810c170 0x7fcf2810e610 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/2317740897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf28103660 0x7fcf2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/2317740897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28102d40 0x7fcf28103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/2317740897 >> 172.21.15.22:0/2317740897 conn(0x7fcf280fc7a0 msgr2=0x7fcf280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/2317740897 shutdown_connections 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.019+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/2317740897 wait complete. 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 Processor -- start 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 -- start start 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28103660 0x7fcf28100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf2810c170 0x7fcf28101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf28112070 con 0x7fcf28102d40 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcf28111ef0 con 0x7fcf28103660 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2cdb0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcf281121f0 con 0x7fcf2810c170 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34152/0 (socket says 172.21.15.22:34152) 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 -- 172.21.15.22:0/1521832306 learned_addr learned my addr 172.21.15.22:0/1521832306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf26d9d640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf2810c170 0x7fcf28101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf25d9b640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28103660 0x7fcf28100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 -- 172.21.15.22:0/1521832306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf2810c170 msgr2=0x7fcf28101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf2810c170 0x7fcf28101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 -- 172.21.15.22:0/1521832306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28103660 msgr2=0x7fcf28100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28103660 0x7fcf28100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.020+0000 7fcf2659c640 1 -- 172.21.15.22:0/1521832306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf281a68d0 con 0x7fcf28102d40 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf2659c640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800ea60 tx=0x7fcf1800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800cde0 con 0x7fcf28102d40 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf180035f0 con 0x7fcf28102d40 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18010720 con 0x7fcf28102d40 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf281a6bc0 con 0x7fcf28102d40 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.021+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf281a7100 con 0x7fcf28102d40 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.022+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf28103120 con 0x7fcf28102d40 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.023+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcf180037a0 con 0x7fcf28102d40 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.023+0000 7fcf177fe640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 0x7fcf100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.024+0000 7fcf25d9b640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 0x7fcf100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.024+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fcf180cf930 con 0x7fcf28102d40 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.024+0000 7fcf25d9b640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 0x7fcf100a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf28102430 tx=0x7fcf1c005cf0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.028+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf1809c570 con 0x7fcf28102d40 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.214+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf28101ed0 con 0x7fcf28102d40 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.215+0000 7fcf177fe640 1 -- 172.21.15.22:0/1521832306 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v92) ==== 81+0+944 (secure 0 0 0) 0x7fcf1809be70 con 0x7fcf28102d40 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1813461442 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1692369784 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4017592669 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/751358539 2024-09-12T22:20:02.899009+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3167992537 2024-09-12T22:20:02.899009+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3254833025 2024-09-12T22:20:02.899009+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/692024919 2024-09-12T22:20:26.526826+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1255471242 2024-09-12T22:20:26.526826+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1955487578 2024-09-12T22:20:02.899009+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3544100501 2024-09-12T22:20:26.526826+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1661302101 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4254056361 2024-09-12T22:20:26.526826+0000 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3544100501 2024-09-12T22:20:26.526826+0000 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3117763107 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3167992537 2024-09-12T22:20:02.899009+0000 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3117763107 2024-09-12T22:29:02.319778+0000 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:listed 16 entries 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.216+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 msgr2=0x7fcf100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.216+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 0x7fcf100a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf28102430 tx=0x7fcf1c005cf0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 msgr2=0x7fcf281009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800ea60 tx=0x7fcf1800ef20 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 shutdown_connections 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fcf100a2cf0 0x7fcf100a51b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf2810c170 0x7fcf28101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf28103660 0x7fcf28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 --2- 172.21.15.22:0/1521832306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf28102d40 0x7fcf281009a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 >> 172.21.15.22:0/1521832306 conn(0x7fcf280fc7a0 msgr2=0x7fcf280fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 shutdown_connections 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:51.217+0000 7fcf2cdb0640 1 -- 172.21.15.22:0/1521832306 wait complete. 2024-09-11T22:39:51.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:51 smithi022 ceph-mon[30966]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:51.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:51 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1521832306' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:39:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:51 smithi169 ceph-mon[35628]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:51.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:51 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1521832306' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:39:51.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:51 smithi045 ceph-mon[35556]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:51.913 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:51 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1521832306' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:39:51.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:39:51.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:39:52.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:39:52.032 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:39:52.071 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:39:52.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:39:52.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-11T22:39:52.289 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T22:39:52.299 INFO:tasks.cephadm:Teardown begin 2024-09-11T22:39:52.299 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:39:52.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:39:52.560 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 -- 172.21.15.22:0/2628513372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68101df0 msgr2=0x7f8b681021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/2628513372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68101df0 0x7f8b681021d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009900 tx=0x7f8b5802a410 comp rx=0 tx=0).stop 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 -- 172.21.15.22:0/2628513372 shutdown_connections 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/2628513372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68106f20 0x7f8b6810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/2628513372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 0x7f8b681067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/2628513372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68101df0 0x7f8b681021d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 -- 172.21.15.22:0/2628513372 >> 172.21.15.22:0/2628513372 conn(0x7f8b680fd8f0 msgr2=0x7f8b680ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 -- 172.21.15.22:0/2628513372 shutdown_connections 2024-09-11T22:39:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.103+0000 7f8b6edd8640 1 -- 172.21.15.22:0/2628513372 wait complete. 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 Processor -- start 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 -- start start 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68101df0 0x7f8b680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 0x7f8b68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b68112060 con 0x7f8b68106f20 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8b68111ee0 con 0x7f8b68101df0 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6edd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8b681121e0 con 0x7f8b681027a0 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34170/0 (socket says 172.21.15.22:34170) 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 -- 172.21.15.22:0/3791465530 learned_addr learned my addr 172.21.15.22:0/3791465530 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b67fff640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 0x7f8b68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6cb74640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68101df0 0x7f8b680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 -- 172.21.15.22:0/3791465530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 msgr2=0x7f8b68074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 0x7f8b68074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 -- 172.21.15.22:0/3791465530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68101df0 msgr2=0x7f8b680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68101df0 0x7f8b680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.104+0000 7f8b6d375640 1 -- 172.21.15.22:0/3791465530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b681a6920 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b6d375640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000eaa0 tx=0x7f8b6000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60004d20 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b60005020 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b681a6c10 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b600116b0 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.105+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b681a7100 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.106+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b681021d0 con 0x7f8b68106f20 2024-09-11T22:39:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.107+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8b600051d0 con 0x7f8b68106f20 2024-09-11T22:39:53.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.108+0000 7f8b65ffb640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 0x7f8b500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:53.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.108+0000 7f8b6cb74640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 0x7f8b500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:53.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.108+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f8b600cf5c0 con 0x7f8b68106f20 2024-09-11T22:39:53.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.108+0000 7f8b6cb74640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 0x7f8b500a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009230 tx=0x7f8b580058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:53.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.112+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b60016030 con 0x7f8b68106f20 2024-09-11T22:39:53.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.322+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b6802d7c0 con 0x7f8b68106f20 2024-09-11T22:39:53.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.323+0000 7f8b65ffb640 1 -- 172.21.15.22:0/3791465530 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f8b6009c200 con 0x7f8b68106f20 2024-09-11T22:39:53.325 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:53.325 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:39:53.325 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:39:53.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 msgr2=0x7f8b500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:53.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 0x7f8b500a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009230 tx=0x7f8b580058d0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 msgr2=0x7f8b68074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000eaa0 tx=0x7f8b6000eea0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 shutdown_connections 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f8b500a2cf0 0x7f8b500a51b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b68106f20 0x7f8b68074f70 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b681027a0 0x7f8b68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 --2- 172.21.15.22:0/3791465530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b68101df0 0x7f8b680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 >> 172.21.15.22:0/3791465530 conn(0x7f8b680fd8f0 msgr2=0x7f8b680fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 shutdown_connections 2024-09-11T22:39:53.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:53.325+0000 7f8b6edd8640 1 -- 172.21.15.22:0/3791465530 wait complete. 2024-09-11T22:39:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:53 smithi022 ceph-mon[30966]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:53.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:53 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3791465530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:53.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:53 smithi169 ceph-mon[35628]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:53.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:53 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3791465530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:53.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:53 smithi045 ceph-mon[35556]: pgmap v337: 97 pgs: 97 active+clean; 5.5 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T22:39:53.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:53 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3791465530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:53.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:39:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.719+0000 7f632dfed640 1 -- 172.21.15.22:0/1683510157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328101400 msgr2=0x7f632810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.719+0000 7f632dfed640 1 --2- 172.21.15.22:0/1683510157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328101400 0x7f632810d930 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6320009cd0 tx=0x7f632002a8e0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 -- 172.21.15.22:0/1683510157 shutdown_connections 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 --2- 172.21.15.22:0/1683510157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328101400 0x7f632810d930 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 --2- 172.21.15.22:0/1683510157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 0x7f6328100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 --2- 172.21.15.22:0/1683510157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328106a60 0x7f6328106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 -- 172.21.15.22:0/1683510157 >> 172.21.15.22:0/1683510157 conn(0x7f63280fc780 msgr2=0x7f63280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 -- 172.21.15.22:0/1683510157 shutdown_connections 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 -- 172.21.15.22:0/1683510157 wait complete. 2024-09-11T22:39:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.720+0000 7f632dfed640 1 Processor -- start 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 -- start start 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 0x7f6328198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328101400 0x7f63281989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6328110fc0 con 0x7f6328106a60 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6328110e40 con 0x7f6328100a60 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f632dfed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6328111140 con 0x7f6328101400 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45738/0 (socket says 172.21.15.22:45738) 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 -- 172.21.15.22:0/664342797 learned_addr learned my addr 172.21.15.22:0/664342797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f63277fe640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 0x7f6328198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6326ffd640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328101400 0x7f63281989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 -- 172.21.15.22:0/664342797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328101400 msgr2=0x7f63281989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328101400 0x7f63281989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 -- 172.21.15.22:0/664342797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 msgr2=0x7f6328198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 0x7f6328198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 -- 172.21.15.22:0/664342797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632819d440 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.721+0000 7f6327fff640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6320009df0 tx=0x7f6320032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.722+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320004240 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.722+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632819d6d0 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.722+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6320003e20 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.722+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63200466e0 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.722+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63281a5010 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.723+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6328100ec0 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.724+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f63200307c0 con 0x7f6328106a60 2024-09-11T22:39:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.725+0000 7f6324ff9640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 0x7f63100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.725+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f632002e030 con 0x7f6328106a60 2024-09-11T22:39:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.725+0000 7f63277fe640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 0x7f63100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.725+0000 7f63277fe640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 0x7f63100a51b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6318009990 tx=0x7f6318009110 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.729+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f632004b060 con 0x7f6328106a60 2024-09-11T22:39:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.944+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6328062e50 con 0x7f6328106a60 2024-09-11T22:39:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.945+0000 7f6324ff9640 1 -- 172.21.15.22:0/664342797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11838 (secure 0 0 0) 0x7f63200bd860 con 0x7f6328106a60 2024-09-11T22:39:54.947 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:54.947 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"btime":"2024-09-11T22:31:25:880011+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3220963127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3220963127},{"type":"v1","addr":"172.21.15.22:6835","nonce":3220963127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3026054305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3026054305},{"type":"v1","addr":"172.21.15.22:6837","nonce":3026054305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14586,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/816349269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":816349269},{"type":"v1","addr":"172.21.15.22:6839","nonce":816349269}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/7353610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":7353610},{"type":"v1","addr":"172.21.15.22:6841","nonce":7353610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/1952933585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1952933585},{"type":"v1","addr":"172.21.15.169:6833","nonce":1952933585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/2686078352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2686078352},{"type":"v1","addr":"172.21.15.45:6833","nonce":2686078352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1085000680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1085000680},{"type":"v1","addr":"172.21.15.169:6835","nonce":1085000680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/857895339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":857895339},{"type":"v1","addr":"172.21.15.169:6837","nonce":857895339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3694766032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3694766032},{"type":"v1","addr":"172.21.15.45:6835","nonce":3694766032}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/1397643648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":1397643648},{"type":"v1","addr":"172.21.15.169:6839","nonce":1397643648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:27:24.459196+0000","modified":"2024-09-11T22:31:25.880000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6839/2293732037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":2293732037},{"type":"v1","addr":"172.21.15.45:6839","nonce":2293732037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25490":{"gid":25490,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6837/2237272154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2237272154},{"type":"v1","addr":"172.21.15.45:6837","nonce":2237272154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-11T22:39:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 22 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 msgr2=0x7f63100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 0x7f63100a51b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6318009990 tx=0x7f6318009110 comp rx=0 tx=0).stop 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 msgr2=0x7f632819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6320009df0 tx=0x7f6320032c00 comp rx=0 tx=0).stop 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 shutdown_connections 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f63100a2cf0 0x7f63100a51b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6328106a60 0x7f632819cd60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6328101400 0x7f63281989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 --2- 172.21.15.22:0/664342797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6328100a60 0x7f6328198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 >> 172.21.15.22:0/664342797 conn(0x7f63280fc780 msgr2=0x7f63280fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 shutdown_connections 2024-09-11T22:39:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:54.947+0000 7f632dfed640 1 -- 172.21.15.22:0/664342797 wait complete. 2024-09-11T22:39:55.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:39:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:55 smithi022 ceph-mon[30966]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:55.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:55 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/664342797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:55 smithi169 ceph-mon[35628]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:55.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:55 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/664342797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:55.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:55 smithi045 ceph-mon[35556]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:55.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:55 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/664342797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:39:55.988 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:56.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 -- 172.21.15.22:0/408546838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380101420 msgr2=0x7f838010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 --2- 172.21.15.22:0/408546838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380101420 0x7f838010d950 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8378009cd0 tx=0x7f837802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 -- 172.21.15.22:0/408546838 shutdown_connections 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 --2- 172.21.15.22:0/408546838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380101420 0x7f838010d950 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 --2- 172.21.15.22:0/408546838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 0x7f8380100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 --2- 172.21.15.22:0/408546838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380106a80 0x7f8380106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 -- 172.21.15.22:0/408546838 >> 172.21.15.22:0/408546838 conn(0x7f83800fc7a0 msgr2=0x7f83800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 -- 172.21.15.22:0/408546838 shutdown_connections 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.475+0000 7f8387372640 1 -- 172.21.15.22:0/408546838 wait complete. 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 Processor -- start 2024-09-11T22:39:56.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 -- start start 2024-09-11T22:39:56.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 0x7f8380198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:56.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380101420 0x7f83801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:56.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:56.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8380110fa0 con 0x7f8380106a80 2024-09-11T22:39:56.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8380110e20 con 0x7f8380101420 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f8387372640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8380111120 con 0x7f8380100a80 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f838590f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f838590f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45760/0 (socket says 172.21.15.22:45760) 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.476+0000 7f838590f640 1 -- 172.21.15.22:0/865750998 learned_addr learned my addr 172.21.15.22:0/865750998 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838510e640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 0x7f8380198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838490d640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380101420 0x7f83801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 -- 172.21.15.22:0/865750998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 msgr2=0x7f8380198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 0x7f8380198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 -- 172.21.15.22:0/865750998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380101420 msgr2=0x7f83801989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380101420 0x7f83801989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 -- 172.21.15.22:0/865750998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838019d440 con 0x7f8380106a80 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f838590f640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8378006010 tx=0x7f8378003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378004040 con 0x7f8380106a80 2024-09-11T22:39:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83780046e0 con 0x7f8380106a80 2024-09-11T22:39:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838019d6d0 con 0x7f8380106a80 2024-09-11T22:39:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378030da0 con 0x7f8380106a80 2024-09-11T22:39:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.477+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83801a5010 con 0x7f8380106a80 2024-09-11T22:39:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.479+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380100ee0 con 0x7f8380106a80 2024-09-11T22:39:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.480+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f83780305a0 con 0x7f8380106a80 2024-09-11T22:39:56.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.481+0000 7f83767fc640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 0x7f836c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:56.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.481+0000 7f838510e640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 0x7f836c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:56.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.481+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7f837802e030 con 0x7f8380106a80 2024-09-11T22:39:56.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.481+0000 7f838510e640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 0x7f836c0a5230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ab60 tx=0x7f837c00a2d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:56.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.485+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f837804b060 con 0x7f8380106a80 2024-09-11T22:39:56.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.662+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83801a52f0 con 0x7f8380106a80 2024-09-11T22:39:56.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.664+0000 7f83767fc640 1 -- 172.21.15.22:0/865750998 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23110 (secure 0 0 0) 0x7f83780bd490 con 0x7f8380106a80 2024-09-11T22:39:56.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-11T22:39:56.666 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":92,"fsid":"c727338c-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:19:30.932173+0000","modified":"2024-09-11T22:39:18.379798+0000","last_up_change":"2024-09-11T22:26:34.955774+0000","last_in_change":"2024-09-11T22:26:11.089505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:22:47.028188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:27:20.730565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:27:22.755310+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ce2c7a9-daf0-4fe8-b457-6fd038545b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6803","nonce":1086761455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6805","nonce":1086761455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6809","nonce":1086761455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":1086761455},{"type":"v1","addr":"172.21.15.22:6807","nonce":1086761455}]},"public_addr":"172.21.15.22:6803/1086761455","cluster_addr":"172.21.15.22:6805/1086761455","heartbeat_back_addr":"172.21.15.22:6809/1086761455","heartbeat_front_addr":"172.21.15.22:6807/1086761455","state":["exists","up"]},{"osd":1,"uuid":"068e27f1-5aa0-45db-b7b3-510f8a0ad96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6801","nonce":1690638458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6803","nonce":1690638458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6807","nonce":1690638458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":1690638458},{"type":"v1","addr":"172.21.15.45:6805","nonce":1690638458}]},"public_addr":"172.21.15.45:6801/1690638458","cluster_addr":"172.21.15.45:6803/1690638458","heartbeat_back_addr":"172.21.15.45:6807/1690638458","heartbeat_front_addr":"172.21.15.45:6805/1690638458","state":["exists","up"]},{"osd":2,"uuid":"ba0cdee8-b78e-4cff-8899-6108f3a3f633","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6801","nonce":711069925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6803","nonce":711069925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6807","nonce":711069925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":711069925},{"type":"v1","addr":"172.21.15.169:6805","nonce":711069925}]},"public_addr":"172.21.15.169:6801/711069925","cluster_addr":"172.21.15.169:6803/711069925","heartbeat_back_addr":"172.21.15.169:6807/711069925","heartbeat_front_addr":"172.21.15.169:6805/711069925","state":["exists","up"]},{"osd":3,"uuid":"22b6ed2c-e6fe-4acc-86b8-802ab9dc3732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6811","nonce":3656884990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6813","nonce":3656884990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6817","nonce":3656884990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3656884990},{"type":"v1","addr":"172.21.15.22:6815","nonce":3656884990}]},"public_addr":"172.21.15.22:6811/3656884990","cluster_addr":"172.21.15.22:6813/3656884990","heartbeat_back_addr":"172.21.15.22:6817/3656884990","heartbeat_front_addr":"172.21.15.22:6815/3656884990","state":["exists","up"]},{"osd":4,"uuid":"d411e693-5da4-47da-b529-f9d158ac5586","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6809","nonce":2265581210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6811","nonce":2265581210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6815","nonce":2265581210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":2265581210},{"type":"v1","addr":"172.21.15.45:6813","nonce":2265581210}]},"public_addr":"172.21.15.45:6809/2265581210","cluster_addr":"172.21.15.45:6811/2265581210","heartbeat_back_addr":"172.21.15.45:6815/2265581210","heartbeat_front_addr":"172.21.15.45:6813/2265581210","state":["exists","up"]},{"osd":5,"uuid":"19566e6c-1e79-48d6-ba3b-2e61d38e21fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6809","nonce":3288251566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6811","nonce":3288251566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6815","nonce":3288251566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":3288251566},{"type":"v1","addr":"172.21.15.169:6813","nonce":3288251566}]},"public_addr":"172.21.15.169:6809/3288251566","cluster_addr":"172.21.15.169:6811/3288251566","heartbeat_back_addr":"172.21.15.169:6815/3288251566","heartbeat_front_addr":"172.21.15.169:6813/3288251566","state":["exists","up"]},{"osd":6,"uuid":"231d0816-5eb1-4a2c-aced-20a92e18523b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6819","nonce":3560259389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6821","nonce":3560259389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6825","nonce":3560259389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3560259389},{"type":"v1","addr":"172.21.15.22:6823","nonce":3560259389}]},"public_addr":"172.21.15.22:6819/3560259389","cluster_addr":"172.21.15.22:6821/3560259389","heartbeat_back_addr":"172.21.15.22:6825/3560259389","heartbeat_front_addr":"172.21.15.22:6823/3560259389","state":["exists","up"]},{"osd":7,"uuid":"65301ecd-9ff7-4221-bfb2-fffea68443e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6817","nonce":1044507788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6819","nonce":1044507788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6823","nonce":1044507788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":1044507788},{"type":"v1","addr":"172.21.15.45:6821","nonce":1044507788}]},"public_addr":"172.21.15.45:6817/1044507788","cluster_addr":"172.21.15.45:6819/1044507788","heartbeat_back_addr":"172.21.15.45:6823/1044507788","heartbeat_front_addr":"172.21.15.45:6821/1044507788","state":["exists","up"]},{"osd":8,"uuid":"59a824e3-0c3e-4315-86e2-e3a1684c94b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6817","nonce":3945465196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6819","nonce":3945465196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6823","nonce":3945465196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":3945465196},{"type":"v1","addr":"172.21.15.169:6821","nonce":3945465196}]},"public_addr":"172.21.15.169:6817/3945465196","cluster_addr":"172.21.15.169:6819/3945465196","heartbeat_back_addr":"172.21.15.169:6823/3945465196","heartbeat_front_addr":"172.21.15.169:6821/3945465196","state":["exists","up"]},{"osd":9,"uuid":"ba20c169-e5d6-418a-82b3-ee96748875d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6827","nonce":3132615329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6829","nonce":3132615329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6833","nonce":3132615329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3132615329},{"type":"v1","addr":"172.21.15.22:6831","nonce":3132615329}]},"public_addr":"172.21.15.22:6827/3132615329","cluster_addr":"172.21.15.22:6829/3132615329","heartbeat_back_addr":"172.21.15.22:6833/3132615329","heartbeat_front_addr":"172.21.15.22:6831/3132615329","state":["exists","up"]},{"osd":10,"uuid":"ed65f590-5c01-40d7-83dc-681d043f5203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6825","nonce":963190759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6827","nonce":963190759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6831","nonce":963190759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":963190759},{"type":"v1","addr":"172.21.15.45:6829","nonce":963190759}]},"public_addr":"172.21.15.45:6825/963190759","cluster_addr":"172.21.15.45:6827/963190759","heartbeat_back_addr":"172.21.15.45:6831/963190759","heartbeat_front_addr":"172.21.15.45:6829/963190759","state":["exists","up"]},{"osd":11,"uuid":"eb6aa919-e469-40a8-a10a-533d098108e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6825","nonce":1239026325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6827","nonce":1239026325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6831","nonce":1239026325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1239026325},{"type":"v1","addr":"172.21.15.169:6829","nonce":1239026325}]},"public_addr":"172.21.15.169:6825/1239026325","cluster_addr":"172.21.15.169:6827/1239026325","heartbeat_back_addr":"172.21.15.169:6831/1239026325","heartbeat_front_addr":"172.21.15.169:6829/1239026325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:21:52.971052+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:18.940554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:44.157334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:10.399376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:36.458961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:01.189259+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:27.438580+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:52.746511+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:17.286998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:43.523959+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:08.147029+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:32.591774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/1813461442":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/1692369784":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4017592669":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/751358539":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6800/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/3254833025":"2024-09-12T22:20:02.899009+0000","172.21.15.22:0/692024919":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1255471242":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1955487578":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:0/1661302101":"2024-09-12T22:29:02.319778+0000","172.21.15.22:0/4254056361":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3544100501":"2024-09-12T22:20:26.526826+0000","172.21.15.22:6800/3117763107":"2024-09-12T22:29:02.319778+0000","172.21.15.22:6801/3167992537":"2024-09-12T22:20:02.899009+0000","172.21.15.22:6801/3117763107":"2024-09-12T22:29:02.319778+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:39:56.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 msgr2=0x7f836c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:56.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 0x7f836c0a5230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f837c00ab60 tx=0x7f837c00a2d0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 msgr2=0x7f838019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8378006010 tx=0x7f8378003f10 comp rx=0 tx=0).stop 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 shutdown_connections 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f836c0a2d70 0x7f836c0a5230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8380106a80 0x7f838019cd60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380101420 0x7f83801989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 --2- 172.21.15.22:0/865750998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8380100a80 0x7f8380198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:56.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 >> 172.21.15.22:0/865750998 conn(0x7f83800fc7a0 msgr2=0x7f8380104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:56.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 shutdown_connections 2024-09-11T22:39:56.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:56.666+0000 7f8387372640 1 -- 172.21.15.22:0/865750998 wait complete. 2024-09-11T22:39:57.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T22:39:57.639 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:57.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:57 smithi022 ceph-mon[30966]: pgmap v339: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:57.764 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:57 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/865750998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:57.902 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:57 smithi169 ceph-mon[35628]: pgmap v339: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:57.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:57 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/865750998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:57.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:57 smithi045 ceph-mon[35556]: pgmap v339: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T22:39:57.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:57 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/865750998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 -- 172.21.15.22:0/3925478162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e0101280 msgr2=0x7fb2e010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/3925478162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e0101280 0x7fb2e010df40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009900 tx=0x7fb2d002a410 comp rx=0 tx=0).stop 2024-09-11T22:39:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 -- 172.21.15.22:0/3925478162 shutdown_connections 2024-09-11T22:39:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/3925478162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e010e480 0x7fb2e0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/3925478162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e0101280 0x7fb2e010df40 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/3925478162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 0x7fb2e0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 -- 172.21.15.22:0/3925478162 >> 172.21.15.22:0/3925478162 conn(0x7fb2e00fc7a0 msgr2=0x7fb2e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 -- 172.21.15.22:0/3925478162 shutdown_connections 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.133+0000 7fb2e77bc640 1 -- 172.21.15.22:0/3925478162 wait complete. 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.134+0000 7fb2e77bc640 1 Processor -- start 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.134+0000 7fb2e77bc640 1 -- start start 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 0x7fb2e01a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e0101280 0x7fb2e01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0114320 con 0x7fb2e010e480 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e01141a0 con 0x7fb2e01008d0 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e77bc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e01144a0 con 0x7fb2e0101280 2024-09-11T22:39:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45780/0 (socket says 172.21.15.22:45780) 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 -- 172.21.15.22:0/1630950959 learned_addr learned my addr 172.21.15.22:0/1630950959 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5558640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 0x7fb2e01a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e4d57640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e0101280 0x7fb2e01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 -- 172.21.15.22:0/1630950959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e0101280 msgr2=0x7fb2e01a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e0101280 0x7fb2e01a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 -- 172.21.15.22:0/1630950959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 msgr2=0x7fb2e01a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 0x7fb2e01a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 -- 172.21.15.22:0/1630950959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e019ad20 con 0x7fb2e010e480 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.135+0000 7fb2e5d59640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800b9e0 tx=0x7fb2d800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.136+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8019070 con 0x7fb2e010e480 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.136+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2d800cb20 con 0x7fb2e010e480 2024-09-11T22:39:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.136+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e019b010 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.136+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80126b0 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.136+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01a7300 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.137+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e0100cb0 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.138+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb2d801c070 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.139+0000 7fb2d67fc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 0x7fb2cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.139+0000 7fb2e5558640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 0x7fb2cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.139+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8484+0+0 (secure 0 0 0) 0x7fb2d80ce890 con 0x7fb2e010e480 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.139+0000 7fb2e5558640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 0x7fb2cc0a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005fd0 tx=0x7fb2dc005850 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:58.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.143+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2d809b5e0 con 0x7fb2e010e480 2024-09-11T22:39:58.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.360+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb2e0109610 con 0x7fb2e010e480 2024-09-11T22:39:58.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.363+0000 7fb2d67fc640 1 -- 172.21.15.22:0/1630950959 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7fb2d809aee0 con 0x7fb2e010e480 2024-09-11T22:39:58.365 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:39:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 msgr2=0x7fb2cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 0x7fb2cc0a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005fd0 tx=0x7fb2dc005850 comp rx=0 tx=0).stop 2024-09-11T22:39:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 msgr2=0x7fb2e019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800b9e0 tx=0x7fb2d800bea0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 shutdown_connections 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fb2cc0a2cf0 0x7fb2cc0a51b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e010e480 0x7fb2e019a5f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2e0101280 0x7fb2e01a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 --2- 172.21.15.22:0/1630950959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e01008d0 0x7fb2e01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 >> 172.21.15.22:0/1630950959 conn(0x7fb2e00fc7a0 msgr2=0x7fb2e00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 shutdown_connections 2024-09-11T22:39:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:58.366+0000 7fb2e77bc640 1 -- 172.21.15.22:0/1630950959 wait complete. 2024-09-11T22:39:58.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:58.362+0000 7f90ed37f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:39:58.661 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: ignoring --setuser ceph since I am not root 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: ignoring --setgroup ceph since I am not root 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mds[69096]: -- 172.21.15.45:0/824355960 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bc1cc93860 con 0x55bc1cc71000 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: starting mds.h at 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:39:58.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mon[35556]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T22:39:58.663 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: ignoring --setuser ceph since I am not root 2024-09-11T22:39:58.663 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: ignoring --setgroup ceph since I am not root 2024-09-11T22:39:58.663 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-mds[65693]: -- 172.21.15.45:0/3241165168 <== mon.2 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cdd7f77c20 con 0x55cdd7f55000 2024-09-11T22:39:58.663 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:39:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: starting mds.b at 2024-09-11T22:39:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:39:58.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:58 smithi022 ceph-mon[30966]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1630950959' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:39:58.903 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:39:58.904 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:58 smithi169 ceph-mon[35628]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T22:39:59.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:39:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: pgmap v341: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6836/7710762,v1:172.21.15.45:6837/7710762] up:boot 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: mds.? [v2:172.21.15.45:6838/287876096,v1:172.21.15.45:6839/287876096] up:boot 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:39:59.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:39:59 smithi022 ceph-mon[30966]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:39:59.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- 172.21.15.22:0/1122504894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0100a80 msgr2=0x7f4dc0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:59.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1122504894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0100a80 0x7f4dc0100ee0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009930 tx=0x7f4dac02a420 comp rx=0 tx=0).stop 2024-09-11T22:39:59.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- 172.21.15.22:0/1122504894 shutdown_connections 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1122504894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0101420 0x7f4dc010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1122504894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0100a80 0x7f4dc0100ee0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1122504894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0106a80 0x7f4dc0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- 172.21.15.22:0/1122504894 >> 172.21.15.22:0/1122504894 conn(0x7f4dc00fc7a0 msgr2=0x7f4dc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- 172.21.15.22:0/1122504894 shutdown_connections 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- 172.21.15.22:0/1122504894 wait complete. 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 Processor -- start 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.833+0000 7f4dc724f640 1 -- start start 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0100a80 0x7f4dc01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 0x7f4dc019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0110fa0 con 0x7f4dc0101420 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0110e20 con 0x7f4dc0100a80 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc724f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0111120 con 0x7f4dc0106a80 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45802/0 (socket says 172.21.15.22:45802) 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 -- 172.21.15.22:0/1685158509 learned_addr learned my addr 172.21.15.22:0/1685158509 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc4feb640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0100a80 0x7f4dc01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc57ec640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 0x7f4dc019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 -- 172.21.15.22:0/1685158509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 msgr2=0x7f4dc019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 0x7f4dc019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 -- 172.21.15.22:0/1685158509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0100a80 msgr2=0x7f4dc01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0100a80 0x7f4dc01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 -- 172.21.15.22:0/1685158509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc019d480 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dc57ec640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 0x7f4dc019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.834+0000 7f4dbffff640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009230 tx=0x7f4dac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.835+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac03f030 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.835+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dac003af0 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.835+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc019d710 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.835+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac035070 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.835+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc01a5050 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.836+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc0100ee0 con 0x7f4dc0101420 2024-09-11T22:39:59.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.837+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4dac042030 con 0x7f4dc0101420 2024-09-11T22:39:59.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.838+0000 7f4dbdffb640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 0x7f4db00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:59.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.838+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8526+0+0 (secure 0 0 0) 0x7f4dac0efaa0 con 0x7f4dc0101420 2024-09-11T22:39:59.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.838+0000 7f4dc4feb640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 0x7f4db00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:59.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.838+0000 7f4dc4feb640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 0x7f4db00a5230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ab60 tx=0x7f4db400a2d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:59.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:39:59.842+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4dac0bc6c0 con 0x7f4dc0101420 2024-09-11T22:39:59.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: pgmap v341: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:39:59.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6836/7710762,v1:172.21.15.45:6837/7710762] up:boot 2024-09-11T22:39:59.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: mds.? [v2:172.21.15.45:6838/287876096,v1:172.21.15.45:6839/287876096] up:boot 2024-09-11T22:39:59.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T22:39:59.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:39:59.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:39:59 smithi045 ceph-mon[35556]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:40:00.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.055+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4dc01a5250 con 0x7f4dc0101420 2024-09-11T22:40:00.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:59.998+0000 7f90efb84640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:40:00.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:59.998+0000 7f90efb84640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-11T22:40:00.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:59.998+0000 7f90efb84640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-11T22:40:00.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:59.998+0000 7f90efb84640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-11T22:40:00.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:39:59.998+0000 7f90efb84640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-11T22:40:00.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: pgmap v341: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:00.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6836/7710762,v1:172.21.15.45:6837/7710762] up:boot 2024-09-11T22:40:00.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: mds.? [v2:172.21.15.45:6838/287876096,v1:172.21.15.45:6839/287876096] up:boot 2024-09-11T22:40:00.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T22:40:00.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:40:00.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:39:59 smithi169 ceph-mon[35628]: from='mgr.15057 172.21.15.22:0/2960303473' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:40:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.656+0000 7f4dbdffb640 1 -- 172.21.15.22:0/1685158509 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f4dac0bbfc0 con 0x7f4dc0101420 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 msgr2=0x7f4db00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 0x7f4db00a5230 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4db400ab60 tx=0x7f4db400a2d0 comp rx=0 tx=0).stop 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 msgr2=0x7f4dc0198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009230 tx=0x7f4dac004270 comp rx=0 tx=0).stop 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 shutdown_connections 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f4db00a2d70 0x7f4db00a5230 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dc0106a80 0x7f4dc019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:00.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4dc0101420 0x7f4dc0198a10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:00.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 --2- 172.21.15.22:0/1685158509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc0100a80 0x7f4dc01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:00.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 >> 172.21.15.22:0/1685158509 conn(0x7f4dc00fc7a0 msgr2=0x7f4dc01047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:00.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 shutdown_connections 2024-09-11T22:40:00.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:00.659+0000 7f4dc724f640 1 -- 172.21.15.22:0/1685158509 wait complete. 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: fs cephfs is degraded 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: fs cephfs is offline because no MDS is active for it. 2024-09-11T22:40:00.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:00 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: fs cephfs is degraded 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: fs cephfs is offline because no MDS is active for it. 2024-09-11T22:40:00.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:00 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:01.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:40:01.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-11T22:40:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: fs cephfs is degraded 2024-09-11T22:40:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-11T22:40:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: fs cephfs is offline because no MDS is active for it. 2024-09-11T22:40:01.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:00 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:01.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:40:01.583 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:01.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: pgmap v342: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:01.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:01.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:01.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: Cluster is now healthy 2024-09-11T22:40:01.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:01.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:01 smithi045 ceph-mon[35556]: fsmap 12 up:standby 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: pgmap v342: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: Cluster is now healthy 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:01.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:01 smithi022 ceph-mon[30966]: fsmap 12 up:standby 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 -- 172.21.15.22:0/2769012738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40101de0 msgr2=0x7fab401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 --2- 172.21.15.22:0/2769012738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40101de0 0x7fab401021c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009900 tx=0x7fab3c02a410 comp rx=0 tx=0).stop 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 -- 172.21.15.22:0/2769012738 shutdown_connections 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 --2- 172.21.15.22:0/2769012738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40106f10 0x7fab4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 --2- 172.21.15.22:0/2769012738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40102790 0x7fab401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 --2- 172.21.15.22:0/2769012738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40101de0 0x7fab401021c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.053+0000 7fab4814b640 1 -- 172.21.15.22:0/2769012738 >> 172.21.15.22:0/2769012738 conn(0x7fab400fd8c0 msgr2=0x7fab400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.054+0000 7fab4814b640 1 -- 172.21.15.22:0/2769012738 shutdown_connections 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.054+0000 7fab4814b640 1 -- 172.21.15.22:0/2769012738 wait complete. 2024-09-11T22:40:02.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.054+0000 7fab4814b640 1 Processor -- start 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.054+0000 7fab4814b640 1 -- start start 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40101de0 0x7fab40198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40106f10 0x7fab4019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fab40112050 con 0x7fab40102790 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fab40111ed0 con 0x7fab40106f10 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab4814b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab401121d0 con 0x7fab40101de0 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45808/0 (socket says 172.21.15.22:45808) 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 -- 172.21.15.22:0/1555983535 learned_addr learned my addr 172.21.15.22:0/1555983535 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab45ee7640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40101de0 0x7fab40198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab466e8640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40106f10 0x7fab4019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:02.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 -- 172.21.15.22:0/1555983535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40101de0 msgr2=0x7fab40198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40101de0 0x7fab40198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 -- 172.21.15.22:0/1555983535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40106f10 msgr2=0x7fab4019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40106f10 0x7fab4019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 -- 172.21.15.22:0/1555983535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4019d410 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab456e6640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c920 tx=0x7fab3000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.055+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30007c70 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.056+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4019d700 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.056+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab30007e10 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.056+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30018940 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.056+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab401a4fe0 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.057+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab401021c0 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.058+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fab30018be0 con 0x7fab40102790 2024-09-11T22:40:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.058+0000 7fab36ffd640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 0x7fab2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.059+0000 7fab45ee7640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 0x7fab2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.059+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8526+0+0 (secure 0 0 0) 0x7fab300cf550 con 0x7fab40102790 2024-09-11T22:40:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.059+0000 7fab45ee7640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 0x7fab2c0a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009230 tx=0x7fab3c0058d0 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.063+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab30014030 con 0x7fab40102790 2024-09-11T22:40:02.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: pgmap v342: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:02.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:02.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:02.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: Cluster is now healthy 2024-09-11T22:40:02.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1685158509' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:02.153 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:01 smithi169 ceph-mon[35628]: fsmap 12 up:standby 2024-09-11T22:40:02.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.240+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fab4002d7c0 con 0x7fab40102790 2024-09-11T22:40:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.665+0000 7fab36ffd640 1 -- 172.21.15.22:0/1555983535 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7fab3009c110 con 0x7fab40102790 2024-09-11T22:40:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 msgr2=0x7fab2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 0x7fab2c0a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009230 tx=0x7fab3c0058d0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 msgr2=0x7fab401989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c920 tx=0x7fab3000cde0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 shutdown_connections 2024-09-11T22:40:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7fab2c0a2cf0 0x7fab2c0a51b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab40106f10 0x7fab4019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab40102790 0x7fab401989a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 --2- 172.21.15.22:0/1555983535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab40101de0 0x7fab40198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.668+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 >> 172.21.15.22:0/1555983535 conn(0x7fab400fd8c0 msgr2=0x7fab400fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.669+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 shutdown_connections 2024-09-11T22:40:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:02.669+0000 7fab4814b640 1 -- 172.21.15.22:0/1555983535 wait complete. 2024-09-11T22:40:02.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:02 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:03.046 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:02 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:03.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:02 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:03.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c727338c-708b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:40:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:04.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:03 smithi022 ceph-mon[30966]: pgmap v343: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:04.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:03 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:04.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:03 smithi022 ceph-mon[30966]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:40:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 -- 172.21.15.22:0/3805673473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 msgr2=0x7f53081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 --2- 172.21.15.22:0/3805673473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f53081029b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009900 tx=0x7f52f802a480 comp rx=0 tx=0).stop 2024-09-11T22:40:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 -- 172.21.15.22:0/3805673473 shutdown_connections 2024-09-11T22:40:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 --2- 172.21.15.22:0/3805673473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308102ef0 0x7f530810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 --2- 172.21.15.22:0/3805673473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f53081029b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 --2- 172.21.15.22:0/3805673473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308100e20 0x7f5308101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 -- 172.21.15.22:0/3805673473 >> 172.21.15.22:0/3805673473 conn(0x7f53080fc7d0 msgr2=0x7f53080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 -- 172.21.15.22:0/3805673473 shutdown_connections 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 -- 172.21.15.22:0/3805673473 wait complete. 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.101+0000 7f530f1da640 1 Processor -- start 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 -- start start 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308100e20 0x7f53081993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308102ef0 0x7f53081a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53081110a0 con 0x7f5308102570 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5308110f20 con 0x7f5308100e20 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530f1da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5308111220 con 0x7f5308102ef0 2024-09-11T22:40:04.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58044/0 (socket says 172.21.15.22:58044) 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 -- 172.21.15.22:0/3581986024 learned_addr learned my addr 172.21.15.22:0/3581986024 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530cf76640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308100e20 0x7f53081993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 -- 172.21.15.22:0/3581986024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308102ef0 msgr2=0x7f53081a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f530d777640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308102ef0 0x7f53081a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308102ef0 0x7f53081a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 -- 172.21.15.22:0/3581986024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308100e20 msgr2=0x7f53081993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308100e20 0x7f53081993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.102+0000 7f52fffff640 1 -- 172.21.15.22:0/3581986024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53081a4990 con 0x7f5308102570 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f52fffff640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006010 tx=0x7f52f8004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f803f030 con 0x7f5308102570 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f8005500 con 0x7f5308102570 2024-09-11T22:40:04.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53081a4b60 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8035070 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.103+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53081a4fb0 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.104+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5308101200 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.105+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f52f8042030 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.106+0000 7f52fdffb640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 0x7f52f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.106+0000 7f530cf76640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 0x7f52f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.106+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 7972+0+0 (secure 0 0 0) 0x7f52f80ef6b0 con 0x7f5308102570 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.106+0000 7f530cf76640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 0x7f52f00a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5304005fd0 tx=0x7f530400b390 comp rx=0 tx=0).ready entity=mgr.15057 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:04.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.110+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52f80bc540 con 0x7f5308102570 2024-09-11T22:40:04.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:03 smithi169 ceph-mon[35628]: pgmap v343: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:04.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:03 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:04.152 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:03 smithi169 ceph-mon[35628]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:40:04.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:03 smithi045 ceph-mon[35556]: pgmap v343: 97 pgs: 97 active+clean; 5.5 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-11T22:40:04.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:03 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/1555983535' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:04.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:03 smithi045 ceph-mon[35556]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:40:04.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.286+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53081a5180 con 0x7f5308102570 2024-09-11T22:40:04.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.671+0000 7f52fdffb640 1 -- 172.21.15.22:0/3581986024 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f52f80bbe40 con 0x7f5308102570 2024-09-11T22:40:04.673 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 msgr2=0x7f52f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 0x7f52f00a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5304005fd0 tx=0x7f530400b390 comp rx=0 tx=0).stop 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 msgr2=0x7f5308199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006010 tx=0x7f52f8004c00 comp rx=0 tx=0).stop 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 shutdown_connections 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:6800/3304490936,v1:172.21.15.22:6801/3304490936] conn(0x7f52f00a2cf0 0x7f52f00a51b0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5304005fd0 tx=0x7f530400b390 comp rx=0 tx=0).stop 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5308102ef0 0x7f53081a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5308102570 0x7f5308199910 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 --2- 172.21.15.22:0/3581986024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5308100e20 0x7f53081993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.675+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 >> 172.21.15.22:0/3581986024 conn(0x7f53080fc7d0 msgr2=0x7f53081067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.676+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 shutdown_connections 2024-09-11T22:40:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-11T22:40:04.676+0000 7f530f1da640 1 -- 172.21.15.22:0/3581986024 wait complete. 2024-09-11T22:40:05.045 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:04 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:05.054 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:04 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:05.161 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:04 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:05.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:05.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:05.472 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:05.507 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T22:40:05.508 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:05.525 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:05.544 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:05.563 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T22:40:05.564 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T22:40:05.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a 2024-09-11T22:40:05.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 systemd[1]: Stopping Ceph mon.a for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:05.753 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:05 smithi169 ceph-mon[35628]: pgmap v345: 65 pgs: 65 active+clean; 577 KiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:05.753 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:05 smithi169 ceph-mon[35628]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:05.753 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:05 smithi169 ceph-mon[35628]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:40:05.911 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:05 smithi045 ceph-mon[35556]: pgmap v345: 65 pgs: 65 active+clean; 577 KiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:05.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:05 smithi045 ceph-mon[35556]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:05.912 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:05 smithi045 ceph-mon[35556]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:40:06.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 ceph-mon[30966]: pgmap v345: 65 pgs: 65 active+clean; 577 KiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:06.037 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 ceph-mon[30966]: from='client.? 172.21.15.22:0/3581986024' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:06.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 ceph-mon[30966]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:40:06.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:40:05.882+0000 7f90f2b8a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:06.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a[30962]: 2024-09-11T22:40:05.883+0000 7f90f2b8a640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T22:40:06.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:06 smithi022 podman[101124]: 2024-09-11 22:40:06.037387698 +0000 UTC m=+0.271295020 container died dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T22:40:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:06 smithi022 podman[101124]: 2024-09-11 22:40:06.415926119 +0000 UTC m=+0.649833440 container cleanup dbb7de54a696f38fc6e542a6dbee4919cceb5c3f5464fc21f83fed0c65610ffc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:06.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 11 22:40:06 smithi022 bash[101124]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-a 2024-09-11T22:40:06.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T22:40:06.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:06.907 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T22:40:06.907 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T22:40:06.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.b 2024-09-11T22:40:07.231 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:06 smithi045 systemd[1]: Stopping Ceph mon.b for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:07.661 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-b[35552]: 2024-09-11T22:40:07.230+0000 7f4a78429640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:07.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-b[35552]: 2024-09-11T22:40:07.230+0000 7f4a78429640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:40:07.662 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:07 smithi045 podman[71091]: 2024-09-11 22:40:07.39401537 +0000 UTC m=+0.283405435 container died 8a8450ed32740f2166dbffb189368e49e78f6b99e871d83ba84636b40bd1df3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:08.023 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:07 smithi045 podman[71091]: 2024-09-11 22:40:07.747196567 +0000 UTC m=+0.636586631 container cleanup 8a8450ed32740f2166dbffb189368e49e78f6b99e871d83ba84636b40bd1df3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:40:08.023 INFO:journalctl@ceph.mon.b.smithi045.stdout:Sep 11 22:40:07 smithi045 bash[71091]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-b 2024-09-11T22:40:08.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T22:40:08.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:08.225 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T22:40:08.225 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T22:40:08.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.c 2024-09-11T22:40:08.540 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 systemd[1]: Stopping Ceph mon.c for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:08.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c[35624]: 2024-09-11T22:40:08.538+0000 7f16a6846640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:08.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c[35624]: 2024-09-11T22:40:08.538+0000 7f16a6846640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:40:08.832 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 podman[71336]: 2024-09-11 22:40:08.580236483 +0000 UTC m=+0.156824980 container died 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:09.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 podman[71336]: 2024-09-11 22:40:08.922880248 +0000 UTC m=+0.499468743 container cleanup 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:09.100 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:08 smithi169 bash[71336]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c 2024-09-11T22:40:09.350 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 11 22:40:09 smithi169 podman[71348]: 2024-09-11 22:40:09.099181157 +0000 UTC m=+0.515606357 container remove 6e1d4cb557d35ec4baabdd2039e86a5afdc90666ba834bc52182f2796f1f1cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T22:40:09.353 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T22:40:09.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:09.398 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T22:40:09.398 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T22:40:09.398 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x 2024-09-11T22:40:09.705 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:40:09 smithi022 systemd[1]: Stopping Ceph mgr.x for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:09.996 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:40:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x[31194]: 2024-09-11T22:40:09.703+0000 7f6a1f3cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:09.997 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:40:09 smithi022 podman[101245]: 2024-09-11 22:40:09.7353272 +0000 UTC m=+0.129510516 container died f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T22:40:10.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:40:10 smithi022 podman[101245]: 2024-09-11 22:40:10.213326851 +0000 UTC m=+0.607510208 container cleanup f9dbecf47ba2000db61ce9059ce399898bbbf124bae90d32d644b223e5d3956e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:10.402 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 11 22:40:10 smithi022 bash[101245]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-x 2024-09-11T22:40:10.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T22:40:10.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:10.643 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T22:40:10.643 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T22:40:10.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.y 2024-09-11T22:40:10.980 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:40:10 smithi045 systemd[1]: Stopping Ceph mgr.y for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:11.277 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:40:10 smithi045 podman[71216]: 2024-09-11 22:40:10.980357073 +0000 UTC m=+0.140762727 container died d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T22:40:11.602 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:40:11 smithi045 podman[71216]: 2024-09-11 22:40:11.359848316 +0000 UTC m=+0.520253969 container cleanup d1ac30208fdf2619323bd6bfd1a34bedcea0452bea10159986997b0c31d20566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T22:40:11.603 INFO:journalctl@ceph.mgr.y.smithi045.stdout:Sep 11 22:40:11 smithi045 bash[71216]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-y 2024-09-11T22:40:11.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T22:40:11.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:11.787 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T22:40:11.787 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T22:40:11.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.z 2024-09-11T22:40:12.116 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:40:11 smithi169 systemd[1]: Stopping Ceph mgr.z for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:12.402 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:40:12 smithi169 podman[71461]: 2024-09-11 22:40:12.116351921 +0000 UTC m=+0.132765402 container died 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:12.736 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:40:12 smithi169 podman[71461]: 2024-09-11 22:40:12.510391175 +0000 UTC m=+0.526804692 container cleanup 12185625f1446a0321ca7275b5761d896ead0e22c55e7541600d109440da9c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T22:40:12.736 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 11 22:40:12 smithi169 bash[71461]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mgr-z 2024-09-11T22:40:12.887 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T22:40:12.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:12.922 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T22:40:12.922 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T22:40:12.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.0 2024-09-11T22:40:13.235 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:12 smithi022 systemd[1]: Stopping Ceph osd.0 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:13.652 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:40:13.234+0000 7f9628f9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:13.652 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:40:13.234+0000 7f9628f9f640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-11T22:40:13.652 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0[42541]: 2024-09-11T22:40:13.234+0000 7f9628f9f640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:19.060 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:18 smithi022 podman[101367]: 2024-09-11 22:40:18.744481849 +0000 UTC m=+5.613645704 container died 4efdf1d747d55f793cfe71b88e7755112cade765fa8e594353618dcdf257276d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T22:40:19.402 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:19 smithi022 podman[101367]: 2024-09-11 22:40:19.217738265 +0000 UTC m=+6.086902107 container cleanup 4efdf1d747d55f793cfe71b88e7755112cade765fa8e594353618dcdf257276d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T22:40:19.402 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:19 smithi022 bash[101367]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0 2024-09-11T22:40:19.850 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:19 smithi022 podman[101382]: 2024-09-11 22:40:19.502753508 +0000 UTC m=+0.753344972 container remove 4efdf1d747d55f793cfe71b88e7755112cade765fa8e594353618dcdf257276d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T22:40:20.118 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:19 smithi022 podman[101471]: 2024-09-11 22:40:19.752932081 +0000 UTC m=+0.016307418 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:20.118 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:19 smithi022 podman[101471]: 2024-09-11 22:40:19.853500999 +0000 UTC m=+0.116876366 container create 93a8c37bfb219433774c287e2de7c3750f5180627dba95b1b0a8e869f5e9fb93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:20.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:20 smithi022 podman[101471]: 2024-09-11 22:40:20.114230796 +0000 UTC m=+0.377606121 container init 93a8c37bfb219433774c287e2de7c3750f5180627dba95b1b0a8e869f5e9fb93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:20.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:20 smithi022 podman[101471]: 2024-09-11 22:40:20.117816838 +0000 UTC m=+0.381192164 container start 93a8c37bfb219433774c287e2de7c3750f5180627dba95b1b0a8e869f5e9fb93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-11T22:40:20.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:20 smithi022 podman[101471]: 2024-09-11 22:40:20.214615363 +0000 UTC m=+0.477990691 container attach 93a8c37bfb219433774c287e2de7c3750f5180627dba95b1b0a8e869f5e9fb93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:20.403 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 11 22:40:20 smithi022 podman[101471]: 2024-09-11 22:40:20.312245259 +0000 UTC m=+0.575620595 container died 93a8c37bfb219433774c287e2de7c3750f5180627dba95b1b0a8e869f5e9fb93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:21.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T22:40:21.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:21.060 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T22:40:21.060 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T22:40:21.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.1 2024-09-11T22:40:21.399 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:21 smithi045 systemd[1]: Stopping Ceph osd.1 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:21.661 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:40:21.397+0000 7f4b3c2b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:21.662 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:40:21.397+0000 7f4b3c2b8640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-11T22:40:21.662 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1[40068]: 2024-09-11T22:40:21.397+0000 7f4b3c2b8640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:27.074 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:26 smithi045 podman[71353]: 2024-09-11 22:40:26.768152598 +0000 UTC m=+5.493673839 container died c798d1fb22056e2235370311071b9dcfa15cc6356414eb36458b85fdf4539503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:27.332 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:27 smithi045 podman[71353]: 2024-09-11 22:40:27.156054217 +0000 UTC m=+5.881575446 container cleanup c798d1fb22056e2235370311071b9dcfa15cc6356414eb36458b85fdf4539503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T22:40:27.332 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:27 smithi045 bash[71353]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1 2024-09-11T22:40:27.661 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:27 smithi045 podman[71369]: 2024-09-11 22:40:27.332384779 +0000 UTC m=+0.559278421 container remove c798d1fb22056e2235370311071b9dcfa15cc6356414eb36458b85fdf4539503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T22:40:28.028 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:27 smithi045 podman[71461]: 2024-09-11 22:40:27.678162671 +0000 UTC m=+0.015767593 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:28.028 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:27 smithi045 podman[71461]: 2024-09-11 22:40:27.78344028 +0000 UTC m=+0.121045245 container create 09f582344a8307b749a2861dffffebedccf6c0af0e54a35129fb74fb322f27a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:28.412 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:28 smithi045 podman[71461]: 2024-09-11 22:40:28.027939577 +0000 UTC m=+0.365544499 container init 09f582344a8307b749a2861dffffebedccf6c0af0e54a35129fb74fb322f27a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T22:40:28.412 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:28 smithi045 podman[71461]: 2024-09-11 22:40:28.031359125 +0000 UTC m=+0.368964049 container start 09f582344a8307b749a2861dffffebedccf6c0af0e54a35129fb74fb322f27a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:28.412 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:28 smithi045 podman[71461]: 2024-09-11 22:40:28.111287611 +0000 UTC m=+0.448892534 container attach 09f582344a8307b749a2861dffffebedccf6c0af0e54a35129fb74fb322f27a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:28.412 INFO:journalctl@ceph.osd.1.smithi045.stdout:Sep 11 22:40:28 smithi045 podman[71461]: 2024-09-11 22:40:28.219943027 +0000 UTC m=+0.557547949 container died 09f582344a8307b749a2861dffffebedccf6c0af0e54a35129fb74fb322f27a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:40:28.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T22:40:28.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:28.837 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T22:40:28.837 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T22:40:28.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.2 2024-09-11T22:40:29.123 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:28 smithi169 systemd[1]: Stopping Ceph osd.2 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:29.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:40:29.122+0000 7fd26d320640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:29.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:40:29.122+0000 7fd26d320640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-11T22:40:29.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2[40660]: 2024-09-11T22:40:29.122+0000 7fd26d320640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:34.748 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:34 smithi169 podman[71588]: 2024-09-11 22:40:34.459437714 +0000 UTC m=+5.427289804 container died 79aa3d139467b555e90c8deb5b75cae632552b29bb8c4f71f1d47786f74ea977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:40:35.081 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:34 smithi169 podman[71588]: 2024-09-11 22:40:34.84718065 +0000 UTC m=+5.815032729 container cleanup 79aa3d139467b555e90c8deb5b75cae632552b29bb8c4f71f1d47786f74ea977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T22:40:35.081 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:34 smithi169 bash[71588]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2 2024-09-11T22:40:35.402 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71602]: 2024-09-11 22:40:35.081742112 +0000 UTC m=+0.612293551 container remove 79aa3d139467b555e90c8deb5b75cae632552b29bb8c4f71f1d47786f74ea977 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T22:40:35.702 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.317404821 +0000 UTC m=+0.016497904 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:35.702 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.44933776 +0000 UTC m=+0.148430842 container create a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T22:40:36.153 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.702290601 +0000 UTC m=+0.401383684 container init a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T22:40:36.153 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.706026797 +0000 UTC m=+0.405119884 container start a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T22:40:36.153 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.802218057 +0000 UTC m=+0.501311154 container attach a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T22:40:36.153 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:35 smithi169 podman[71692]: 2024-09-11 22:40:35.890245746 +0000 UTC m=+0.589338830 container died a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T22:40:36.522 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 11 22:40:36 smithi169 podman[71716]: 2024-09-11 22:40:36.497362661 +0000 UTC m=+0.601393675 container remove a637cbddc71ef8ca17010d1732b82bf2af4fc762946c892895c9238a1f61f995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T22:40:36.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T22:40:36.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:36.576 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T22:40:36.576 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T22:40:36.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.3 2024-09-11T22:40:36.902 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:36 smithi022 systemd[1]: Stopping Ceph osd.3 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:37.235 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:36 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:40:36.917+0000 7ff5c3a11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:37.235 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:36 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:40:36.917+0000 7ff5c3a11640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-11T22:40:37.235 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:36 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:40:36.917+0000 7ff5c3a11640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:39.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:39 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:39.584+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:40.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:40.072+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:40.582 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:40 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:40.248+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:40.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:40 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:40.581+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:40.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:40 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:40.445+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:41.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:41.116+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:41.553 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:41 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:41.292+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:41.881 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:41 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:41.552+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:41.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:41 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:41.452+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:42.152 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:41 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3[49035]: 2024-09-11T22:40:41.881+0000 7ff5c0016640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.253187+0000 front 2024-09-11T22:40:15.253244+0000 (oldest deadline 2024-09-11T22:40:41.153376+0000) 2024-09-11T22:40:42.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:42.091+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:42.652 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:42 smithi022 podman[101578]: 2024-09-11 22:40:42.368448422 +0000 UTC m=+5.580289634 container died 20b0ce63cb6d6c3620af1ef2babfb9c771d5bba961c5a557a5c08896c2db022f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T22:40:42.653 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:42 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:42.515+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:42.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:42 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:42.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:42.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:42.490+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:42.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:42 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:42.412+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:43.152 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:42 smithi022 podman[101578]: 2024-09-11 22:40:42.979450367 +0000 UTC m=+6.191291575 container cleanup 20b0ce63cb6d6c3620af1ef2babfb9c771d5bba961c5a557a5c08896c2db022f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T22:40:43.152 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:42 smithi022 bash[101578]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3 2024-09-11T22:40:43.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:43.093+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:43.606 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101609]: 2024-09-11 22:40:43.256085128 +0000 UTC m=+0.882919624 container remove 20b0ce63cb6d6c3620af1ef2babfb9c771d5bba961c5a557a5c08896c2db022f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T22:40:43.606 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:43 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:43.477+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:43.607 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:43 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:43.257+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:43.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:43.507+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:43.903 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101698]: 2024-09-11 22:40:43.509274545 +0000 UTC m=+0.016246081 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:43.903 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101698]: 2024-09-11 22:40:43.606674845 +0000 UTC m=+0.113646362 container create 1ffb10dfc2ba569f2f41b553787d51e7020262c5fbb046559b606ec4aeb7907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T22:40:43.903 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101698]: 2024-09-11 22:40:43.851190891 +0000 UTC m=+0.358162416 container init 1ffb10dfc2ba569f2f41b553787d51e7020262c5fbb046559b606ec4aeb7907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T22:40:43.903 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101698]: 2024-09-11 22:40:43.854638178 +0000 UTC m=+0.361609709 container start 1ffb10dfc2ba569f2f41b553787d51e7020262c5fbb046559b606ec4aeb7907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:40:43.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:43 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:43.423+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:44.249 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:43 smithi022 podman[101698]: 2024-09-11 22:40:43.934146985 +0000 UTC m=+0.441118509 container attach 1ffb10dfc2ba569f2f41b553787d51e7020262c5fbb046559b606ec4aeb7907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-11T22:40:44.249 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 11 22:40:44 smithi022 podman[101698]: 2024-09-11 22:40:44.04636017 +0000 UTC m=+0.553331711 container died 1ffb10dfc2ba569f2f41b553787d51e7020262c5fbb046559b606ec4aeb7907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:40:44.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:44.049+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:44.506 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:44 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:44.248+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:44.773 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:44 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:44.525+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:44.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T22:40:44.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:44.844 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T22:40:44.844 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T22:40:44.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.4 2024-09-11T22:40:44.871 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:44 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:44.469+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:44.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:44.662+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:44.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:44.504+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:45.142 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:44 smithi045 systemd[1]: Stopping Ceph osd.4 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:45.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:45 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:45.044+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:45.411 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:45 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:40:45.140+0000 7f60ca815640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:45.411 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:45 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:40:45.140+0000 7f60ca815640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-11T22:40:45.411 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:45 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:40:45.140+0000 7f60ca815640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:45.543 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:45 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:45.253+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:45.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:45 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:45.542+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:45.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:45 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:45.471+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:45.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:45 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:45.676+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:45.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:45 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:45.465+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:46.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:46 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:46.085+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:46.553 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:46 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:46.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:46.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:46 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:46.552+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:46.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:46 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:46.700+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:46.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:46 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:46.492+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:46.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:46 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:46.417+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:47.369 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:47 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:47.090+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:47.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:47 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:47.065+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:47.581 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:47.225+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:47.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:47 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:47.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:47.728 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:47 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:47.473+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:47.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:47.581+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:47.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:47.581+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:48.041 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:47 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:47.727+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:48.373 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:48 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:40:48.196+0000 7f60c6e1a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:22.712598+0000 front 2024-09-11T22:40:22.712630+0000 (oldest deadline 2024-09-11T22:40:47.412710+0000) 2024-09-11T22:40:48.373 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:48 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:48.109+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:48.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:48 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:48.041+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:48.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:48 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:48.041+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:48.540 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:48.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:48.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:48 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:48.372+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:48.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:48.540+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:48.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:48 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:48.540+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:48.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:48 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:48.681+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:48.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:48 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:48.465+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:48.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:48 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:48.465+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:49.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:49 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:49.005+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:49.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:49 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:49.005+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:49.412 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:49 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4[46573]: 2024-09-11T22:40:49.181+0000 7f60c6e1a640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:22.712598+0000 front 2024-09-11T22:40:22.712630+0000 (oldest deadline 2024-09-11T22:40:47.412710+0000) 2024-09-11T22:40:49.412 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:49 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:49.113+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:49.530 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:49.242+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:49.680 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:49 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:49.425+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:49.680 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:49 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:49.425+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:49.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:49.530+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:49.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:49 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:49.530+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:49.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:49 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:49.416+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:50.017 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:49 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:49.679+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:50.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:50.013+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:50.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:50.013+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:50.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:50 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:50.154+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:50.535 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:50.214+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:50.701 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:50 smithi045 podman[71566]: 2024-09-11 22:40:50.488386695 +0000 UTC m=+5.450385823 container died f355e034f2902a966986dc0a86d6bc591544b048f67e5bc6cda98dea2b7f57b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:50.702 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:50 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:50.461+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:50.702 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:50 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:50.461+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:50.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:50.535+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:50.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:50 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:50.535+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:50.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:50.653+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:50.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:50.447+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:50.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:50.447+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:51.044 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:50 smithi045 podman[71566]: 2024-09-11 22:40:50.842425442 +0000 UTC m=+5.804424569 container cleanup f355e034f2902a966986dc0a86d6bc591544b048f67e5bc6cda98dea2b7f57b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T22:40:51.044 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:50 smithi045 bash[71566]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4 2024-09-11T22:40:51.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:50.981+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:51.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:50 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:50.981+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:51.411 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71583]: 2024-09-11 22:40:51.043564241 +0000 UTC m=+0.550116193 container remove f355e034f2902a966986dc0a86d6bc591544b048f67e5bc6cda98dea2b7f57b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:51.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:51 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:51.106+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:51.538 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:51.189+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:51.689 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:51 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:51.432+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:51.689 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:51 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:51.432+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:51.764 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.411302134 +0000 UTC m=+0.022678628 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:51.764 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.519479997 +0000 UTC m=+0.130856482 container create 1ca27f889a1ce1a8c56d0bb9a52315c6d9e0c7c58fac98e20363e08099b76425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:51.765 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:51 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:51.460+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:51.765 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:51 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:51.460+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:51.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:51.537+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:51.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:51 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:51.537+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:52.027 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:51 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:51.688+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:52.060 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.797231724 +0000 UTC m=+0.408608216 container init 1ca27f889a1ce1a8c56d0bb9a52315c6d9e0c7c58fac98e20363e08099b76425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:52.061 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.800547325 +0000 UTC m=+0.411923807 container start 1ca27f889a1ce1a8c56d0bb9a52315c6d9e0c7c58fac98e20363e08099b76425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:52.061 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.888869412 +0000 UTC m=+0.500245897 container attach 1ca27f889a1ce1a8c56d0bb9a52315c6d9e0c7c58fac98e20363e08099b76425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T22:40:52.061 INFO:journalctl@ceph.osd.4.smithi045.stdout:Sep 11 22:40:51 smithi045 podman[71680]: 2024-09-11 22:40:51.993206737 +0000 UTC m=+0.604583223 container died 1ca27f889a1ce1a8c56d0bb9a52315c6d9e0c7c58fac98e20363e08099b76425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T22:40:52.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:52.027+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:52.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:52.027+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:52.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:52 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:52.059+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:52.570 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:52.200+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:52.570 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:52.200+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:52.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T22:40:52.686 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:52 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:52.432+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:52.686 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:52 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:52.432+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:52.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:52.688 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T22:40:52.689 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T22:40:52.689 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.5 2024-09-11T22:40:52.716 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:52.663+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:52.717 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:52.422+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:52.717 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:52.422+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:52.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:52.570+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:52.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:52.570+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:52.983 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 systemd[1]: Stopping Ceph osd.5 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:53.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:53 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:53.073+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:53.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:53 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:53.073+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:53.403 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:52.982+0000 7fc92da00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:53.403 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:52.982+0000 7fc92da00640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-11T22:40:53.403 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:52 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:52.982+0000 7fc92da00640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:53.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:53 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:53.014+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:53.576 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:53 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:53.155+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:53.576 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:53 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:53.155+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:53.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:53 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:53.575+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:53.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:53 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:53.575+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:53.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:53 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:53.658+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:53.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:53 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:53.435+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:53.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:53 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:53.435+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:53.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:53 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:53.475+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:53.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:53 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:53.475+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:54.402 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:54.188+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:54.402 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:54.188+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:54.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:54 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:54.066+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:54.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:54 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:54.066+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:54.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:54 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:54.048+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:54.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:54.551+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:54.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:54 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:54.551+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:54.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:54 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:54.623+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:54.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:54 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:54.444+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:54.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:54 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:54.444+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:54.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:54 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:54.447+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:54.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:54 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:54.447+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:55.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:55.108+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:55.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:55.108+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:55.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:55 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:55.086+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:55.531 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:55 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:55.166+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:55.531 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:55 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:55.166+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:55.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:55 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:55.531+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:55.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:55 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:55.531+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:55.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:55.599+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:55.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:55.468+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:55.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:55.468+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:55.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:55 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:55.468+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:31.126001+0000 front 2024-09-11T22:40:31.126036+0000 (oldest deadline 2024-09-11T22:40:55.226045+0000) 2024-09-11T22:40:55.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:55 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:55.477+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:55.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:55 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:55.477+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:55.911 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:55 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:55.477+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:40:56.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:56.068+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:56.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:56.068+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:56.412 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:56 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:56.105+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:56.535 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:56 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:56.158+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:56.536 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:56 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:56.158+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:56.536 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:56 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:56.158+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:40:56.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:56 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:56.535+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:56.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:56 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:56.535+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:56.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:56.597+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:56.902 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:56.463+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:56.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:56.463+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:56.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:56 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:56.463+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:31.126001+0000 front 2024-09-11T22:40:31.126036+0000 (oldest deadline 2024-09-11T22:40:55.226045+0000) 2024-09-11T22:40:56.912 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:56 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:56.438+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:56.912 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:56 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:56.438+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:56.912 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:56 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:56.438+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:40:57.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:57.052+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:57.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:57.052+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:57.409 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:57.093+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:57.409 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:57.093+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:40:57.559 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:57.176+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:57.559 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:57.176+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:57.560 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:57.176+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:40:57.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:57.408+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:57.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:57.408+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:57.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:57 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:57.408+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:40:57.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:57.559+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:57.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:57 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:57.559+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:57.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:57.555+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:57.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:57.423+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.024581+0000 front 2024-09-11T22:40:17.024535+0000 (oldest deadline 2024-09-11T22:40:41.724654+0000) 2024-09-11T22:40:57.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:57.423+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.725173+0000 front 2024-09-11T22:40:21.725270+0000 (oldest deadline 2024-09-11T22:40:47.625102+0000) 2024-09-11T22:40:57.903 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:57 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5[47568]: 2024-09-11T22:40:57.423+0000 7fc925ffd640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:31.126001+0000 front 2024-09-11T22:40:31.126036+0000 (oldest deadline 2024-09-11T22:40:55.226045+0000) 2024-09-11T22:40:58.383 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:58.086+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:58.383 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:58.086+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:40:58.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.006+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:58.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.006+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:58.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.006+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:40:58.578 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:58.215+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:58.578 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:58.215+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:58.579 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:58.215+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:40:58.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:58.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:58.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:58.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:58.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:58 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:58.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:40:58.783 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:58 smithi169 podman[71810]: 2024-09-11 22:40:58.517015808 +0000 UTC m=+5.633657038 container died 816d00633a67ed67ad2778c0f28d43c2eac68f8495b1639d8e739d6497453888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:58.784 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:58.559+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:58.784 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:58.559+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:40:58.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:58.578+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:58.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:58.578+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:40:59.153 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:58 smithi169 podman[71810]: 2024-09-11 22:40:58.883023996 +0000 UTC m=+5.999665225 container cleanup 816d00633a67ed67ad2778c0f28d43c2eac68f8495b1639d8e739d6497453888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:59.153 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:58 smithi169 bash[71810]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5 2024-09-11T22:40:59.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.975+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:40:59.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.975+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:40:59.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:58 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:58.975+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:40:59.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:59.125+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:40:59.411 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:40:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:40:59.125+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:40:59.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:59.370+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:40:59.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:59.370+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:40:59.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:40:59 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:40:59.370+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:40:59.510 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71826]: 2024-09-11 22:40:59.167786565 +0000 UTC m=+0.649921999 container remove 816d00633a67ed67ad2778c0f28d43c2eac68f8495b1639d8e739d6497453888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T22:40:59.533 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:59.196+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:40:59.534 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:59.196+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:40:59.534 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:40:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:40:59.196+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:40:59.795 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:59.590+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:40:59.796 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:40:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:40:59.590+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:40:59.796 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.413057715 +0000 UTC m=+0.015926922 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:59.796 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.518448721 +0000 UTC m=+0.121317926 container create 4703323e7606b3e31af7976112dbfc575abf88defe99e520806abe95aa477421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T22:40:59.796 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.720815139 +0000 UTC m=+0.323684352 container init 4703323e7606b3e31af7976112dbfc575abf88defe99e520806abe95aa477421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:40:59.796 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.724056021 +0000 UTC m=+0.326925228 container start 4703323e7606b3e31af7976112dbfc575abf88defe99e520806abe95aa477421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:59.797 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.795800634 +0000 UTC m=+0.398669861 container attach 4703323e7606b3e31af7976112dbfc575abf88defe99e520806abe95aa477421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T22:40:59.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:59.533+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:40:59.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:40:59 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:40:59.533+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:00.152 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 11 22:40:59 smithi169 podman[71912]: 2024-09-11 22:40:59.909509554 +0000 UTC m=+0.512378762 container died 4703323e7606b3e31af7976112dbfc575abf88defe99e520806abe95aa477421 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:00.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:59.949+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:00.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:59.949+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:00.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:40:59 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:40:59.949+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:00.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T22:41:00.566 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:00.174+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:00.567 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:00.174+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:00.567 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:00.174+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:00.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:00.606 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T22:41:00.606 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T22:41:00.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.6 2024-09-11T22:41:00.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:00.167+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:00.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:00.167+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:00.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:00.401+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:00.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:00.401+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:00.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:00 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:00.401+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:00.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.565+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:00.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.565+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:00.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.565+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:00.903 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 systemd[1]: Stopping Ceph osd.6 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:00.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:00.562+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:00.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:00.562+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:01.219 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.916+0000 7f5310330640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:01.219 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.916+0000 7f5310330640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-11T22:41:01.220 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:00 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:00.916+0000 7f5310330640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:01.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:00.906+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:01.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:00.906+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:01.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:00 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:00.906+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:01.427 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:01.176+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:01.427 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:01.176+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:01.428 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:01.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:01.428 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:01.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:01.428 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:01 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:01.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:01.581 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:01.219+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:01.581 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:01.219+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:01.582 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:01.219+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:01.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:01.580+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:01.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:01.580+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:01.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:01.580+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:01.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:01.562+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:01.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:01.562+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:02.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:01.946+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:02.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:01.946+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:02.403 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:01 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:01.946+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:02.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:02.242+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:02.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:02.242+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:02.532 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:02.242+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:02.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:02.194+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:02.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:02.194+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:02.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:02.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:02.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:02.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:02.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:02 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:02.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:02.901 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:02.600+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:02.901 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:02.600+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:02.901 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:02.531+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:02.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:02.531+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:02.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:02 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:02.531+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:03.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:02.900+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:03.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:02.900+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:03.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:02 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:02.900+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:03.500 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:03.226+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:03.500 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:03.226+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:03.500 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:03.226+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:03.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:03.237+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:03.237+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:03.237+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:03.414+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:03.414+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:03.414+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:03.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:03 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:03.414+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:03.856 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:03 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:03.603+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:03.857 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:03 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:03.603+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:03.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:03.499+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:03.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:03.499+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:03.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:03.499+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:03.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:03 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:03.499+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.886897+0000 front 2024-09-11T22:40:41.886869+0000 (oldest deadline 2024-09-11T22:41:02.987003+0000) 2024-09-11T22:41:04.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:03 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:03.856+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:04.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:03 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:03.856+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:04.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:03 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:03.856+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:04.515 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:04.211+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:04.515 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:04.211+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:04.515 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:04.211+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:04.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:04.266+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:04.266+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:04.266+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:04.407+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:04.407+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:04.407+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:04.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:04 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:04.407+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:04.903 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:04.514+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:04.903 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:04.514+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:04.903 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:04.514+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:04.904 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:04 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:04.514+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.886897+0000 front 2024-09-11T22:40:41.886869+0000 (oldest deadline 2024-09-11T22:41:02.987003+0000) 2024-09-11T22:41:05.055 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:04 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:04.652+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:05.056 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:04 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:04.652+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:05.056 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:04 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:04.814+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:05.056 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:04 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:04.814+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:05.056 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:04 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:04.814+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:05.498 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:05.221+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:05.499 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:05.221+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:05.499 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:05.221+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:05.499 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:05.221+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:05.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:05.316+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:05.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:05.316+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:05.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:05.316+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:05.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:05.403+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:05.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:05.403+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:05.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:05.403+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:05.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:05 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:05.403+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:05.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:05.498+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:18.082616+0000 front 2024-09-11T22:40:18.082715+0000 (oldest deadline 2024-09-11T22:40:39.182808+0000) 2024-09-11T22:41:05.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:05.498+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.484116+0000 front 2024-09-11T22:40:24.484032+0000 (oldest deadline 2024-09-11T22:40:46.783961+0000) 2024-09-11T22:41:05.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:05.498+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.785265+0000 front 2024-09-11T22:40:33.785372+0000 (oldest deadline 2024-09-11T22:41:00.185968+0000) 2024-09-11T22:41:05.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:05 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6[55562]: 2024-09-11T22:41:05.498+0000 7f530c935640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.886897+0000 front 2024-09-11T22:40:41.886869+0000 (oldest deadline 2024-09-11T22:41:02.987003+0000) 2024-09-11T22:41:05.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:05.650+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:05.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:05.650+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:05.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:05.808+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:05.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:05.808+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:05.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:05 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:05.808+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:06.592 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:06 smithi022 podman[101798]: 2024-09-11 22:41:06.329162734 +0000 UTC m=+5.510049028 container died d6a2bbf7a1d8dfd9ab74f1a305e2e6c44337be451c8c8a48b68aa5165fd8be79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-11T22:41:06.593 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:06 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:06.235+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:06.593 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:06 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:06.235+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:06.593 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:06 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:06.235+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:06.593 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:06 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:06.235+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:06.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:06.293+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:06.293+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:06.293+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:06.415+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:06.415+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:06.415+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:06.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:06.415+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:06.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:06 smithi022 podman[101798]: 2024-09-11 22:41:06.800057813 +0000 UTC m=+5.980944149 container cleanup d6a2bbf7a1d8dfd9ab74f1a305e2e6c44337be451c8c8a48b68aa5165fd8be79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-11T22:41:06.902 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:06 smithi022 bash[101798]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:06.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:06.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:06.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:06.651+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:06.651+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:06.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:06 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:06.651+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:07.402 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101814]: 2024-09-11 22:41:07.101505948 +0000 UTC m=+0.766171958 container remove d6a2bbf7a1d8dfd9ab74f1a305e2e6c44337be451c8c8a48b68aa5165fd8be79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-11T22:41:07.402 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:07.229+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:07.403 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:07.229+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:07.403 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:07.229+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:07.403 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:07 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:07.229+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:07.342+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:07.342+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:07.342+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:07.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:07.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:07.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:07.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:07 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:07.380+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:07.738 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.332756661 +0000 UTC m=+0.016548316 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:07.739 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.431079492 +0000 UTC m=+0.114871180 container create 07d9fd933324c347f344afc67e068673fe885c7fe2f13add1161d450dbbe302e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:07.739 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.663120535 +0000 UTC m=+0.346912184 container init 07d9fd933324c347f344afc67e068673fe885c7fe2f13add1161d450dbbe302e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T22:41:07.739 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.666494186 +0000 UTC m=+0.350285831 container start 07d9fd933324c347f344afc67e068673fe885c7fe2f13add1161d450dbbe302e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:41:08.152 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.737862068 +0000 UTC m=+0.421653734 container attach 07d9fd933324c347f344afc67e068673fe885c7fe2f13add1161d450dbbe302e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T22:41:08.152 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 11 22:41:07 smithi022 podman[101902]: 2024-09-11 22:41:07.865916557 +0000 UTC m=+0.549708203 container died 07d9fd933324c347f344afc67e068673fe885c7fe2f13add1161d450dbbe302e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:07.767+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:07.767+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:07.767+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:07.669+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:07.669+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:08.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:07 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:07.669+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:08.416 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:08 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:08.266+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:08.416 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:08 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:08.266+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:08.416 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:08 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:08.266+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:08.416 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:08 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:08.266+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:08.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T22:41:08.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:08.484 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T22:41:08.484 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T22:41:08.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.7 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:08.400+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:08.400+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:08.400+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:08.400+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.370+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.370+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.370+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:08.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 systemd[1]: Stopping Ceph osd.7 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:09.152 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:08.713+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:09.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:08.713+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:09.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:08.713+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:09.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:08.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:09.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:08.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:09.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:08 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:08.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:09.162 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.794+0000 7f7ae6a06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:09.162 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.794+0000 7f7ae6a06640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-11T22:41:09.162 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:08 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:08.794+0000 7f7ae6a06640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:09.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:09.264+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:09.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:09.264+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:09.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:09.264+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:09.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:09 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:09.264+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:09.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:09.340+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:09.340+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:09.340+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:09.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:09.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:09.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:09.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:09 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:09.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:10.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:09.677+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:10.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:09.677+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:10.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:09.677+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:10.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:09.674+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:10.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:09.674+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:10.153 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:09 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:09.674+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:10.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:10 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:10.274+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:10.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:10 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:10.274+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:10.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:10 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:10.274+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:10.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:10 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:10.274+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:10.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:10.312+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:10.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:10.312+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:10.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:10.312+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:10.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:10.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:10.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:10.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:10.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:10.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:10.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:10 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:10.426+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:10.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:10.664+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:10.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:10.664+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:10.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:10.664+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:10.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:10.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:10.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:10.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:10.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:10 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:10.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:11.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:11.257+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:11.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:11.257+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:11.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:11.257+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:11.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:11 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:11.257+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:11.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:11.315+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:11.315+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:11.315+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:11.315+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.009917+0000 front 2024-09-11T22:40:49.009895+0000 (oldest deadline 2024-09-11T22:41:10.709966+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:11.417+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:11.417+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:11.417+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:11.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:11.417+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:11.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:11.604+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:11.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:11.604+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:11.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:11.604+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:11.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:11.614+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:11.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:11.614+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:11.904 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:11.614+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:11.904 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:11 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:11.614+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:12.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:12 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:12.252+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:12.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:12 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:12.252+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:12.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:12 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:12.252+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:12.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:12 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:12.252+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:12.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:12.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:12.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:12.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:12.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:12.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.009917+0000 front 2024-09-11T22:40:49.009895+0000 (oldest deadline 2024-09-11T22:41:10.709966+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:12.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:12.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:12.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:12.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:12 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:12.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:12.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:12.653+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:12.653+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:12.653+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:12.584+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:12.584+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:12.584+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:12.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:12 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:12.584+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:13.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:13.240+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:13.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:13.240+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:13.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:13.240+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:13.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:13.240+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:13.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:13 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:13.240+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:13.661 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:13.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:21.006071+0000 front 2024-09-11T22:40:21.006089+0000 (oldest deadline 2024-09-11T22:40:46.906181+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:13.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.307631+0000 front 2024-09-11T22:40:30.307656+0000 (oldest deadline 2024-09-11T22:40:56.207737+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:13.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.308789+0000 front 2024-09-11T22:40:40.308935+0000 (oldest deadline 2024-09-11T22:41:02.608669+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7[53270]: 2024-09-11T22:41:13.298+0000 7f7ae300b640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.009917+0000 front 2024-09-11T22:40:49.009895+0000 (oldest deadline 2024-09-11T22:41:10.709966+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:13.399+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:13.399+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:13.399+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:13.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:13 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:13.399+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:13.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:13.634+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:13.634+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:13.634+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:13.575+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:13.575+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:13.575+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:13.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:13 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:13.575+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:14.621 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:14 smithi045 podman[71783]: 2024-09-11 22:41:14.352089656 +0000 UTC m=+5.662641887 container died c9a8bcb1f05dc2b4d7c121ae151489acffb832f2dba93bac29f4648004bc0ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T22:41:14.621 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:14 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:14.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:14.621 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:14 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:14.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:14.622 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:14 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:14.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:14.622 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:14 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:14.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:14.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:14 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:14.271+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:14.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:14 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:14.271+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:14.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:14 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:14.271+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:14.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:14 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:14.271+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:14.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:14 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:14.271+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:14.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:14.625+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:14.625+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:14.625+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:14.625+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:14.596+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:14.596+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:14.596+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:14.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:14 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:14.596+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:14.911 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:14 smithi045 podman[71783]: 2024-09-11 22:41:14.702816528 +0000 UTC m=+6.013368760 container cleanup c9a8bcb1f05dc2b4d7c121ae151489acffb832f2dba93bac29f4648004bc0ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:14.911 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:14 smithi045 bash[71783]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7 2024-09-11T22:41:15.326 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:14 smithi045 podman[71798]: 2024-09-11 22:41:14.98784844 +0000 UTC m=+0.634176620 container remove c9a8bcb1f05dc2b4d7c121ae151489acffb832f2dba93bac29f4648004bc0ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T22:41:15.591 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.229396271 +0000 UTC m=+0.015900113 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:15.591 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.35526674 +0000 UTC m=+0.141770584 container create 55eeb25fdbf1126e6639b47378bb4c237b2bf98638504ba32d813efba2a60489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:15.591 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.591378959 +0000 UTC m=+0.377882815 container init 55eeb25fdbf1126e6639b47378bb4c237b2bf98638504ba32d813efba2a60489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T22:41:15.592 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:15 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:15.342+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:15.592 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:15 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:15.342+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:15.592 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:15 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:15.342+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:15.592 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:15 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:15.342+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:15.592 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:15 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:15.342+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:15.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:15 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:15.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:15.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:15 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:15.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:15.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:15 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:15.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:15.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:15 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:15.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:15.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:15 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:15.302+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:15.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:15.626+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:15.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:15.626+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:15.626+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:15.626+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:15.573+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:15.573+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:15.573+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:15.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:15 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:15.573+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:15.911 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.594843936 +0000 UTC m=+0.381347777 container start 55eeb25fdbf1126e6639b47378bb4c237b2bf98638504ba32d813efba2a60489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T22:41:15.912 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.682958701 +0000 UTC m=+0.469462572 container attach 55eeb25fdbf1126e6639b47378bb4c237b2bf98638504ba32d813efba2a60489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:15.912 INFO:journalctl@ceph.osd.7.smithi045.stdout:Sep 11 22:41:15 smithi045 podman[71889]: 2024-09-11 22:41:15.789013623 +0000 UTC m=+0.575517472 container died 55eeb25fdbf1126e6639b47378bb4c237b2bf98638504ba32d813efba2a60489 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-11T22:41:16.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T22:41:16.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:16.552 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T22:41:16.552 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T22:41:16.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.8 2024-09-11T22:41:16.625 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.582+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:16.625 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.582+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:16.625 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.582+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:16.625 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.582+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:16.625 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 systemd[1]: Stopping Ceph osd.8 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:16.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:16 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:16.343+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:16.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:16 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:16.343+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:16.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:16 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:16.343+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:16.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:16 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:16.343+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:16.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:16 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:16.343+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:16.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:16.348+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:16.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:16.348+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:16.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:16.348+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:16.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:16.348+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:16.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:16.348+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.843+0000 7fd97e285640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.843+0000 7fd97e285640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:16.843+0000 7fd97e285640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:16.622+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:16.622+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:16.622+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:16.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:16 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:16.622+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:17.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:17 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:17.377+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:17.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:17 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:17.377+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:17.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:17 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:17.377+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:17.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:17 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:17.377+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:17.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:17 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:17.377+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:17.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:17.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:17.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:17.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:17.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:17.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:17.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:17.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:17.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:17 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:17.391+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:17.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:17.617+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:17.617+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:17.617+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:17.617+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:17.671+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:17.671+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:17.671+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:17.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:17 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:17.671+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:18.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:18 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:18.363+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:18.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:18 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:18.363+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:18.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:18 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:18.363+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:18.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:18 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:18.363+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:18.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:18 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:18.363+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:18.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:18 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:18.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:18.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:18 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:18.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:18.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:18 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:18.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:18.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:18 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:18.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:18.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:18 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:18.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:18.605+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:18.605+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:18.605+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:18.605+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:18.709+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:18.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:18.709+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:18.904 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:18.709+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:18.904 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:18 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:18.709+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:19.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:19 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:19.344+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:19.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:19.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:19.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:19.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:19.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:19.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:19.367+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:19.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:19.560+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:19.560+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:19.560+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:19.560+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:19.733+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:19.733+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:19.733+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:19.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:19 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:19.733+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:20.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:20 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:20.311+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:20.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:20.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:20.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:20.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:20.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:20.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:20 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:20.383+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:20.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:20.591+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:20.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:20.591+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:20.591+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:20.591+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:20.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:20.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:20.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:20.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:20 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:20.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.279+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.279+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.280+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.280+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.280+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:21.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:21 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:21.280+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:21.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:21.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:21.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:21.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:21.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:21.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:21 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:21.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:21.902 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:21.626+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:15.232004+0000 front 2024-09-11T22:40:15.232205+0000 (oldest deadline 2024-09-11T22:40:44.032792+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:21.626+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.134713+0000 front 2024-09-11T22:40:32.134848+0000 (oldest deadline 2024-09-11T22:40:58.034906+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:21.626+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:40.236569+0000 front 2024-09-11T22:40:40.236468+0000 (oldest deadline 2024-09-11T22:41:06.136366+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8[54391]: 2024-09-11T22:41:21.626+0000 7fd976882640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.037603+0000 front 2024-09-11T22:40:49.037509+0000 (oldest deadline 2024-09-11T22:41:10.737368+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:21.749+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:21.749+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:21.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:21.749+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:21.904 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:21.749+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:21.904 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:21 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:21.749+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:22.459 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:22 smithi169 podman[72028]: 2024-09-11 22:41:22.1731725 +0000 UTC m=+5.430434130 container died 63e970c3cfc2a0aaf005f1c85f07cc3be0b80d3510b2625b46f9a818aed2237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:22.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:22 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:22.269+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:22.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:22.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:22.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:22.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:22.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:22.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:22 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:22.325+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:22.711 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:22 smithi169 podman[72028]: 2024-09-11 22:41:22.459412309 +0000 UTC m=+5.716673937 container cleanup 63e970c3cfc2a0aaf005f1c85f07cc3be0b80d3510b2625b46f9a818aed2237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:22.711 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:22 smithi169 bash[72028]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8 2024-09-11T22:41:23.074 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:22 smithi169 podman[72043]: 2024-09-11 22:41:22.711011587 +0000 UTC m=+0.534306518 container remove 63e970c3cfc2a0aaf005f1c85f07cc3be0b80d3510b2625b46f9a818aed2237f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-11T22:41:23.074 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:22 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:22.724+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:23.074 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:22 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:22.724+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:23.074 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:22 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:22.724+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:23.075 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:22 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:22.724+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:23.075 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:22 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:22.724+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:23.326 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:22.977369087 +0000 UTC m=+0.016144980 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:23.326 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:23.103489581 +0000 UTC m=+0.142265468 container create dd8a3f6e558f717721d6a6818b3e68fd4e590bfde8ca66fd9b87bbbc2edf23a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T22:41:23.326 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:23.322398849 +0000 UTC m=+0.361174736 container init dd8a3f6e558f717721d6a6818b3e68fd4e590bfde8ca66fd9b87bbbc2edf23a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T22:41:23.326 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:23.325729277 +0000 UTC m=+0.364505165 container start dd8a3f6e558f717721d6a6818b3e68fd4e590bfde8ca66fd9b87bbbc2edf23a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:23.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:23 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:23.296+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:23.653 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:23.422479834 +0000 UTC m=+0.461255721 container attach dd8a3f6e558f717721d6a6818b3e68fd4e590bfde8ca66fd9b87bbbc2edf23a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:23.653 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 11 22:41:23 smithi169 podman[72134]: 2024-09-11 22:41:23.526310404 +0000 UTC m=+0.565086298 container died dd8a3f6e558f717721d6a6818b3e68fd4e590bfde8ca66fd9b87bbbc2edf23a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T22:41:23.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:23.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:23.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:23.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:23.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:23.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:23 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:23.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:24.018 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:23.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:24.018 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:23.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:24.018 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:23.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:24.018 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:23.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:24.018 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:23.716+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:24.043 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T22:41:24.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:24.086 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T22:41:24.086 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T22:41:24.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.9 2024-09-11T22:41:24.294 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:24.294 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:24.294 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:24.294 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:24.294 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 systemd[1]: Stopping Ceph osd.9 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:24.394 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.262+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:24.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.393+0000 7fc0c1589640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:24.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.393+0000 7fc0c1589640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-11T22:41:24.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:24 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:24.393+0000 7fc0c1589640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:24.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:24 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:24.292+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:25.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:24.700+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:25.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:24.700+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:25.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:24.700+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:25.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:24.700+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:25.155 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:24 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:24.700+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:25.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:25.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:25.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:25.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:25.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:25.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:25 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:25.287+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:25.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:25.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:25.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:25.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:25.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:25.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:25 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:25.278+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:26.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:25.674+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:26.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:25.674+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:26.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:25.674+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:26.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:25.674+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:26.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:25.674+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:26.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:26 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:26.316+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:26.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:26.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:26.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:26.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:26.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:26.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:26 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:26.324+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:26.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:26.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:26.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:26.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:26.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:26.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:26 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:26.631+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:27.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:27 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:27.342+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:27.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:27.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:27.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:27.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:27.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:27.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:27 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:27.368+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:28.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:28.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:28.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:28.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:28.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:28.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:27 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:27.662+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:28.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:28.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:28.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:28.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:28.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:28.653 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:28 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:28.388+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:28.665 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:28.665 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:28.665 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:28.665 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:28.665 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:28.666 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:28 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:28.340+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:29.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.688+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:29.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.688+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:29.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:29.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:29.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:29.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:28 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:28.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:14.661129+0000 front 2024-09-11T22:40:14.661301+0000 (oldest deadline 2024-09-11T22:40:39.961228+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:25.063294+0000 front 2024-09-11T22:40:25.063279+0000 (oldest deadline 2024-09-11T22:40:52.063801+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:33.164839+0000 front 2024-09-11T22:40:33.164695+0000 (oldest deadline 2024-09-11T22:40:55.464623+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:41.866127+0000 front 2024-09-11T22:40:41.866185+0000 (oldest deadline 2024-09-11T22:41:04.766184+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:48.866980+0000 front 2024-09-11T22:40:48.866998+0000 (oldest deadline 2024-09-11T22:41:12.967000+0000) 2024-09-11T22:41:29.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9[62539]: 2024-09-11T22:41:29.383+0000 7fc0b9b86640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:52.967624+0000 front 2024-09-11T22:40:52.967639+0000 (oldest deadline 2024-09-11T22:41:18.867514+0000) 2024-09-11T22:41:29.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:29.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:29.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:29.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:29.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:29.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:29 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:29.318+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:30.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:30.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:30.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:30.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:30.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:30.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:29 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:29.725+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:30.185 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:29 smithi022 podman[102016]: 2024-09-11 22:41:29.932702007 +0000 UTC m=+5.641646773 container died 1a3a67bd68b90a4ac146017e87e54379442a6cdb1c73da62f6a18f27a6697230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:41:30.460 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:30 smithi022 podman[102016]: 2024-09-11 22:41:30.27569972 +0000 UTC m=+5.984644486 container cleanup 1a3a67bd68b90a4ac146017e87e54379442a6cdb1c73da62f6a18f27a6697230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T22:41:30.460 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:30 smithi022 bash[102016]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9 2024-09-11T22:41:30.625 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:30.625 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:30.626 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:30.626 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:30.626 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:30.626 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:30 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:30.313+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:30.902 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:30 smithi022 podman[102036]: 2024-09-11 22:41:30.460243656 +0000 UTC m=+0.519874809 container remove 1a3a67bd68b90a4ac146017e87e54379442a6cdb1c73da62f6a18f27a6697230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:41:31.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:31.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:31.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:31.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:31.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:31.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:30.713+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:31.230 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:30 smithi022 podman[102125]: 2024-09-11 22:41:30.808340397 +0000 UTC m=+0.017081093 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:31.230 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:30 smithi022 podman[102125]: 2024-09-11 22:41:30.910954498 +0000 UTC m=+0.119695247 container create c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:31.230 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:31 smithi022 podman[102125]: 2024-09-11 22:41:31.146536518 +0000 UTC m=+0.355277207 container init c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T22:41:31.230 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:31 smithi022 podman[102125]: 2024-09-11 22:41:31.150011399 +0000 UTC m=+0.358752081 container start c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-11T22:41:31.230 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:31 smithi022 podman[102125]: 2024-09-11 22:41:31.229684082 +0000 UTC m=+0.438424779 container attach c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:41:31.652 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:31 smithi022 podman[102125]: 2024-09-11 22:41:31.344805138 +0000 UTC m=+0.553545831 container died c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:31.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:31 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:31.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:31.961 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 11 22:41:31 smithi022 podman[102148]: 2024-09-11 22:41:31.958321505 +0000 UTC m=+0.604284087 container remove c799f18443f97068e9c8e292397de499a3d8809027c0e719a01c61058dae2ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T22:41:31.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T22:41:32.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:32.022 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T22:41:32.022 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T22:41:32.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.10 2024-09-11T22:41:32.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:32.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:32.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:32.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:32.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:32.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:31 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:31.689+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:32.331 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 systemd[1]: Stopping Ceph osd.10 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.330+0000 7f2b51117640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.330+0000 7f2b51117640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.330+0000 7f2b51117640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:32.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:32.663 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:32.663 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:32 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:32.349+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:32.902 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:32.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:32.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:32.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:32.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:32.903 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:32 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:32.641+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:33.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:33.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:33 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:33.301+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:34.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:34.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:34.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:34.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:34.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:34.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:33 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:33.673+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:34.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:34.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:34 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:34.283+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:35.054 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:35.054 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:35.054 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:35.054 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:35.054 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:35.055 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:34.722+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:35.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:35.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:35 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:35.322+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:36.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:36.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:36.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:36.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:36.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:36.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:35 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:35.683+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:36.661 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.543244+0000 front 2024-09-11T22:40:17.543231+0000 (oldest deadline 2024-09-11T22:40:39.743639+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:24.845620+0000 front 2024-09-11T22:40:24.845587+0000 (oldest deadline 2024-09-11T22:40:50.145798+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:30.146535+0000 front 2024-09-11T22:40:30.146444+0000 (oldest deadline 2024-09-11T22:40:55.346864+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-11T22:40:39.948567+0000 front 2024-09-11T22:40:39.948533+0000 (oldest deadline 2024-09-11T22:41:02.749144+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:49.750382+0000 front 2024-09-11T22:40:49.750359+0000 (oldest deadline 2024-09-11T22:41:15.050455+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.151584+0000 front 2024-09-11T22:40:56.151533+0000 (oldest deadline 2024-09-11T22:41:19.051472+0000) 2024-09-11T22:41:36.662 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:36 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10[60000]: 2024-09-11T22:41:36.312+0000 7f2b49714640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.753162+0000 front 2024-09-11T22:41:04.753142+0000 (oldest deadline 2024-09-11T22:41:30.653092+0000) 2024-09-11T22:41:37.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:37.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:36 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:36.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:38.123 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:37 smithi045 podman[72005]: 2024-09-11 22:41:37.859847495 +0000 UTC m=+5.633193636 container died 163614b1d7f50ff11420a44ff15a54d4c798e0ffd8cc1d44f707bfc93e2ccaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:38.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:38.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:38.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:38.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:38.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:38.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:38.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:37 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:37.779+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:38.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:38 smithi045 podman[72005]: 2024-09-11 22:41:38.246746015 +0000 UTC m=+6.020092156 container cleanup 163614b1d7f50ff11420a44ff15a54d4c798e0ffd8cc1d44f707bfc93e2ccaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T22:41:38.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:38 smithi045 bash[72005]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10 2024-09-11T22:41:38.817 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:38 smithi045 podman[72020]: 2024-09-11 22:41:38.481413148 +0000 UTC m=+0.622019906 container remove 163614b1d7f50ff11420a44ff15a54d4c798e0ffd8cc1d44f707bfc93e2ccaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T22:41:39.118 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:38 smithi045 podman[72107]: 2024-09-11 22:41:38.719455223 +0000 UTC m=+0.015852038 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:39.118 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:38 smithi045 podman[72107]: 2024-09-11 22:41:38.82367303 +0000 UTC m=+0.120069847 container create 00b3052579bedadecdc8c3d7f53cd99509ead05c699719ef295d59cb7a673f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T22:41:39.118 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:39 smithi045 podman[72107]: 2024-09-11 22:41:39.042970357 +0000 UTC m=+0.339367175 container init 00b3052579bedadecdc8c3d7f53cd99509ead05c699719ef295d59cb7a673f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T22:41:39.118 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:39 smithi045 podman[72107]: 2024-09-11 22:41:39.046167543 +0000 UTC m=+0.342564368 container start 00b3052579bedadecdc8c3d7f53cd99509ead05c699719ef295d59cb7a673f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T22:41:39.118 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:39 smithi045 podman[72107]: 2024-09-11 22:41:39.117978855 +0000 UTC m=+0.414375674 container attach 00b3052579bedadecdc8c3d7f53cd99509ead05c699719ef295d59cb7a673f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:39.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:39.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:38 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:38.732+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:39.412 INFO:journalctl@ceph.osd.10.smithi045.stdout:Sep 11 22:41:39 smithi045 podman[72107]: 2024-09-11 22:41:39.241291563 +0000 UTC m=+0.537688378 container died 00b3052579bedadecdc8c3d7f53cd99509ead05c699719ef295d59cb7a673f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:41:39.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T22:41:39.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:39.860 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T22:41:39.860 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T22:41:39.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.11 2024-09-11T22:41:40.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:40.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:40.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:40.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:40.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:40.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:40.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:39.765+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:40.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:39 smithi169 systemd[1]: Stopping Ceph osd.11 for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:40.652 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.152+0000 7f5cd5eaf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:40.653 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.152+0000 7f5cd5eaf640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-11T22:41:40.653 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.153+0000 7f5cd5eaf640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:41.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:41.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:40 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:40.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:42.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:41 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:41.800+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:43.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:43.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:43.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:43.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:43.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:43.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:43.154 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:42 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:42.760+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:44.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:44.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:43 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:43.751+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:45.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-11T22:40:17.541517+0000 front 2024-09-11T22:40:17.541502+0000 (oldest deadline 2024-09-11T22:40:39.841313+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6804 osd.1 since back 2024-09-11T22:40:26.242880+0000 front 2024-09-11T22:40:26.242806+0000 (oldest deadline 2024-09-11T22:40:47.942978+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-11T22:40:32.044016+0000 front 2024-09-11T22:40:32.043811+0000 (oldest deadline 2024-09-11T22:40:57.344028+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6812 osd.4 since back 2024-09-11T22:40:45.545518+0000 front 2024-09-11T22:40:45.545679+0000 (oldest deadline 2024-09-11T22:41:13.746029+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-11T22:40:56.046747+0000 front 2024-09-11T22:40:56.046810+0000 (oldest deadline 2024-09-11T22:41:20.746841+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.727+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-11T22:41:04.847756+0000 front 2024-09-11T22:41:04.847659+0000 (oldest deadline 2024-09-11T22:41:26.547437+0000) 2024-09-11T22:41:45.153 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:44 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11[60997]: 2024-09-11T22:41:44.728+0000 7f5cce4ac640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.45:6820 osd.7 since back 2024-09-11T22:41:13.449671+0000 front 2024-09-11T22:41:13.449614+0000 (oldest deadline 2024-09-11T22:41:35.749477+0000) 2024-09-11T22:41:45.653 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:45 smithi169 podman[72251]: 2024-09-11 22:41:45.495749761 +0000 UTC m=+5.440978711 container died e22f46a3fd6e726810d187fcd88f677df8a2301daf1881d91ccb544609390365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-11T22:41:46.137 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:45 smithi169 podman[72251]: 2024-09-11 22:41:45.86091121 +0000 UTC m=+5.806140159 container cleanup e22f46a3fd6e726810d187fcd88f677df8a2301daf1881d91ccb544609390365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T22:41:46.137 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:45 smithi169 bash[72251]: ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11 2024-09-11T22:41:46.402 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72268]: 2024-09-11 22:41:46.137085189 +0000 UTC m=+0.637727544 container remove e22f46a3fd6e726810d187fcd88f677df8a2301daf1881d91ccb544609390365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:41:46.782 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.383408045 +0000 UTC m=+0.015778687 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:46.782 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.496351182 +0000 UTC m=+0.128721870 container create 77c1b2c1bb8cc774652c429985f8a550cb02110b1d453755b4c0d18b86e52653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T22:41:46.782 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.698566269 +0000 UTC m=+0.330936920 container init 77c1b2c1bb8cc774652c429985f8a550cb02110b1d453755b4c0d18b86e52653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:46.782 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.701815248 +0000 UTC m=+0.334185898 container start 77c1b2c1bb8cc774652c429985f8a550cb02110b1d453755b4c0d18b86e52653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T22:41:46.782 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.782088269 +0000 UTC m=+0.414458914 container attach 77c1b2c1bb8cc774652c429985f8a550cb02110b1d453755b4c0d18b86e52653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:41:47.152 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 11 22:41:46 smithi169 podman[72355]: 2024-09-11 22:41:46.888885101 +0000 UTC m=+0.521255747 container died 77c1b2c1bb8cc774652c429985f8a550cb02110b1d453755b4c0d18b86e52653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:41:47.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T22:41:47.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:47.497 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T22:41:47.497 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T22:41:47.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.a 2024-09-11T22:41:47.802 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:47 smithi022 systemd[1]: Stopping Ceph mds.a for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:48.152 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a[69285]: 2024-09-11T22:41:47.801+0000 7f5666ac3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:48.152 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:47 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a[69285]: 2024-09-11T22:41:47.801+0000 7f5666ac3640 -1 mds.a *** got signal Terminated *** 2024-09-11T22:41:51.760 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:51 smithi022 podman[102251]: 2024-09-11 22:41:51.488154004 +0000 UTC m=+3.786552649 container died 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T22:41:52.119 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:51 smithi022 podman[102251]: 2024-09-11 22:41:51.926275974 +0000 UTC m=+4.224674652 container cleanup 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T22:41:52.119 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:51 smithi022 bash[102251]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a 2024-09-11T22:41:52.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T22:41:52.388 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:52 smithi022 podman[102263]: 2024-09-11 22:41:52.119331322 +0000 UTC m=+0.631472120 container remove 138a89153760b6bc4e9626318655d99ab61bc20651b51d9695d17892d2910bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T22:41:52.388 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:52 smithi022 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-11T22:41:52.388 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:52 smithi022 systemd[1]: Stopped Ceph mds.a for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:41:52.388 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 11 22:41:52 smithi022 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.a.service: Consumed 1.082s CPU time. 2024-09-11T22:41:52.402 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:52.402 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T22:41:52.402 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T22:41:52.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.d 2024-09-11T22:41:52.652 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:52 smithi022 systemd[1]: Stopping Ceph mds.d for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:53.152 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d[68097]: 2024-09-11T22:41:52.847+0000 7fc4f5d48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:53.152 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:52 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d[68097]: 2024-09-11T22:41:52.847+0000 7fc4f5d48640 -1 mds.d *** got signal Terminated *** 2024-09-11T22:41:57.130 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:56 smithi022 podman[102372]: 2024-09-11 22:41:56.85861529 +0000 UTC m=+4.228957629 container died 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T22:41:57.402 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:57 smithi022 podman[102372]: 2024-09-11 22:41:57.212793188 +0000 UTC m=+4.583135524 container cleanup 9559ef3a84d072a129e4e75ed44121bcc665aa9e08a5bfb051862fddd488c5c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T22:41:57.402 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 11 22:41:57 smithi022 bash[102372]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-d 2024-09-11T22:41:57.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T22:41:57.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:57.696 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T22:41:57.696 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T22:41:57.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.g 2024-09-11T22:41:58.025 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:41:57 smithi022 systemd[1]: Stopping Ceph mds.g for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:58.402 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:41:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g[68868]: 2024-09-11T22:41:58.024+0000 7f2e51de7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:58.402 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:41:58 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g[68868]: 2024-09-11T22:41:58.024+0000 7f2e51de7640 -1 mds.g *** got signal Terminated *** 2024-09-11T22:42:00.351 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:42:00 smithi022 podman[102492]: 2024-09-11 22:42:00.078381459 +0000 UTC m=+2.149653209 container died cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:42:00.652 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:42:00 smithi022 podman[102492]: 2024-09-11 22:42:00.433310172 +0000 UTC m=+2.504581911 container cleanup cf2691251d422548d0bec61f8d2273f391f1c7615fd4e5a9605d238b6be8e756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T22:42:00.652 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 11 22:42:00 smithi022 bash[102492]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-g 2024-09-11T22:42:00.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T22:42:00.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:00.904 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T22:42:00.904 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T22:42:00.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.j 2024-09-11T22:42:01.228 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:00 smithi022 systemd[1]: Stopping Ceph mds.j for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:01.652 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j[67701]: 2024-09-11T22:42:01.228+0000 7f17914d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:01.652 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:01 smithi022 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j[67701]: 2024-09-11T22:42:01.228+0000 7f17914d1640 -1 mds.j *** got signal Terminated *** 2024-09-11T22:42:05.652 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:05 smithi022 podman[102612]: 2024-09-11 22:42:05.235614896 +0000 UTC m=+4.111890803 container died f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T22:42:06.037 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:05 smithi022 podman[102612]: 2024-09-11 22:42:05.82809271 +0000 UTC m=+4.704368623 container cleanup f929a19eb09ce086cdec59d8ac8fc118566ee214de94fa2ea1bfd76d3b608d1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:42:06.037 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 11 22:42:05 smithi022 bash[102612]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-j 2024-09-11T22:42:06.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T22:42:06.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:06.209 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T22:42:06.209 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T22:42:06.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.b 2024-09-11T22:42:06.522 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:06 smithi045 systemd[1]: Stopping Ceph mds.b for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:06.790 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: 2024-09-11T22:42:06.521+0000 7f3fa6b5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:06.791 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:06 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b[65689]: 2024-09-11T22:42:06.521+0000 7f3fa6b5c640 -1 mds.b *** got signal Terminated *** 2024-09-11T22:42:10.722 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:10 smithi045 podman[72211]: 2024-09-11 22:42:10.432872146 +0000 UTC m=+4.022326518 container died d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:11.073 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:10 smithi045 podman[72211]: 2024-09-11 22:42:10.796928084 +0000 UTC m=+4.386382446 container cleanup d4026cdd82b574d94c10977074b6ab83ded38bb3656299afeb88cf63635cae9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-11T22:42:11.073 INFO:journalctl@ceph.mds.b.smithi045.stdout:Sep 11 22:42:10 smithi045 bash[72211]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-b 2024-09-11T22:42:11.237 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T22:42:11.273 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:11.273 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T22:42:11.273 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T22:42:11.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.e 2024-09-11T22:42:11.609 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:11 smithi045 systemd[1]: Stopping Ceph mds.e for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:11.912 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e[65081]: 2024-09-11T22:42:11.608+0000 7f3eaf5fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:11.912 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:11 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e[65081]: 2024-09-11T22:42:11.608+0000 7f3eaf5fd640 -1 mds.e *** got signal Terminated *** 2024-09-11T22:42:15.876 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:15 smithi045 podman[72344]: 2024-09-11 22:42:15.618395979 +0000 UTC m=+4.112357284 container died 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:42:16.161 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:16 smithi045 podman[72344]: 2024-09-11 22:42:16.100325381 +0000 UTC m=+4.594286686 container cleanup 8683002695a88d281a30f79a3ccd8907b6de2248da7afc923a0790f4a416f097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T22:42:16.161 INFO:journalctl@ceph.mds.e.smithi045.stdout:Sep 11 22:42:16 smithi045 bash[72344]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-e 2024-09-11T22:42:16.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T22:42:16.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:16.494 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T22:42:16.494 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T22:42:16.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h 2024-09-11T22:42:16.661 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:16 smithi045 systemd[1]: Stopping Ceph mds.h for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:17.162 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: 2024-09-11T22:42:16.811+0000 7f3e3748b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:17.162 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:16 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h[69092]: 2024-09-11T22:42:16.811+0000 7f3e3748b640 -1 mds.h *** got signal Terminated *** 2024-09-11T22:42:18.695 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:18 smithi045 podman[72468]: 2024-09-11 22:42:18.431354623 +0000 UTC m=+1.715587984 container died 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T22:42:18.695 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:18 smithi045 podman[72468]: 2024-09-11 22:42:18.69547918 +0000 UTC m=+1.979712540 container cleanup 3f5afbaef011c32924b66ae68231ab5abd2ead9b8a52ea151b571f65b167056b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:42:18.997 INFO:journalctl@ceph.mds.h.smithi045.stdout:Sep 11 22:42:18 smithi045 bash[72468]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-h 2024-09-11T22:42:19.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T22:42:19.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:19.211 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T22:42:19.211 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T22:42:19.211 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.k 2024-09-11T22:42:19.533 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:19 smithi045 systemd[1]: Stopping Ceph mds.k for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:19.911 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k[64765]: 2024-09-11T22:42:19.532+0000 7f5e455c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:19.912 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:19 smithi045 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k[64765]: 2024-09-11T22:42:19.532+0000 7f5e455c9640 -1 mds.k *** got signal Terminated *** 2024-09-11T22:42:22.409 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:22 smithi045 podman[72588]: 2024-09-11 22:42:22.036800713 +0000 UTC m=+2.601840741 container died 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T22:42:22.661 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:22 smithi045 podman[72588]: 2024-09-11 22:42:22.499382672 +0000 UTC m=+3.064422683 container cleanup 36414c2906b62f424ce76c7937242b4ce98a10ac573be58839ed465cf90404f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T22:42:22.662 INFO:journalctl@ceph.mds.k.smithi045.stdout:Sep 11 22:42:22 smithi045 bash[72588]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-k 2024-09-11T22:42:22.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T22:42:22.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:22.965 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T22:42:22.965 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T22:42:22.965 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.c 2024-09-11T22:42:23.260 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:23 smithi169 systemd[1]: Stopping Ceph mds.c for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:23.261 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c[65852]: 2024-09-11T22:42:23.259+0000 7fbcfdd7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:23.261 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:23 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c[65852]: 2024-09-11T22:42:23.259+0000 7fbcfdd7d640 -1 mds.c *** got signal Terminated *** 2024-09-11T22:42:24.835 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:24 smithi169 podman[72457]: 2024-09-11 22:42:24.403642185 +0000 UTC m=+1.241069450 container died 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T22:42:25.135 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:24 smithi169 podman[72457]: 2024-09-11 22:42:24.942700178 +0000 UTC m=+1.780127445 container cleanup 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:42:25.135 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:24 smithi169 bash[72457]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c 2024-09-11T22:42:25.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T22:42:25.386 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:25 smithi169 podman[72472]: 2024-09-11 22:42:25.135572084 +0000 UTC m=+0.730669602 container remove 883fa02f9d68d5e22f028aabbd1fa2e7e8e67733515c1180286556a5df834fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T22:42:25.386 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:25 smithi169 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-11T22:42:25.386 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:25 smithi169 systemd[1]: Stopped Ceph mds.c for c727338c-708b-11ef-bcea-c7b262605968. 2024-09-11T22:42:25.386 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 11 22:42:25 smithi169 systemd[1]: ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.c.service: Consumed 1.038s CPU time. 2024-09-11T22:42:25.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:25.400 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T22:42:25.400 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T22:42:25.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.f 2024-09-11T22:42:25.652 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:25 smithi169 systemd[1]: Stopping Ceph mds.f for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:26.153 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f[65548]: 2024-09-11T22:42:25.738+0000 7faada6e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:26.153 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:25 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f[65548]: 2024-09-11T22:42:25.738+0000 7faada6e5640 -1 mds.f *** got signal Terminated *** 2024-09-11T22:42:30.040 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:29 smithi169 podman[72592]: 2024-09-11 22:42:29.74450289 +0000 UTC m=+4.121767629 container died 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T22:42:30.380 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:30 smithi169 podman[72592]: 2024-09-11 22:42:30.121578259 +0000 UTC m=+4.498843033 container cleanup 75b57df03c22e5838a364e02f201d5fb9672d7ec64f7f0bdb88a70456beec0f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T22:42:30.381 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 11 22:42:30 smithi169 bash[72592]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-f 2024-09-11T22:42:30.548 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T22:42:30.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:30.581 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T22:42:30.581 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T22:42:30.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.i 2024-09-11T22:42:30.892 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:30 smithi169 systemd[1]: Stopping Ceph mds.i for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:31.152 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i[66168]: 2024-09-11T22:42:30.891+0000 7f45943d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:31.152 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:30 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i[66168]: 2024-09-11T22:42:30.891+0000 7f45943d8640 -1 mds.i *** got signal Terminated *** 2024-09-11T22:42:33.874 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:33 smithi169 podman[72715]: 2024-09-11 22:42:33.544505465 +0000 UTC m=+2.746732196 container died e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T22:42:33.875 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:33 smithi169 podman[72715]: 2024-09-11 22:42:33.874966699 +0000 UTC m=+3.077193423 container cleanup e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T22:42:34.152 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:33 smithi169 bash[72715]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i 2024-09-11T22:42:34.152 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 11 22:42:34 smithi169 podman[72729]: 2024-09-11 22:42:34.076148015 +0000 UTC m=+0.532565719 container remove e66ab1dcccfb165d147e725c5039efd960794f0639e7c9b54d19e6770c77b7f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T22:42:34.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T22:42:34.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:34.336 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T22:42:34.337 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T22:42:34.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.l 2024-09-11T22:42:34.652 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:34 smithi169 systemd[1]: Stopping Ceph mds.l for c727338c-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:35.153 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l[65247]: 2024-09-11T22:42:34.653+0000 7f85e6497640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:35.153 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:34 smithi169 ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l[65247]: 2024-09-11T22:42:34.653+0000 7f85e6497640 -1 mds.l *** got signal Terminated *** 2024-09-11T22:42:39.012 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:38 smithi169 podman[72836]: 2024-09-11 22:42:38.666530961 +0000 UTC m=+4.113231262 container died 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T22:42:39.402 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:39 smithi169 podman[72836]: 2024-09-11 22:42:39.103643685 +0000 UTC m=+4.550343973 container cleanup 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:39.402 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:39 smithi169 bash[72836]: ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l 2024-09-11T22:42:39.402 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 11 22:42:39 smithi169 podman[72848]: 2024-09-11 22:42:39.246068432 +0000 UTC m=+0.578364263 container remove 971d30a251dfb0d4a6594700943418a187b4fc18b5f68c9f6902d3f28e4b6db2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c727338c-708b-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T22:42:39.459 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c727338c-708b-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T22:42:39.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:39.491 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T22:42:39.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:42:39.704 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:42:42.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:42:42.369 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:42:44.891 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:42:45.094 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:42:47.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:42:47.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:42:47.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:42:47.620 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T22:42:47.622 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi022/crash 2024-09-11T22:42:47.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:42:47.652 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:42:47.652 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:42:47.654 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi045/crash 2024-09-11T22:42:47.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:42:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:42:47.705 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:42:47.706 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi169/crash 2024-09-11T22:42:47.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:42:47.745 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/c727338c-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:42:47.746 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:42:47.747 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T22:42:47.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:42:47.785 INFO:teuthology.orchestra.run.smithi022.stdout:2024-09-11T22:40:00.000116+0000 mon.a (mon.0) 1347 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:42:47.786 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-11T22:42:47.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[SEC\]' /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:42:47.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]' /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:42:47.943 INFO:teuthology.orchestra.run.smithi022.stdout:2024-09-11T22:40:00.000116+0000 mon.a (mon.0) 1347 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-11T22:42:47.943 INFO:tasks.cephadm:Compressing logs... 2024-09-11T22:42:47.944 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:42:47.986 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:42:47.989 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:42:48.010 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T22:42:48.010 INFO:teuthology.orchestra.run.smithi022.stderr:: No such file or directory 2024-09-11T22:42:48.010 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T22:42:48.010 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.0.log: -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:42:48.011 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:42:48.011 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T22:42:48.011 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:42:48.011 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T22:42:48.013 INFO:teuthology.orchestra.run.smithi022.stderr:gzip/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T22:42:48.014 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.4%gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T22:42:48.014 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:42:48.014 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:42:48.015 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:42:48.015 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:42:48.016 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-11T22:42:48.016 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:42:48.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T22:42:48.016 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T22:42:48.017 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T22:42:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:: No such file or directory 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.1.log: /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T22:42:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr: 81.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.2.log: /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:42:48.022 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T22:42:48.023 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T22:42:48.023 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.l.log: 94.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T22:42:48.023 INFO:teuthology.orchestra.run.smithi169.stderr: 87.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr: 94.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:42:48.024 INFO:teuthology.orchestra.run.smithi045.stderr: 81.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr: 94.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log: 87.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr: 94.7% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T22:42:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:42:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T22:42:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log: 87.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr: 94.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.c.log: 91.0% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:42:48.030 INFO:teuthology.orchestra.run.smithi169.stderr: 94.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T22:42:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T22:42:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:42:48.032 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:42:48.033 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:42:48.034 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T22:42:48.035 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T22:42:48.035 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T22:42:48.035 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:42:48.036 INFO:teuthology.orchestra.run.smithi169.stderr: 94.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T22:42:48.038 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:42:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.e.log: 94.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T22:42:48.041 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:42:48.384 INFO:teuthology.orchestra.run.smithi022.stderr: 90.1% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T22:42:48.451 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T22:42:48.480 INFO:teuthology.orchestra.run.smithi045.stderr: 91.8% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T22:42:48.820 INFO:teuthology.orchestra.run.smithi022.stderr: 90.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T22:42:49.858 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T22:42:49.922 INFO:teuthology.orchestra.run.smithi169.stderr: 93.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T22:42:50.044 INFO:teuthology.orchestra.run.smithi022.stderr: 93.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T22:42:50.124 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T22:42:50.148 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T22:42:50.204 INFO:teuthology.orchestra.run.smithi169.stderr: 93.8% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T22:42:50.396 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T22:42:50.398 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-11T22:42:50.398 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m2.393s 2024-09-11T22:42:50.398 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m8.769s 2024-09-11T22:42:50.398 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.327s 2024-09-11T22:42:50.547 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T22:42:50.565 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T22:42:50.675 INFO:teuthology.orchestra.run.smithi045.stderr: 93.6% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T22:42:50.927 INFO:teuthology.orchestra.run.smithi022.stderr: 93.4% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T22:42:50.929 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-11T22:42:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m2.930s 2024-09-11T22:42:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m10.213s 2024-09-11T22:42:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m0.355s 2024-09-11T22:42:51.301 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T22:42:51.629 INFO:teuthology.orchestra.run.smithi045.stderr: 95.1% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T22:43:31.164 INFO:teuthology.orchestra.run.smithi045.stderr: 93.2% -- replaced with /var/log/ceph/c727338c-708b-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T22:43:31.166 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-09-11T22:43:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m43.162s 2024-09-11T22:43:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m56.186s 2024-09-11T22:43:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m1.569s 2024-09-11T22:43:31.167 INFO:tasks.cephadm:Archiving logs... 2024-09-11T22:43:31.167 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi022/log 2024-09-11T22:43:31.168 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:43:32.635 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi045/log 2024-09-11T22:43:32.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:43:40.461 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi169/log 2024-09-11T22:43:40.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:43:41.828 INFO:tasks.cephadm:Removing cluster... 2024-09-11T22:43:41.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force 2024-09-11T22:43:42.040 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:42.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force 2024-09-11T22:43:42.522 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:42.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c727338c-708b-11ef-bcea-c7b262605968 --force 2024-09-11T22:43:43.042 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: c727338c-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:43.316 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T22:43:43.316 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:43:43.336 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:43:43.352 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T22:43:43.369 INFO:tasks.cephadm:Teardown complete 2024-09-11T22:43:43.369 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T22:43:43.380 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T22:43:43.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:43:43.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:43:43.396 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:43:43.527 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T22:43:43.538 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T22:43:43.538 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:43:43.541 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:43:43.543 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:43:43.555 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:43:43.557 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:43:43.557 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1048us[+1050us] +/- 45ms 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -690us[ -690us] +/- 64ms 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1018us[-1018us] +/- 87ms 2024-09-11T22:43:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:43:43.561 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:43:43.561 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-11T22:43:43.561 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +1013us[+1029us] +/- 45ms 2024-09-11T22:43:43.561 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -707us[ -707us] +/- 64ms 2024-09-11T22:43:43.561 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -1018us[-1003us] +/- 87ms 2024-09-11T22:43:43.562 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +998us[ +983us] +/- 45ms 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -721us[ -736us] +/- 64ms 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -1055us[-1055us] +/- 87ms 2024-09-11T22:43:43.563 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:43:43.564 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T22:43:43.574 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T22:43:43.575 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T22:43:43.584 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:43:43.691 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:43:43.759 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:43:43.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:43:43.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:43.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:43:43.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:43.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:43:43.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:43.919 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T22:43:43.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T22:43:43.944 INFO:teuthology.task.internal:Duration was 1864.729308 seconds 2024-09-11T22:43:43.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T22:43:43.955 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T22:43:43.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:43:43.958 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:43:43.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:43:43.997 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:43:44.000 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:43:44.000 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:43:44.451 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T22:43:44.451 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-11T22:43:44.451 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:43:44.475 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-09-11T22:43:44.475 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:43:44.519 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-11T22:43:44.519 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:43:44.543 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T22:43:44.543 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:43:44.546 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:43:44.562 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:43:44.611 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T22:43:44.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:43:44.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:43:44.630 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:43:45.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T22:43:45.583 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T22:43:45.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:43:45.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:43:45.639 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:43:45.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T22:43:45.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.703 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-11T22:43:45.708 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-09-11T22:43:45.731 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-11T22:43:45.761 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:45.777 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:45.793 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:43:45.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:43:45.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T22:43:45.828 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T22:43:45.829 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi022 2024-09-11T22:43:45.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:43:45.887 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi045 2024-09-11T22:43:45.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:43:45.926 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901418/remote/smithi169 2024-09-11T22:43:45.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:43:45.964 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T22:43:45.965 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:43:45.968 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:43:45.971 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:43:46.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T22:43:46.028 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T22:43:46.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T22:43:46.041 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T22:43:46.042 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:43:46.044 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:43:46.047 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:43:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: 265803 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:43 /home/ubuntu/cephtest 2024-09-11T22:43:46.061 INFO:teuthology.orchestra.run.smithi045.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:43 /home/ubuntu/cephtest 2024-09-11T22:43:46.068 INFO:teuthology.orchestra.run.smithi169.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:43 /home/ubuntu/cephtest 2024-09-11T22:43:46.070 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T22:43:46.081 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T22:43:46.109 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1864.7293078899384 failure_reason: '"2024-09-11T22:40:00.000116+0000 mon.a (mon.0) 1347 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-11T22:43:46.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:43:46.206 INFO:teuthology.run:FAIL